INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.19.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36360 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:38:59,910 - lava_callback - INFO - Received callback for node 69a941227ee78ae610caa9b5 2026-03-07 08:38:59,921 - lava_callback - INFO - Starting async job submit for node 69a941227ee78ae610caa9b5 INFO: 172.19.0.1:37164 - "POST /node/69a941227ee78ae610caa9b5 HTTP/1.0" 202 Accepted 2026-03-07 08:38:59,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:38:59,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941227ee78ae610caa9b5 HTTP/1.1" 200 None 2026-03-07 08:38:59,956 - lava_callback - DEBUG - Processing node 69a941227ee78ae610caa9b5: baseline-arm64-baylibre 2026-03-07 08:38:59,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a941227ee78ae610caa9b5 2026-03-07 08:38:59,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:38:59,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941227ee78ae610caa9b5 HTTP/1.1" 200 None 2026-03-07 08:38:59,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:38:59,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 08:38:59,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:39:00,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a941227ee78ae610caa9b5 HTTP/1.1" 200 None 2026-03-07 08:39:00,046 - lava_callback - ERROR - Error processing callback for node 69a941227ee78ae610caa9b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37346 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:40:40,002 - lava_callback - INFO - Received callback for node 69a941867ee78ae610caaa0c INFO: 172.19.0.1:38654 - "POST /node/69a941867ee78ae610caaa0c HTTP/1.0" 202 Accepted 2026-03-07 08:40:40,008 - lava_callback - INFO - Starting async job submit for node 69a941867ee78ae610caaa0c 2026-03-07 08:40:40,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:40:40,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941867ee78ae610caaa0c HTTP/1.1" 200 None 2026-03-07 08:40:40,024 - lava_callback - DEBUG - Processing node 69a941867ee78ae610caaa0c: baseline-arm64-baylibre 2026-03-07 08:40:40,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a941867ee78ae610caaa0c 2026-03-07 08:40:40,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:40:40,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941867ee78ae610caaa0c HTTP/1.1" 200 None 2026-03-07 08:40:40,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:40:40,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 08:40:40,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:40:40,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a941867ee78ae610caaa0c HTTP/1.1" 200 None 2026-03-07 08:40:40,078 - lava_callback - ERROR - Error processing callback for node 69a941867ee78ae610caaa0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45356 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:42:00,040 - lava_callback - INFO - Received callback for node 69a941cf7ee78ae610caaa51 INFO: 172.19.0.1:36394 - "POST /node/69a941cf7ee78ae610caaa51 HTTP/1.0" 202 Accepted 2026-03-07 08:42:00,048 - lava_callback - INFO - Starting async job submit for node 69a941cf7ee78ae610caaa51 2026-03-07 08:42:00,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:00,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941cf7ee78ae610caaa51 HTTP/1.1" 200 None 2026-03-07 08:42:00,075 - lava_callback - DEBUG - Processing node 69a941cf7ee78ae610caaa51: baseline-arm-baylibre 2026-03-07 08:42:00,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a941cf7ee78ae610caaa51 2026-03-07 08:42:00,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:00,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941cf7ee78ae610caaa51 HTTP/1.1" 200 None 2026-03-07 08:42:00,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:00,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:42:00,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:00,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a941cf7ee78ae610caaa51 HTTP/1.1" 200 None 2026-03-07 08:42:00,201 - lava_callback - ERROR - Error processing callback for node 69a941cf7ee78ae610caaa51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54036 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:42:40,026 - lava_callback - INFO - Received callback for node 69a941fd7ee78ae610caaa9b INFO: 172.19.0.1:44328 - "POST /node/69a941fd7ee78ae610caaa9b HTTP/1.0" 202 Accepted 2026-03-07 08:42:40,035 - lava_callback - INFO - Starting async job submit for node 69a941fd7ee78ae610caaa9b 2026-03-07 08:42:40,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:40,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941fd7ee78ae610caaa9b HTTP/1.1" 200 None 2026-03-07 08:42:40,068 - lava_callback - DEBUG - Processing node 69a941fd7ee78ae610caaa9b: baseline-arm-baylibre 2026-03-07 08:42:40,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a941fd7ee78ae610caaa9b 2026-03-07 08:42:40,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:40,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941fd7ee78ae610caaa9b HTTP/1.1" 200 None 2026-03-07 08:42:40,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:40,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:42:40,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:40,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a941fd7ee78ae610caaa9b HTTP/1.1" 200 None 2026-03-07 08:42:40,173 - lava_callback - ERROR - Error processing callback for node 69a941fd7ee78ae610caaa9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58436 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:43:40,281 - lava_callback - INFO - Received callback for node 69a9422c7ee78ae610caaac1 INFO: 172.19.0.1:49778 - "POST /node/69a9422c7ee78ae610caaac1 HTTP/1.0" 202 Accepted 2026-03-07 08:43:40,287 - lava_callback - INFO - Starting async job submit for node 69a9422c7ee78ae610caaac1 2026-03-07 08:43:40,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:43:40,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9422c7ee78ae610caaac1 HTTP/1.1" 200 None 2026-03-07 08:43:40,303 - lava_callback - DEBUG - Processing node 69a9422c7ee78ae610caaac1: baseline-arm-baylibre 2026-03-07 08:43:40,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9422c7ee78ae610caaac1 2026-03-07 08:43:40,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:43:40,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9422c7ee78ae610caaac1 HTTP/1.1" 200 None 2026-03-07 08:43:40,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:43:40,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:43:40,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:43:40,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9422c7ee78ae610caaac1 HTTP/1.1" 200 None 2026-03-07 08:43:40,373 - lava_callback - ERROR - Error processing callback for node 69a9422c7ee78ae610caaac1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53296 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:44:20,201 - lava_callback - INFO - Received callback for node 69a9425c7ee78ae610caab19 INFO: 172.19.0.1:57292 - "POST /node/69a9425c7ee78ae610caab19 HTTP/1.0" 202 Accepted 2026-03-07 08:44:20,207 - lava_callback - INFO - Starting async job submit for node 69a9425c7ee78ae610caab19 2026-03-07 08:44:20,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:20,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9425c7ee78ae610caab19 HTTP/1.1" 200 None 2026-03-07 08:44:20,228 - lava_callback - DEBUG - Processing node 69a9425c7ee78ae610caab19: baseline-arm-baylibre 2026-03-07 08:44:20,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9425c7ee78ae610caab19 2026-03-07 08:44:20,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:20,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9425c7ee78ae610caab19 HTTP/1.1" 200 None 2026-03-07 08:44:20,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:20,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:44:20,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:20,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9425c7ee78ae610caab19 HTTP/1.1" 200 None 2026-03-07 08:44:20,291 - lava_callback - ERROR - Error processing callback for node 69a9425c7ee78ae610caab19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50446 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:44:41,509 - lava_callback - INFO - Received callback for node 69abe55540deb775998f3f0d INFO: 172.19.0.1:43294 - "POST /node/69abe55540deb775998f3f0d HTTP/1.0" 202 Accepted 2026-03-07 08:44:41,515 - lava_callback - INFO - Starting async job submit for node 69abe55540deb775998f3f0d 2026-03-07 08:44:41,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:41,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55540deb775998f3f0d HTTP/1.1" 200 None 2026-03-07 08:44:41,566 - lava_callback - DEBUG - Processing node 69abe55540deb775998f3f0d: baseline-x86 2026-03-07 08:44:41,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:41,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:41,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55540deb775998f3f0d/log.txt.gz 2026-03-07 08:44:42,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:42,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:42,226 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55540deb775998f3f0d/lava-logs.yaml 2026-03-07 08:44:42,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:42,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:42,413 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55540deb775998f3f0d/lava_callback.json.gz 2026-03-07 08:44:42,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:42,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55540deb775998f3f0d HTTP/1.1" 200 None 2026-03-07 08:44:42,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:42,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf4740deb775998f3bd2 HTTP/1.1" 200 None 2026-03-07 08:44:42,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:42,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe55540deb775998f3f0d HTTP/1.1" 200 None 2026-03-07 08:44:42,502 - lava_callback - INFO - Completed processing callback for node 69abe55540deb775998f3f0d INFO: 172.19.0.1:43300 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:44:52,156 - lava_callback - INFO - Received callback for node 69abe55740deb775998f3f16 INFO: 172.19.0.1:40324 - "POST /node/69abe55740deb775998f3f16 HTTP/1.0" 202 Accepted 2026-03-07 08:44:52,167 - lava_callback - INFO - Starting async job submit for node 69abe55740deb775998f3f16 2026-03-07 08:44:52,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:52,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55740deb775998f3f16 HTTP/1.1" 200 None 2026-03-07 08:44:52,244 - lava_callback - DEBUG - Processing node 69abe55740deb775998f3f16: baseline-x86 2026-03-07 08:44:52,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:52,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:52,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f16/log.txt.gz 2026-03-07 08:44:52,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:53,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:53,292 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f16/lava-logs.yaml 2026-03-07 08:44:53,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:53,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:53,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f16/lava_callback.json.gz 2026-03-07 08:44:53,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:53,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55740deb775998f3f16 HTTP/1.1" 200 None 2026-03-07 08:44:53,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:53,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf4740deb775998f3bd2 HTTP/1.1" 200 None 2026-03-07 08:44:53,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:53,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe55740deb775998f3f16 HTTP/1.1" 200 None 2026-03-07 08:44:53,750 - lava_callback - INFO - Completed processing callback for node 69abe55740deb775998f3f16 INFO: 172.19.0.1:40334 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:45:00,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:45:00,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43356 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:46:16,593 - lava_callback - INFO - Received callback for node 69abe55f40deb775998f3f21 INFO: 172.19.0.1:43368 - "POST /node/69abe55f40deb775998f3f21 HTTP/1.0" 202 Accepted 2026-03-07 08:46:16,600 - lava_callback - INFO - Starting async job submit for node 69abe55f40deb775998f3f21 2026-03-07 08:46:16,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:16,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55f40deb775998f3f21 HTTP/1.1" 200 None 2026-03-07 08:46:16,641 - lava_callback - DEBUG - Processing node 69abe55f40deb775998f3f21: baseline-arm 2026-03-07 08:46:16,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:46:17,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:46:17,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe55f40deb775998f3f21/log.txt.gz 2026-03-07 08:46:17,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:46:17,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:46:17,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe55f40deb775998f3f21/lava-logs.yaml 2026-03-07 08:46:17,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:46:17,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:46:17,968 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe55f40deb775998f3f21/lava_callback.json.gz 2026-03-07 08:46:17,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:18,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55f40deb775998f3f21 HTTP/1.1" 200 None 2026-03-07 08:46:18,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:18,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2b40deb775998f3bab HTTP/1.1" 200 None 2026-03-07 08:46:18,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:18,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe55f40deb775998f3f21 HTTP/1.1" 200 None 2026-03-07 08:46:18,077 - lava_callback - INFO - Completed processing callback for node 69abe55f40deb775998f3f21 INFO: 172.19.0.1:51780 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:46:30,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:30,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33318 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:46:40,279 - lava_callback - INFO - Received callback for node 69a942e47ee78ae610caabff INFO: 172.19.0.1:40124 - "POST /node/69a942e47ee78ae610caabff HTTP/1.0" 202 Accepted 2026-03-07 08:46:40,284 - lava_callback - INFO - Starting async job submit for node 69a942e47ee78ae610caabff 2026-03-07 08:46:40,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:40,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a942e47ee78ae610caabff HTTP/1.1" 200 None 2026-03-07 08:46:40,300 - lava_callback - DEBUG - Processing node 69a942e47ee78ae610caabff: baseline-arm-baylibre 2026-03-07 08:46:40,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a942e47ee78ae610caabff 2026-03-07 08:46:40,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:40,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a942e47ee78ae610caabff HTTP/1.1" 200 None 2026-03-07 08:46:40,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:40,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:46:40,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:40,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a942e47ee78ae610caabff HTTP/1.1" 200 None 2026-03-07 08:46:40,365 - lava_callback - ERROR - Error processing callback for node 69a942e47ee78ae610caabff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50684 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:47:20,288 - lava_callback - INFO - Received callback for node 69a943117ee78ae610caac7c INFO: 172.19.0.1:54464 - "POST /node/69a943117ee78ae610caac7c HTTP/1.0" 202 Accepted 2026-03-07 08:47:20,293 - lava_callback - INFO - Starting async job submit for node 69a943117ee78ae610caac7c 2026-03-07 08:47:20,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:20,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943117ee78ae610caac7c HTTP/1.1" 200 None 2026-03-07 08:47:20,311 - lava_callback - DEBUG - Processing node 69a943117ee78ae610caac7c: baseline-arm-baylibre 2026-03-07 08:47:20,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943117ee78ae610caac7c 2026-03-07 08:47:20,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:20,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943117ee78ae610caac7c HTTP/1.1" 200 None 2026-03-07 08:47:20,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:20,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:47:20,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:20,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943117ee78ae610caac7c HTTP/1.1" 200 None 2026-03-07 08:47:20,387 - lava_callback - ERROR - Error processing callback for node 69a943117ee78ae610caac7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54468 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:47:34,449 - lava_callback - INFO - Received callback for node 69abe61a40deb775998f3f90 INFO: 172.19.0.1:56510 - "POST /node/69abe61a40deb775998f3f90 HTTP/1.0" 202 Accepted 2026-03-07 08:47:34,461 - lava_callback - INFO - Starting async job submit for node 69abe61a40deb775998f3f90 2026-03-07 08:47:34,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:34,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61a40deb775998f3f90 HTTP/1.1" 200 None 2026-03-07 08:47:34,501 - lava_callback - DEBUG - Processing node 69abe61a40deb775998f3f90: baseline-arm 2026-03-07 08:47:34,510 - lava_callback - WARNING - Failed to upload log 2026-03-07 08:47:34,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:47:34,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:47:34,652 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61a40deb775998f3f90/lava-logs.yaml 2026-03-07 08:47:34,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:47:35,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:47:35,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61a40deb775998f3f90/lava_callback.json.gz 2026-03-07 08:47:35,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:35,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61a40deb775998f3f90 HTTP/1.1" 200 None 2026-03-07 08:47:35,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:35,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:47:35,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:35,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61a40deb775998f3f90 HTTP/1.1" 200 None 2026-03-07 08:47:35,186 - lava_callback - INFO - Completed processing callback for node 69abe61a40deb775998f3f90 INFO: 172.19.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48232 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:00,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:00,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51754 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:11,609 - lava_callback - INFO - Received callback for node 69abe61b40deb775998f3f93 INFO: 172.19.0.1:60638 - "POST /node/69abe61b40deb775998f3f93 HTTP/1.0" 202 Accepted 2026-03-07 08:48:11,666 - lava_callback - INFO - Starting async job submit for node 69abe61b40deb775998f3f93 2026-03-07 08:48:11,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:11,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61b40deb775998f3f93 HTTP/1.1" 200 None 2026-03-07 08:48:11,731 - lava_callback - DEBUG - Processing node 69abe61b40deb775998f3f93: baseline-arm 2026-03-07 08:48:12,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:12,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:12,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f93/log.txt.gz 2026-03-07 08:48:12,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:12,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:12,676 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f93/lava-logs.yaml 2026-03-07 08:48:12,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:12,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:12,852 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f93/lava_callback.json.gz 2026-03-07 08:48:12,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:12,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61b40deb775998f3f93 HTTP/1.1" 200 None 2026-03-07 08:48:12,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:12,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:48:12,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:12,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61b40deb775998f3f93 HTTP/1.1" 200 None 2026-03-07 08:48:12,944 - lava_callback - INFO - Completed processing callback for node 69abe61b40deb775998f3f93 2026-03-07 08:48:15,106 - lava_callback - INFO - Received callback for node 69abe61e40deb775998f3f9d INFO: 172.19.0.1:60654 - "POST /node/69abe61e40deb775998f3f9d HTTP/1.0" 202 Accepted 2026-03-07 08:48:15,155 - lava_callback - INFO - Starting async job submit for node 69abe61e40deb775998f3f9d INFO: 172.19.0.1:60670 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 08:48:15,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:15,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61e40deb775998f3f9d HTTP/1.1" 200 None 2026-03-07 08:48:15,191 - lava_callback - DEBUG - Processing node 69abe61e40deb775998f3f9d: baseline-arm 2026-03-07 08:48:15,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:15,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:15,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61e40deb775998f3f9d/log.txt.gz 2026-03-07 08:48:15,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:16,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:16,031 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61e40deb775998f3f9d/lava-logs.yaml 2026-03-07 08:48:16,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:16,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:16,189 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61e40deb775998f3f9d/lava_callback.json.gz 2026-03-07 08:48:16,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:16,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61e40deb775998f3f9d HTTP/1.1" 200 None 2026-03-07 08:48:16,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:16,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:48:16,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:16,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61e40deb775998f3f9d HTTP/1.1" 200 None 2026-03-07 08:48:16,285 - lava_callback - INFO - Completed processing callback for node 69abe61e40deb775998f3f9d INFO: 172.19.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47740 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:30,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:30,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:43940 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:38,858 - lava_callback - INFO - Received callback for node 69abe63340deb775998f3fe8 INFO: 172.19.0.1:43946 - "POST /node/69abe63340deb775998f3fe8 HTTP/1.0" 202 Accepted 2026-03-07 08:48:38,870 - lava_callback - INFO - Starting async job submit for node 69abe63340deb775998f3fe8 2026-03-07 08:48:38,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:38,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63340deb775998f3fe8 HTTP/1.1" 200 None 2026-03-07 08:48:38,945 - lava_callback - DEBUG - Processing node 69abe63340deb775998f3fe8: baseline-arm-clabbe 2026-03-07 08:48:39,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:39,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:39,324 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63340deb775998f3fe8/log.txt.gz 2026-03-07 08:48:39,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:39,679 - lava_callback - INFO - Received callback for node 69abe61940deb775998f3f8d 2026-03-07 08:48:39,689 - lava_callback - INFO - Starting async job submit for node 69abe61940deb775998f3f8d INFO: 172.19.0.1:43948 - "POST /node/69abe61940deb775998f3f8d HTTP/1.0" 202 Accepted 2026-03-07 08:48:39,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:39,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61940deb775998f3f8d HTTP/1.1" 200 None 2026-03-07 08:48:39,772 - lava_callback - DEBUG - Processing node 69abe61940deb775998f3f8d: baseline-arm 2026-03-07 08:48:40,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:40,070 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63340deb775998f3fe8/lava-logs.yaml 2026-03-07 08:48:40,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:40,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:40,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:40,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61940deb775998f3f8d/log.txt.gz 2026-03-07 08:48:40,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:40,265 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63340deb775998f3fe8/lava_callback.json.gz 2026-03-07 08:48:40,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63340deb775998f3fe8 HTTP/1.1" 200 None 2026-03-07 08:48:40,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,507 - lava_callback - INFO - Received callback for node 69a9435b7ee78ae610caacd7 2026-03-07 08:48:40,541 - lava_callback - INFO - Starting async job submit for node 69a9435b7ee78ae610caacd7 2026-03-07 08:48:40,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:41374 - "POST /node/69a9435b7ee78ae610caacd7 HTTP/1.0" 202 Accepted 2026-03-07 08:48:40,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:48:40,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:40,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435b7ee78ae610caacd7 HTTP/1.1" 200 None 2026-03-07 08:48:40,616 - lava_callback - DEBUG - Processing node 69a9435b7ee78ae610caacd7: baseline-arm-baylibre 2026-03-07 08:48:40,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9435b7ee78ae610caacd7 2026-03-07 08:48:40,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435b7ee78ae610caacd7 HTTP/1.1" 200 None 2026-03-07 08:48:40,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63340deb775998f3fe8 HTTP/1.1" 200 None 2026-03-07 08:48:40,662 - lava_callback - INFO - Completed processing callback for node 69abe63340deb775998f3fe8 2026-03-07 08:48:40,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:40,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9435b7ee78ae610caacd7 HTTP/1.1" 200 None 2026-03-07 08:48:40,770 - lava_callback - ERROR - Error processing callback for node 69a9435b7ee78ae610caacd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:48:41,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:41,224 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61940deb775998f3f8d/lava-logs.yaml 2026-03-07 08:48:41,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:41,235 - lava_callback - INFO - Received callback for node 69a9435d7ee78ae610caacda INFO: 172.19.0.1:41390 - "POST /node/69a9435d7ee78ae610caacda HTTP/1.0" 202 Accepted 2026-03-07 08:48:41,246 - lava_callback - INFO - Starting async job submit for node 69a9435d7ee78ae610caacda 2026-03-07 08:48:41,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435d7ee78ae610caacda HTTP/1.1" 200 None 2026-03-07 08:48:41,278 - lava_callback - DEBUG - Processing node 69a9435d7ee78ae610caacda: baseline-arm-baylibre 2026-03-07 08:48:41,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9435d7ee78ae610caacda 2026-03-07 08:48:41,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435d7ee78ae610caacda HTTP/1.1" 200 None 2026-03-07 08:48:41,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:41,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9435d7ee78ae610caacda HTTP/1.1" 200 None 2026-03-07 08:48:41,357 - lava_callback - ERROR - Error processing callback for node 69a9435d7ee78ae610caacda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:48:41,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:41,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61940deb775998f3f8d/lava_callback.json.gz 2026-03-07 08:48:41,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61940deb775998f3f8d HTTP/1.1" 200 None 2026-03-07 08:48:41,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:48:41,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61940deb775998f3f8d HTTP/1.1" 200 None 2026-03-07 08:48:41,691 - lava_callback - INFO - Completed processing callback for node 69abe61940deb775998f3f8d 2026-03-07 08:48:41,961 - lava_callback - INFO - Received callback for node 69a9435e7ee78ae610caacdd INFO: 172.19.0.1:41406 - "POST /node/69a9435e7ee78ae610caacdd HTTP/1.0" 202 Accepted 2026-03-07 08:48:41,970 - lava_callback - INFO - Starting async job submit for node 69a9435e7ee78ae610caacdd 2026-03-07 08:48:41,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435e7ee78ae610caacdd HTTP/1.1" 200 None 2026-03-07 08:48:42,040 - lava_callback - DEBUG - Processing node 69a9435e7ee78ae610caacdd: baseline-arm-baylibre 2026-03-07 08:48:42,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9435e7ee78ae610caacdd 2026-03-07 08:48:42,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435e7ee78ae610caacdd HTTP/1.1" 200 None 2026-03-07 08:48:42,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:42,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9435e7ee78ae610caacdd HTTP/1.1" 200 None 2026-03-07 08:48:42,158 - lava_callback - ERROR - Error processing callback for node 69a9435e7ee78ae610caacdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:48:42,673 - lava_callback - INFO - Received callback for node 69a9435f7ee78ae610caace2 INFO: 172.19.0.1:41412 - "POST /node/69a9435f7ee78ae610caace2 HTTP/1.0" 202 Accepted 2026-03-07 08:48:42,682 - lava_callback - INFO - Starting async job submit for node 69a9435f7ee78ae610caace2 2026-03-07 08:48:42,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435f7ee78ae610caace2 HTTP/1.1" 200 None 2026-03-07 08:48:42,709 - lava_callback - DEBUG - Processing node 69a9435f7ee78ae610caace2: baseline-arm-baylibre 2026-03-07 08:48:42,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9435f7ee78ae610caace2 2026-03-07 08:48:42,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435f7ee78ae610caace2 HTTP/1.1" 200 None 2026-03-07 08:48:42,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:42,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9435f7ee78ae610caace2 HTTP/1.1" 200 None 2026-03-07 08:48:42,796 - lava_callback - ERROR - Error processing callback for node 69a9435f7ee78ae610caace2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:48:43,374 - lava_callback - INFO - Received callback for node 69a943627ee78ae610caacfd INFO: 172.19.0.1:41414 - "POST /node/69a943627ee78ae610caacfd HTTP/1.0" 202 Accepted 2026-03-07 08:48:43,379 - lava_callback - INFO - Starting async job submit for node 69a943627ee78ae610caacfd 2026-03-07 08:48:43,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:43,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943627ee78ae610caacfd HTTP/1.1" 200 None 2026-03-07 08:48:43,398 - lava_callback - DEBUG - Processing node 69a943627ee78ae610caacfd: baseline-arm-baylibre 2026-03-07 08:48:43,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943627ee78ae610caacfd 2026-03-07 08:48:43,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:43,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943627ee78ae610caacfd HTTP/1.1" 200 None 2026-03-07 08:48:43,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:43,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:43,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:43,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943627ee78ae610caacfd HTTP/1.1" 200 None 2026-03-07 08:48:43,502 - lava_callback - ERROR - Error processing callback for node 69a943627ee78ae610caacfd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:48:44,069 - lava_callback - INFO - Received callback for node 69a943647ee78ae610caad00 INFO: 172.19.0.1:41430 - "POST /node/69a943647ee78ae610caad00 HTTP/1.0" 202 Accepted 2026-03-07 08:48:44,075 - lava_callback - INFO - Starting async job submit for node 69a943647ee78ae610caad00 2026-03-07 08:48:44,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:44,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943647ee78ae610caad00 HTTP/1.1" 200 None 2026-03-07 08:48:44,118 - lava_callback - DEBUG - Processing node 69a943647ee78ae610caad00: baseline-arm-baylibre 2026-03-07 08:48:44,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943647ee78ae610caad00 2026-03-07 08:48:44,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:44,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943647ee78ae610caad00 HTTP/1.1" 200 None 2026-03-07 08:48:44,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:44,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:44,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:44,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943647ee78ae610caad00 HTTP/1.1" 200 None 2026-03-07 08:48:44,219 - lava_callback - ERROR - Error processing callback for node 69a943647ee78ae610caad00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41446 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:52,987 - lava_callback - INFO - Received callback for node 69a9436f7ee78ae610caad1f INFO: 172.19.0.1:36010 - "POST /node/69a9436f7ee78ae610caad1f HTTP/1.0" 202 Accepted 2026-03-07 08:48:52,993 - lava_callback - INFO - Starting async job submit for node 69a9436f7ee78ae610caad1f 2026-03-07 08:48:52,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:53,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9436f7ee78ae610caad1f HTTP/1.1" 200 None 2026-03-07 08:48:53,009 - lava_callback - DEBUG - Processing node 69a9436f7ee78ae610caad1f: baseline-arm-clabbe 2026-03-07 08:48:53,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9436f7ee78ae610caad1f 2026-03-07 08:48:53,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:53,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9436f7ee78ae610caad1f HTTP/1.1" 200 None 2026-03-07 08:48:53,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:53,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:53,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:53,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9436f7ee78ae610caad1f HTTP/1.1" 200 None 2026-03-07 08:48:53,086 - lava_callback - ERROR - Error processing callback for node 69a9436f7ee78ae610caad1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36022 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:56,983 - lava_callback - INFO - Received callback for node 69abe62d40deb775998f3fd9 INFO: 172.19.0.1:36034 - "POST /node/69abe62d40deb775998f3fd9 HTTP/1.0" 202 Accepted 2026-03-07 08:48:56,989 - lava_callback - INFO - Starting async job submit for node 69abe62d40deb775998f3fd9 2026-03-07 08:48:57,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:57,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62d40deb775998f3fd9 HTTP/1.1" 200 None 2026-03-07 08:48:57,045 - lava_callback - DEBUG - Processing node 69abe62d40deb775998f3fd9: baseline-arm-broonie 2026-03-07 08:48:57,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:57,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:57,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62d40deb775998f3fd9/log.txt.gz 2026-03-07 08:48:57,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:57,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:57,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62d40deb775998f3fd9/lava-logs.yaml 2026-03-07 08:48:57,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:57,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:57,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62d40deb775998f3fd9/lava_callback.json.gz 2026-03-07 08:48:57,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:57,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62d40deb775998f3fd9 HTTP/1.1" 200 None 2026-03-07 08:48:57,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:57,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:48:57,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:57,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe62d40deb775998f3fd9 HTTP/1.1" 200 None 2026-03-07 08:48:57,933 - lava_callback - INFO - Completed processing callback for node 69abe62d40deb775998f3fd9 2026-03-07 08:49:00,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:00,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42166 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:49:12,933 - lava_callback - INFO - Received callback for node 69a943747ee78ae610caad2e INFO: 172.19.0.1:37310 - "POST /node/69a943747ee78ae610caad2e HTTP/1.0" 202 Accepted 2026-03-07 08:49:12,940 - lava_callback - INFO - Starting async job submit for node 69a943747ee78ae610caad2e 2026-03-07 08:49:12,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:12,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943747ee78ae610caad2e HTTP/1.1" 200 None 2026-03-07 08:49:12,964 - lava_callback - DEBUG - Processing node 69a943747ee78ae610caad2e: baseline-arm-clabbe 2026-03-07 08:49:12,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943747ee78ae610caad2e 2026-03-07 08:49:12,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:12,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943747ee78ae610caad2e HTTP/1.1" 200 None 2026-03-07 08:49:12,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:13,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:49:13,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:13,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943747ee78ae610caad2e HTTP/1.1" 200 None 2026-03-07 08:49:13,049 - lava_callback - ERROR - Error processing callback for node 69a943747ee78ae610caad2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37314 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 08:49:15,176 - lava_callback - INFO - Received callback for node 69abe64440deb775998f4037 INFO: 172.19.0.1:37316 - "POST /node/69abe64440deb775998f4037 HTTP/1.0" 202 Accepted 2026-03-07 08:49:15,185 - lava_callback - INFO - Starting async job submit for node 69abe64440deb775998f4037 2026-03-07 08:49:15,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:15,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64440deb775998f4037 HTTP/1.1" 200 None 2026-03-07 08:49:15,258 - lava_callback - DEBUG - Processing node 69abe64440deb775998f4037: baseline-arm-pengutronix 2026-03-07 08:49:15,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:15,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:15,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64440deb775998f4037/log.txt.gz 2026-03-07 08:49:15,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:16,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:16,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64440deb775998f4037/lava-logs.yaml 2026-03-07 08:49:16,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:16,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:16,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64440deb775998f4037/lava_callback.json.gz 2026-03-07 08:49:16,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:16,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64440deb775998f4037 HTTP/1.1" 200 None 2026-03-07 08:49:16,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:16,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:16,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:16,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe64440deb775998f4037 HTTP/1.1" 200 None 2026-03-07 08:49:16,499 - lava_callback - INFO - Completed processing callback for node 69abe64440deb775998f4037 INFO: 172.19.0.1:37326 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:49:16,713 - lava_callback - INFO - Received callback for node 69abe62f40deb775998f3fdc INFO: 172.19.0.1:37334 - "POST /node/69abe62f40deb775998f3fdc HTTP/1.0" 202 Accepted 2026-03-07 08:49:16,724 - lava_callback - INFO - Starting async job submit for node 69abe62f40deb775998f3fdc 2026-03-07 08:49:16,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:16,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62f40deb775998f3fdc HTTP/1.1" 200 None 2026-03-07 08:49:16,827 - lava_callback - DEBUG - Processing node 69abe62f40deb775998f3fdc: baseline-arm-broonie 2026-03-07 08:49:17,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:17,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:17,485 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62f40deb775998f3fdc/log.txt.gz 2026-03-07 08:49:17,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:18,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:18,031 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62f40deb775998f3fdc/lava-logs.yaml 2026-03-07 08:49:18,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:18,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:18,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62f40deb775998f3fdc/lava_callback.json.gz 2026-03-07 08:49:18,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:18,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62f40deb775998f3fdc HTTP/1.1" 200 None 2026-03-07 08:49:18,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:18,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:18,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:18,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe62f40deb775998f3fdc HTTP/1.1" 200 None 2026-03-07 08:49:18,359 - lava_callback - INFO - Completed processing callback for node 69abe62f40deb775998f3fdc 2026-03-07 08:49:18,407 - lava_callback - INFO - Received callback for node 69abe64740deb775998f403f INFO: 172.19.0.1:37342 - "POST /node/69abe64740deb775998f403f HTTP/1.0" 202 Accepted 2026-03-07 08:49:18,464 - lava_callback - INFO - Starting async job submit for node 69abe64740deb775998f403f 2026-03-07 08:49:18,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:18,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64740deb775998f403f HTTP/1.1" 200 None 2026-03-07 08:49:18,549 - lava_callback - DEBUG - Processing node 69abe64740deb775998f403f: baseline-arm-pengutronix 2026-03-07 08:49:18,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:18,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:18,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64740deb775998f403f/log.txt.gz 2026-03-07 08:49:19,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:19,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:19,513 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64740deb775998f403f/lava-logs.yaml 2026-03-07 08:49:19,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:19,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:19,654 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64740deb775998f403f/lava_callback.json.gz 2026-03-07 08:49:19,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:19,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64740deb775998f403f HTTP/1.1" 200 None 2026-03-07 08:49:19,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:19,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:19,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:19,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe64740deb775998f403f HTTP/1.1" 200 None 2026-03-07 08:49:19,735 - lava_callback - INFO - Completed processing callback for node 69abe64740deb775998f403f 2026-03-07 08:49:22,745 - lava_callback - INFO - Received callback for node 69abe63640deb775998f3ff0 INFO: 172.19.0.1:33314 - "POST /node/69abe63640deb775998f3ff0 HTTP/1.0" 202 Accepted 2026-03-07 08:49:22,752 - lava_callback - INFO - Starting async job submit for node 69abe63640deb775998f3ff0 2026-03-07 08:49:22,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:22,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63640deb775998f3ff0 HTTP/1.1" 200 None 2026-03-07 08:49:22,792 - lava_callback - DEBUG - Processing node 69abe63640deb775998f3ff0: baseline-arm-clabbe 2026-03-07 08:49:23,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:23,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:23,348 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63640deb775998f3ff0/log.txt.gz 2026-03-07 08:49:23,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:23,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:23,923 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63640deb775998f3ff0/lava-logs.yaml 2026-03-07 08:49:23,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:24,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:24,079 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63640deb775998f3ff0/lava_callback.json.gz 2026-03-07 08:49:24,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:24,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63640deb775998f3ff0 HTTP/1.1" 200 None 2026-03-07 08:49:24,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:24,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:24,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:24,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63640deb775998f3ff0 HTTP/1.1" 200 None 2026-03-07 08:49:24,167 - lava_callback - INFO - Completed processing callback for node 69abe63640deb775998f3ff0 INFO: 172.19.0.1:33320 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:49:26,669 - lava_callback - INFO - Received callback for node 69abe63040deb775998f3fdf INFO: 172.19.0.1:33332 - "POST /node/69abe63040deb775998f3fdf HTTP/1.0" 202 Accepted 2026-03-07 08:49:26,675 - lava_callback - INFO - Starting async job submit for node 69abe63040deb775998f3fdf 2026-03-07 08:49:26,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:26,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63040deb775998f3fdf HTTP/1.1" 200 None 2026-03-07 08:49:26,716 - lava_callback - DEBUG - Processing node 69abe63040deb775998f3fdf: baseline-arm-broonie 2026-03-07 08:49:27,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:27,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:27,303 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe63040deb775998f3fdf/log.txt.gz 2026-03-07 08:49:27,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:27,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:27,899 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe63040deb775998f3fdf/lava-logs.yaml 2026-03-07 08:49:27,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:28,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:28,092 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe63040deb775998f3fdf/lava_callback.json.gz 2026-03-07 08:49:28,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:28,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63040deb775998f3fdf HTTP/1.1" 200 None 2026-03-07 08:49:28,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:28,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:28,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:28,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63040deb775998f3fdf HTTP/1.1" 200 None 2026-03-07 08:49:28,200 - lava_callback - INFO - Completed processing callback for node 69abe63040deb775998f3fdf 2026-03-07 08:49:29,170 - lava_callback - INFO - Received callback for node 69abe63a40deb775998f3ffd INFO: 172.19.0.1:33344 - "POST /node/69abe63a40deb775998f3ffd HTTP/1.0" 202 Accepted 2026-03-07 08:49:29,179 - lava_callback - INFO - Starting async job submit for node 69abe63a40deb775998f3ffd 2026-03-07 08:49:29,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:29,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63a40deb775998f3ffd HTTP/1.1" 200 None 2026-03-07 08:49:29,248 - lava_callback - DEBUG - Processing node 69abe63a40deb775998f3ffd: baseline-arm-clabbe 2026-03-07 08:49:29,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:29,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:29,668 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63a40deb775998f3ffd/log.txt.gz 2026-03-07 08:49:29,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:30,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:30,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:30,212 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63a40deb775998f3ffd/lava-logs.yaml 2026-03-07 08:49:30,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:30,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-07 08:49:30,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:30,357 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63a40deb775998f3ffd/lava_callback.json.gz 2026-03-07 08:49:30,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:30,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63a40deb775998f3ffd HTTP/1.1" 200 None 2026-03-07 08:49:30,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:30,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:30,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:30,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63a40deb775998f3ffd HTTP/1.1" 200 None 2026-03-07 08:49:30,480 - lava_callback - INFO - Completed processing callback for node 69abe63a40deb775998f3ffd INFO: 172.19.0.1:41540 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:49:40,486 - lava_callback - INFO - Received callback for node 69a943947ee78ae610caadb5 INFO: 172.19.0.1:57678 - "POST /node/69a943947ee78ae610caadb5 HTTP/1.0" 202 Accepted 2026-03-07 08:49:40,495 - lava_callback - INFO - Starting async job submit for node 69a943947ee78ae610caadb5 2026-03-07 08:49:40,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:40,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943947ee78ae610caadb5 HTTP/1.1" 200 None 2026-03-07 08:49:40,524 - lava_callback - DEBUG - Processing node 69a943947ee78ae610caadb5: baseline-arm64-baylibre 2026-03-07 08:49:40,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943947ee78ae610caadb5 2026-03-07 08:49:40,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:40,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943947ee78ae610caadb5 HTTP/1.1" 200 None 2026-03-07 08:49:40,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:40,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 08:49:40,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:40,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943947ee78ae610caadb5 HTTP/1.1" 200 None 2026-03-07 08:49:40,649 - lava_callback - ERROR - Error processing callback for node 69a943947ee78ae610caadb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:49:40,753 - lava_callback - INFO - Received callback for node 69abe64040deb775998f4027 INFO: 172.19.0.1:57688 - "POST /node/69abe64040deb775998f4027 HTTP/1.0" 202 Accepted 2026-03-07 08:49:40,763 - lava_callback - INFO - Starting async job submit for node 69abe64040deb775998f4027 2026-03-07 08:49:40,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:40,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64040deb775998f4027 HTTP/1.1" 200 None 2026-03-07 08:49:40,807 - lava_callback - DEBUG - Processing node 69abe64040deb775998f4027: baseline-arm-kontron 2026-03-07 08:49:41,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:41,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:41,414 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69abe64040deb775998f4027/log.txt.gz 2026-03-07 08:49:41,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:42,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:42,092 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69abe64040deb775998f4027/lava-logs.yaml 2026-03-07 08:49:42,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:42,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:42,225 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69abe64040deb775998f4027/lava_callback.json.gz 2026-03-07 08:49:42,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:42,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64040deb775998f4027 HTTP/1.1" 200 None 2026-03-07 08:49:42,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:42,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:42,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:42,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe64040deb775998f4027 HTTP/1.1" 200 None 2026-03-07 08:49:42,320 - lava_callback - INFO - Completed processing callback for node 69abe64040deb775998f4027 INFO: 172.19.0.1:57692 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:49:53,773 - lava_callback - INFO - Received callback for node 69abe69d40deb775998f4108 INFO: 172.19.0.1:38148 - "POST /node/69abe69d40deb775998f4108 HTTP/1.0" 202 Accepted 2026-03-07 08:49:53,783 - lava_callback - INFO - Starting async job submit for node 69abe69d40deb775998f4108 2026-03-07 08:49:53,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:53,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe69d40deb775998f4108 HTTP/1.1" 200 None 2026-03-07 08:49:53,810 - lava_callback - DEBUG - Processing node 69abe69d40deb775998f4108: baseline-arm 2026-03-07 08:49:53,818 - lava_callback - WARNING - Failed to upload log 2026-03-07 08:49:53,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:54,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:54,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe69d40deb775998f4108/lava-logs.yaml 2026-03-07 08:49:54,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:54,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:54,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe69d40deb775998f4108/lava_callback.json.gz 2026-03-07 08:49:54,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:54,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe69d40deb775998f4108 HTTP/1.1" 200 None 2026-03-07 08:49:54,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:54,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:54,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:54,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe69d40deb775998f4108 HTTP/1.1" 200 None 2026-03-07 08:49:54,459 - lava_callback - INFO - Completed processing callback for node 69abe69d40deb775998f4108 INFO: 172.19.0.1:38152 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:50:00,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:00,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 08:50:03,625 - lava_callback - INFO - Received callback for node 69abe61d40deb775998f3f99 INFO: 172.19.0.1:51600 - "POST /node/69abe61d40deb775998f3f99 HTTP/1.0" 202 Accepted 2026-03-07 08:50:03,642 - lava_callback - INFO - Starting async job submit for node 69abe61d40deb775998f3f99 2026-03-07 08:50:03,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:03,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61d40deb775998f3f99 HTTP/1.1" 200 None 2026-03-07 08:50:03,713 - lava_callback - DEBUG - Processing node 69abe61d40deb775998f3f99: baseline-arm 2026-03-07 08:50:04,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:04,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:04,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61d40deb775998f3f99/log.txt.gz 2026-03-07 08:50:04,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:04,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:04,927 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61d40deb775998f3f99/lava-logs.yaml 2026-03-07 08:50:04,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:05,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:05,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61d40deb775998f3f99/lava_callback.json.gz 2026-03-07 08:50:05,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:05,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61d40deb775998f3f99 HTTP/1.1" 200 None 2026-03-07 08:50:05,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:05,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:50:05,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:05,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61d40deb775998f3f99 HTTP/1.1" 200 None 2026-03-07 08:50:05,385 - lava_callback - INFO - Completed processing callback for node 69abe61d40deb775998f3f99 INFO: 172.19.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51612 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:50:06,941 - lava_callback - INFO - Received callback for node 69abe62c40deb775998f3fd6 INFO: 172.19.0.1:51626 - "POST /node/69abe62c40deb775998f3fd6 HTTP/1.0" 202 Accepted 2026-03-07 08:50:06,948 - lava_callback - INFO - Starting async job submit for node 69abe62c40deb775998f3fd6 2026-03-07 08:50:06,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:06,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62c40deb775998f3fd6 HTTP/1.1" 200 None 2026-03-07 08:50:06,991 - lava_callback - DEBUG - Processing node 69abe62c40deb775998f3fd6: baseline-arm-broonie 2026-03-07 08:50:07,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:07,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:07,514 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62c40deb775998f3fd6/log.txt.gz 2026-03-07 08:50:07,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:08,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:08,121 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62c40deb775998f3fd6/lava-logs.yaml 2026-03-07 08:50:08,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:08,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:08,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62c40deb775998f3fd6/lava_callback.json.gz 2026-03-07 08:50:08,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:08,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62c40deb775998f3fd6 HTTP/1.1" 200 None 2026-03-07 08:50:08,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:08,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:50:08,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:08,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe62c40deb775998f3fd6 HTTP/1.1" 200 None 2026-03-07 08:50:08,375 - lava_callback - INFO - Completed processing callback for node 69abe62c40deb775998f3fd6 2026-03-07 08:50:13,566 - lava_callback - INFO - Received callback for node 69abe64340deb775998f4032 INFO: 172.19.0.1:58852 - "POST /node/69abe64340deb775998f4032 HTTP/1.0" 202 Accepted 2026-03-07 08:50:13,575 - lava_callback - INFO - Starting async job submit for node 69abe64340deb775998f4032 2026-03-07 08:50:13,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:13,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64340deb775998f4032 HTTP/1.1" 200 None 2026-03-07 08:50:13,663 - lava_callback - DEBUG - Processing node 69abe64340deb775998f4032: baseline-arm-pengutronix 2026-03-07 08:50:13,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:14,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:14,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64340deb775998f4032/log.txt.gz 2026-03-07 08:50:14,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:14,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:14,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64340deb775998f4032/lava-logs.yaml 2026-03-07 08:50:14,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:14,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:14,797 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64340deb775998f4032/lava_callback.json.gz 2026-03-07 08:50:14,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:14,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64340deb775998f4032 HTTP/1.1" 200 None 2026-03-07 08:50:14,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:14,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:50:14,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:14,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe64340deb775998f4032 HTTP/1.1" 200 None 2026-03-07 08:50:15,007 - lava_callback - INFO - Completed processing callback for node 69abe64340deb775998f4032 INFO: 172.19.0.1:58866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48852 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:50:30,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:30,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44990 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:51:00,544 - lava_callback - INFO - Received callback for node 69a943ee7ee78ae610caaeb2 INFO: 172.19.0.1:33552 - "POST /node/69a943ee7ee78ae610caaeb2 HTTP/1.0" 202 Accepted 2026-03-07 08:51:00,549 - lava_callback - INFO - Starting async job submit for node 69a943ee7ee78ae610caaeb2 2026-03-07 08:51:00,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:00,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943ee7ee78ae610caaeb2 HTTP/1.1" 200 None 2026-03-07 08:51:00,572 - lava_callback - DEBUG - Processing node 69a943ee7ee78ae610caaeb2: baseline-arm64-baylibre 2026-03-07 08:51:00,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943ee7ee78ae610caaeb2 2026-03-07 08:51:00,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:00,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943ee7ee78ae610caaeb2 HTTP/1.1" 200 None 2026-03-07 08:51:00,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:00,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 08:51:00,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:00,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943ee7ee78ae610caaeb2 HTTP/1.1" 200 None 2026-03-07 08:51:00,623 - lava_callback - ERROR - Error processing callback for node 69a943ee7ee78ae610caaeb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33578 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:51:10,117 - lava_callback - INFO - Received callback for node 69abe63740deb775998f3ff4 INFO: 172.19.0.1:56490 - "POST /node/69abe63740deb775998f3ff4 HTTP/1.0" 202 Accepted 2026-03-07 08:51:10,123 - lava_callback - INFO - Starting async job submit for node 69abe63740deb775998f3ff4 2026-03-07 08:51:10,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:10,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63740deb775998f3ff4 HTTP/1.1" 200 None 2026-03-07 08:51:10,169 - lava_callback - DEBUG - Processing node 69abe63740deb775998f3ff4: baseline-arm-clabbe 2026-03-07 08:51:10,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:10,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:10,510 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63740deb775998f3ff4/log.txt.gz 2026-03-07 08:51:10,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:10,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:10,859 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63740deb775998f3ff4/lava-logs.yaml 2026-03-07 08:51:10,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:11,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:11,027 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63740deb775998f3ff4/lava_callback.json.gz 2026-03-07 08:51:11,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:11,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63740deb775998f3ff4 HTTP/1.1" 200 None 2026-03-07 08:51:11,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:11,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:51:11,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:11,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63740deb775998f3ff4 HTTP/1.1" 200 None 2026-03-07 08:51:11,112 - lava_callback - INFO - Completed processing callback for node 69abe63740deb775998f3ff4 INFO: 172.19.0.1:56492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50766 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:51:30,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:30,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 08:51:33,750 - lava_callback - INFO - Received callback for node 69abe65f40deb775998f4075 INFO: 172.19.0.1:40082 - "POST /node/69abe65f40deb775998f4075 HTTP/1.0" 202 Accepted 2026-03-07 08:51:33,757 - lava_callback - INFO - Starting async job submit for node 69abe65f40deb775998f4075 2026-03-07 08:51:33,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:33,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65f40deb775998f4075 HTTP/1.1" 200 None 2026-03-07 08:51:33,801 - lava_callback - DEBUG - Processing node 69abe65f40deb775998f4075: ltp-dio 2026-03-07 08:51:34,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:34,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:34,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69abe65f40deb775998f4075/log.txt.gz 2026-03-07 08:51:34,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:34,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:34,942 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69abe65f40deb775998f4075/lava-logs.yaml 2026-03-07 08:51:34,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:35,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:35,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69abe65f40deb775998f4075/lava_callback.json.gz 2026-03-07 08:51:35,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:35,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65f40deb775998f4075 HTTP/1.1" 200 None 2026-03-07 08:51:35,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:35,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:51:35,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:35,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe65f40deb775998f4075 HTTP/1.1" 200 None 2026-03-07 08:51:35,198 - lava_callback - INFO - Completed processing callback for node 69abe65f40deb775998f4075 INFO: 172.19.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58370 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:52:00,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:00,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33910 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:52:20,559 - lava_callback - INFO - Received callback for node 69a944427ee78ae610caaf10 INFO: 172.19.0.1:49268 - "POST /node/69a944427ee78ae610caaf10 HTTP/1.0" 202 Accepted 2026-03-07 08:52:20,565 - lava_callback - INFO - Starting async job submit for node 69a944427ee78ae610caaf10 2026-03-07 08:52:20,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:20,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944427ee78ae610caaf10 HTTP/1.1" 200 None 2026-03-07 08:52:20,581 - lava_callback - DEBUG - Processing node 69a944427ee78ae610caaf10: baseline-arm64-baylibre 2026-03-07 08:52:20,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a944427ee78ae610caaf10 2026-03-07 08:52:20,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:20,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944427ee78ae610caaf10 HTTP/1.1" 200 None 2026-03-07 08:52:20,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:20,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 08:52:20,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:20,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a944427ee78ae610caaf10 HTTP/1.1" 200 None 2026-03-07 08:52:20,633 - lava_callback - ERROR - Error processing callback for node 69a944427ee78ae610caaf10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49272 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:52:26,926 - lava_callback - INFO - Received callback for node 69abe65940deb775998f4053 INFO: 172.19.0.1:49278 - "POST /node/69abe65940deb775998f4053 HTTP/1.0" 202 Accepted 2026-03-07 08:52:26,932 - lava_callback - INFO - Starting async job submit for node 69abe65940deb775998f4053 2026-03-07 08:52:26,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:26,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65940deb775998f4053 HTTP/1.1" 200 None 2026-03-07 08:52:26,973 - lava_callback - DEBUG - Processing node 69abe65940deb775998f4053: ltp-containers 2026-03-07 08:52:27,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:27,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:27,498 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69abe65940deb775998f4053/log.txt.gz 2026-03-07 08:52:27,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:27,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:27,951 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69abe65940deb775998f4053/lava-logs.yaml 2026-03-07 08:52:27,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:28,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:28,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69abe65940deb775998f4053/lava_callback.json.gz 2026-03-07 08:52:28,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:28,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65940deb775998f4053 HTTP/1.1" 200 None 2026-03-07 08:52:28,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:28,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:52:28,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:28,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe65940deb775998f4053 HTTP/1.1" 200 None 2026-03-07 08:52:28,221 - lava_callback - INFO - Completed processing callback for node 69abe65940deb775998f4053 2026-03-07 08:52:28,531 - lava_callback - INFO - Received callback for node 69abe65a40deb775998f4056 INFO: 172.19.0.1:49286 - "POST /node/69abe65a40deb775998f4056 HTTP/1.0" 202 Accepted 2026-03-07 08:52:28,539 - lava_callback - INFO - Starting async job submit for node 69abe65a40deb775998f4056 2026-03-07 08:52:28,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:28,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65a40deb775998f4056 HTTP/1.1" 200 None 2026-03-07 08:52:28,596 - lava_callback - DEBUG - Processing node 69abe65a40deb775998f4056: ltp-controllers 2026-03-07 08:52:29,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:29,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:29,176 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69abe65a40deb775998f4056/log.txt.gz 2026-03-07 08:52:29,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:29,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:29,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69abe65a40deb775998f4056/lava-logs.yaml 2026-03-07 08:52:29,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:29,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:29,840 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69abe65a40deb775998f4056/lava_callback.json.gz 2026-03-07 08:52:29,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:29,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65a40deb775998f4056 HTTP/1.1" 200 None 2026-03-07 08:52:29,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:29,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:52:29,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:29,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe65a40deb775998f4056 HTTP/1.1" 200 None 2026-03-07 08:52:29,930 - lava_callback - INFO - Completed processing callback for node 69abe65a40deb775998f4056 2026-03-07 08:52:30,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:30,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37820 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:52:36,932 - lava_callback - INFO - Received callback for node 69abe65d40deb775998f406b INFO: 172.19.0.1:37836 - "POST /node/69abe65d40deb775998f406b HTTP/1.0" 202 Accepted 2026-03-07 08:52:36,938 - lava_callback - INFO - Starting async job submit for node 69abe65d40deb775998f406b 2026-03-07 08:52:36,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:37,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65d40deb775998f406b HTTP/1.1" 200 None 2026-03-07 08:52:37,017 - lava_callback - DEBUG - Processing node 69abe65d40deb775998f406b: ltp-cve 2026-03-07 08:52:37,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:37,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:37,533 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69abe65d40deb775998f406b/log.txt.gz 2026-03-07 08:52:37,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:37,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:37,979 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69abe65d40deb775998f406b/lava-logs.yaml 2026-03-07 08:52:37,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:38,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:38,179 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69abe65d40deb775998f406b/lava_callback.json.gz 2026-03-07 08:52:38,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:38,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65d40deb775998f406b HTTP/1.1" 200 None 2026-03-07 08:52:38,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:38,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:52:38,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:38,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe65d40deb775998f406b HTTP/1.1" 200 None 2026-03-07 08:52:38,271 - lava_callback - INFO - Completed processing callback for node 69abe65d40deb775998f406b INFO: 172.19.0.1:46308 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:52:47,395 - lava_callback - INFO - Received callback for node 69abe66e40deb775998f40a1 INFO: 172.19.0.1:46320 - "POST /node/69abe66e40deb775998f40a1 HTTP/1.0" 202 Accepted 2026-03-07 08:52:47,402 - lava_callback - INFO - Starting async job submit for node 69abe66e40deb775998f40a1 2026-03-07 08:52:47,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:47,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66e40deb775998f40a1 HTTP/1.1" 200 None 2026-03-07 08:52:47,443 - lava_callback - DEBUG - Processing node 69abe66e40deb775998f40a1: ltp-syscalls 2026-03-07 08:52:48,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:48,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:48,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69abe66e40deb775998f40a1/log.txt.gz 2026-03-07 08:52:48,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:48,910 - lava_callback - INFO - Received callback for node 69abe63b40deb775998f4000 INFO: 172.19.0.1:46334 - "POST /node/69abe63b40deb775998f4000 HTTP/1.0" 202 Accepted 2026-03-07 08:52:48,916 - lava_callback - INFO - Starting async job submit for node 69abe63b40deb775998f4000 2026-03-07 08:52:48,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:48,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63b40deb775998f4000 HTTP/1.1" 200 None 2026-03-07 08:52:48,961 - lava_callback - DEBUG - Processing node 69abe63b40deb775998f4000: baseline-arm-clabbe 2026-03-07 08:52:49,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:49,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69abe66e40deb775998f40a1/lava-logs.yaml 2026-03-07 08:52:49,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:49,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:49,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:49,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63b40deb775998f4000/log.txt.gz 2026-03-07 08:52:49,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:49,430 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69abe66e40deb775998f40a1/lava_callback.json.gz 2026-03-07 08:52:49,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:49,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:49,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66e40deb775998f40a1 HTTP/1.1" 200 None 2026-03-07 08:52:49,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:49,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:52:49,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:49,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66e40deb775998f40a1 HTTP/1.1" 200 None 2026-03-07 08:52:49,593 - lava_callback - INFO - Completed processing callback for node 69abe66e40deb775998f40a1 2026-03-07 08:52:49,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:49,817 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63b40deb775998f4000/lava-logs.yaml 2026-03-07 08:52:49,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:49,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:49,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63b40deb775998f4000/lava_callback.json.gz 2026-03-07 08:52:49,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:50,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63b40deb775998f4000 HTTP/1.1" 200 None 2026-03-07 08:52:50,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:50,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:52:50,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:50,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63b40deb775998f4000 HTTP/1.1" 200 None 2026-03-07 08:52:50,060 - lava_callback - INFO - Completed processing callback for node 69abe63b40deb775998f4000 INFO: 172.19.0.1:47602 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:53:00,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:00,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37170 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:53:19,643 - lava_callback - INFO - Received callback for node 69abe55640deb775998f3f10 INFO: 172.19.0.1:37172 - "POST /node/69abe55640deb775998f3f10 HTTP/1.0" 202 Accepted 2026-03-07 08:53:19,649 - lava_callback - INFO - Starting async job submit for node 69abe55640deb775998f3f10 2026-03-07 08:53:19,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:19,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55640deb775998f3f10 HTTP/1.1" 200 None 2026-03-07 08:53:19,688 - lava_callback - DEBUG - Processing node 69abe55640deb775998f3f10: baseline-x86 2026-03-07 08:53:20,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:53:20,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:53:20,168 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55640deb775998f3f10/log.txt.gz 2026-03-07 08:53:20,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:53:20,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:53:20,591 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55640deb775998f3f10/lava-logs.yaml 2026-03-07 08:53:20,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:53:20,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:53:20,764 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55640deb775998f3f10/lava_callback.json.gz 2026-03-07 08:53:20,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:20,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55640deb775998f3f10 HTTP/1.1" 200 None 2026-03-07 08:53:20,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:20,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf4740deb775998f3bd2 HTTP/1.1" 200 None 2026-03-07 08:53:20,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:20,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe55640deb775998f3f10 HTTP/1.1" 200 None 2026-03-07 08:53:20,868 - lava_callback - INFO - Completed processing callback for node 69abe55640deb775998f3f10 INFO: 172.19.0.1:54964 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:53:30,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:30,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60036 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:54:26,987 - lava_callback - INFO - Received callback for node 69abe66140deb775998f4078 INFO: 172.19.0.1:60052 - "POST /node/69abe66140deb775998f4078 HTTP/1.0" 202 Accepted 2026-03-07 08:54:26,993 - lava_callback - INFO - Starting async job submit for node 69abe66140deb775998f4078 2026-03-07 08:54:27,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:27,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66140deb775998f4078 HTTP/1.1" 200 None 2026-03-07 08:54:27,034 - lava_callback - DEBUG - Processing node 69abe66140deb775998f4078: ltp-fs_bind 2026-03-07 08:54:27,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:27,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:27,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69abe66140deb775998f4078/log.txt.gz 2026-03-07 08:54:27,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:28,081 - lava_callback - INFO - Received callback for node 69abe63d40deb775998f4003 INFO: 172.19.0.1:60066 - "POST /node/69abe63d40deb775998f4003 HTTP/1.0" 202 Accepted 2026-03-07 08:54:28,095 - lava_callback - INFO - Starting async job submit for node 69abe63d40deb775998f4003 2026-03-07 08:54:28,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:28,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63d40deb775998f4003 HTTP/1.1" 200 None 2026-03-07 08:54:28,188 - lava_callback - DEBUG - Processing node 69abe63d40deb775998f4003: baseline-arm-clabbe 2026-03-07 08:54:28,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:28,391 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69abe66140deb775998f4078/lava-logs.yaml 2026-03-07 08:54:28,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:28,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:28,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:28,806 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69abe66140deb775998f4078/lava_callback.json.gz 2026-03-07 08:54:28,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:28,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:28,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63d40deb775998f4003/log.txt.gz 2026-03-07 08:54:28,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66140deb775998f4078 HTTP/1.1" 200 None 2026-03-07 08:54:28,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:28,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:54:28,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:29,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:29,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66140deb775998f4078 HTTP/1.1" 200 None 2026-03-07 08:54:29,029 - lava_callback - INFO - Completed processing callback for node 69abe66140deb775998f4078 2026-03-07 08:54:29,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:29,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63d40deb775998f4003/lava-logs.yaml 2026-03-07 08:54:29,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:29,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:29,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63d40deb775998f4003/lava_callback.json.gz 2026-03-07 08:54:29,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:29,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63d40deb775998f4003 HTTP/1.1" 200 None 2026-03-07 08:54:29,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:29,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:54:29,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:29,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63d40deb775998f4003 HTTP/1.1" 200 None 2026-03-07 08:54:29,698 - lava_callback - INFO - Completed processing callback for node 69abe63d40deb775998f4003 2026-03-07 08:54:30,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:30,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36854 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:55:40,766 - lava_callback - INFO - Received callback for node 69a944f77ee78ae610cab093 INFO: 172.19.0.1:54074 - "POST /node/69a944f77ee78ae610cab093 HTTP/1.0" 202 Accepted 2026-03-07 08:55:40,772 - lava_callback - INFO - Starting async job submit for node 69a944f77ee78ae610cab093 2026-03-07 08:55:40,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:40,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944f77ee78ae610cab093 HTTP/1.1" 200 None 2026-03-07 08:55:40,788 - lava_callback - DEBUG - Processing node 69a944f77ee78ae610cab093: baseline-arm64-baylibre 2026-03-07 08:55:40,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a944f77ee78ae610cab093 2026-03-07 08:55:40,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:40,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944f77ee78ae610cab093 HTTP/1.1" 200 None 2026-03-07 08:55:40,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:40,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 08:55:40,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:40,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a944f77ee78ae610cab093 HTTP/1.1" 200 None 2026-03-07 08:55:40,848 - lava_callback - ERROR - Error processing callback for node 69a944f77ee78ae610cab093: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:55:41,449 - lava_callback - INFO - Received callback for node 69a944f97ee78ae610cab096 INFO: 172.19.0.1:54086 - "POST /node/69a944f97ee78ae610cab096 HTTP/1.0" 202 Accepted 2026-03-07 08:55:41,457 - lava_callback - INFO - Starting async job submit for node 69a944f97ee78ae610cab096 2026-03-07 08:55:41,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:41,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944f97ee78ae610cab096 HTTP/1.1" 200 None 2026-03-07 08:55:41,480 - lava_callback - DEBUG - Processing node 69a944f97ee78ae610cab096: baseline-arm64-baylibre 2026-03-07 08:55:41,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a944f97ee78ae610cab096 2026-03-07 08:55:41,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:41,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944f97ee78ae610cab096 HTTP/1.1" 200 None 2026-03-07 08:55:41,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:41,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 08:55:41,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:41,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a944f97ee78ae610cab096 HTTP/1.1" 200 None 2026-03-07 08:55:41,542 - lava_callback - ERROR - Error processing callback for node 69a944f97ee78ae610cab096: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:55:42,137 - lava_callback - INFO - Received callback for node 69a944fd7ee78ae610cab0a5 INFO: 172.19.0.1:54102 - "POST /node/69a944fd7ee78ae610cab0a5 HTTP/1.0" 202 Accepted 2026-03-07 08:55:42,145 - lava_callback - INFO - Starting async job submit for node 69a944fd7ee78ae610cab0a5 2026-03-07 08:55:42,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944fd7ee78ae610cab0a5 HTTP/1.1" 200 None 2026-03-07 08:55:42,170 - lava_callback - DEBUG - Processing node 69a944fd7ee78ae610cab0a5: baseline-arm64-baylibre 2026-03-07 08:55:42,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a944fd7ee78ae610cab0a5 2026-03-07 08:55:42,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944fd7ee78ae610cab0a5 HTTP/1.1" 200 None 2026-03-07 08:55:42,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 08:55:42,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a944fd7ee78ae610cab0a5 HTTP/1.1" 200 None 2026-03-07 08:55:42,244 - lava_callback - ERROR - Error processing callback for node 69a944fd7ee78ae610cab0a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:55:42,802 - lava_callback - INFO - Received callback for node 69a944ff7ee78ae610cab0a8 INFO: 172.19.0.1:54108 - "POST /node/69a944ff7ee78ae610cab0a8 HTTP/1.0" 202 Accepted 2026-03-07 08:55:42,808 - lava_callback - INFO - Starting async job submit for node 69a944ff7ee78ae610cab0a8 2026-03-07 08:55:42,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944ff7ee78ae610cab0a8 HTTP/1.1" 200 None 2026-03-07 08:55:42,826 - lava_callback - DEBUG - Processing node 69a944ff7ee78ae610cab0a8: baseline-arm64-baylibre 2026-03-07 08:55:42,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a944ff7ee78ae610cab0a8 2026-03-07 08:55:42,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944ff7ee78ae610cab0a8 HTTP/1.1" 200 None 2026-03-07 08:55:42,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 08:55:42,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a944ff7ee78ae610cab0a8 HTTP/1.1" 200 None 2026-03-07 08:55:42,895 - lava_callback - ERROR - Error processing callback for node 69a944ff7ee78ae610cab0a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55942 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:56:13,397 - lava_callback - INFO - Received callback for node 69a945207ee78ae610cab125 INFO: 172.19.0.1:37958 - "POST /node/69a945207ee78ae610cab125 HTTP/1.0" 202 Accepted 2026-03-07 08:56:13,403 - lava_callback - INFO - Starting async job submit for node 69a945207ee78ae610cab125 2026-03-07 08:56:13,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:13,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a945207ee78ae610cab125 HTTP/1.1" 200 None 2026-03-07 08:56:13,426 - lava_callback - DEBUG - Processing node 69a945207ee78ae610cab125: baseline-arm64-clabbe 2026-03-07 08:56:13,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a945207ee78ae610cab125 2026-03-07 08:56:13,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:13,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a945207ee78ae610cab125 HTTP/1.1" 200 None 2026-03-07 08:56:13,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:13,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 08:56:13,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:13,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a945207ee78ae610cab125 HTTP/1.1" 200 None 2026-03-07 08:56:13,520 - lava_callback - ERROR - Error processing callback for node 69a945207ee78ae610cab125: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39172 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:56:27,118 - lava_callback - INFO - Received callback for node 69abe66240deb775998f407b INFO: 172.19.0.1:39184 - "POST /node/69abe66240deb775998f407b HTTP/1.0" 202 Accepted 2026-03-07 08:56:27,129 - lava_callback - INFO - Starting async job submit for node 69abe66240deb775998f407b 2026-03-07 08:56:27,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:27,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66240deb775998f407b HTTP/1.1" 200 None 2026-03-07 08:56:27,197 - lava_callback - DEBUG - Processing node 69abe66240deb775998f407b: ltp-fsx 2026-03-07 08:56:27,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:27,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:27,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69abe66240deb775998f407b/log.txt.gz 2026-03-07 08:56:28,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:28,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:28,706 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69abe66240deb775998f407b/lava-logs.yaml 2026-03-07 08:56:28,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:28,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:28,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69abe66240deb775998f407b/lava_callback.json.gz 2026-03-07 08:56:28,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:28,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66240deb775998f407b HTTP/1.1" 200 None 2026-03-07 08:56:28,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:28,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:56:28,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:28,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66240deb775998f407b HTTP/1.1" 200 None 2026-03-07 08:56:29,000 - lava_callback - INFO - Completed processing callback for node 69abe66240deb775998f407b 2026-03-07 08:56:29,087 - lava_callback - INFO - Received callback for node 69abe66440deb775998f407e INFO: 172.19.0.1:39194 - "POST /node/69abe66440deb775998f407e HTTP/1.0" 202 Accepted 2026-03-07 08:56:29,094 - lava_callback - INFO - Starting async job submit for node 69abe66440deb775998f407e 2026-03-07 08:56:29,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:29,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66440deb775998f407e HTTP/1.1" 200 None 2026-03-07 08:56:29,163 - lava_callback - DEBUG - Processing node 69abe66440deb775998f407e: ltp-input 2026-03-07 08:56:29,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:29,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:29,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69abe66440deb775998f407e/log.txt.gz 2026-03-07 08:56:30,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:30,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:30,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 08:56:30,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:30,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69abe66440deb775998f407e/lava-logs.yaml 2026-03-07 08:56:30,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:30,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:30,660 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69abe66440deb775998f407e/lava_callback.json.gz 2026-03-07 08:56:30,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:30,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66440deb775998f407e HTTP/1.1" 200 None 2026-03-07 08:56:30,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:30,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:56:30,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:30,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66440deb775998f407e HTTP/1.1" 200 None 2026-03-07 08:56:30,783 - lava_callback - INFO - Completed processing callback for node 69abe66440deb775998f407e INFO: 172.19.0.1:34882 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:56:37,142 - lava_callback - INFO - Received callback for node 69abe66640deb775998f4081 INFO: 172.19.0.1:34898 - "POST /node/69abe66640deb775998f4081 HTTP/1.0" 202 Accepted 2026-03-07 08:56:37,149 - lava_callback - INFO - Starting async job submit for node 69abe66640deb775998f4081 2026-03-07 08:56:37,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:37,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66640deb775998f4081 HTTP/1.1" 200 None 2026-03-07 08:56:37,192 - lava_callback - DEBUG - Processing node 69abe66640deb775998f4081: ltp-ipc 2026-03-07 08:56:37,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:37,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:37,936 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69abe66640deb775998f4081/log.txt.gz 2026-03-07 08:56:38,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:38,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:38,398 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69abe66640deb775998f4081/lava-logs.yaml 2026-03-07 08:56:38,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:38,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:38,638 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69abe66640deb775998f4081/lava_callback.json.gz 2026-03-07 08:56:38,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:38,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66640deb775998f4081 HTTP/1.1" 200 None 2026-03-07 08:56:38,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:38,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:56:38,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:38,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66640deb775998f4081 HTTP/1.1" 200 None 2026-03-07 08:56:38,752 - lava_callback - INFO - Completed processing callback for node 69abe66640deb775998f4081 INFO: 172.19.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59826 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:57:00,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:57:00,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42518 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:57:47,102 - lava_callback - INFO - Received callback for node 69abe65740deb775998f4050 INFO: 172.19.0.1:42526 - "POST /node/69abe65740deb775998f4050 HTTP/1.0" 202 Accepted 2026-03-07 08:57:47,109 - lava_callback - INFO - Starting async job submit for node 69abe65740deb775998f4050 2026-03-07 08:57:47,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:57:47,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65740deb775998f4050 HTTP/1.1" 200 None 2026-03-07 08:57:47,148 - lava_callback - DEBUG - Processing node 69abe65740deb775998f4050: ltp-cap_bounds 2026-03-07 08:57:47,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:57:47,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:57:47,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69abe65740deb775998f4050/log.txt.gz 2026-03-07 08:57:47,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:57:48,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:57:48,088 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69abe65740deb775998f4050/lava-logs.yaml 2026-03-07 08:57:48,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:57:48,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:57:48,269 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69abe65740deb775998f4050/lava_callback.json.gz 2026-03-07 08:57:48,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:57:48,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65740deb775998f4050 HTTP/1.1" 200 None 2026-03-07 08:57:48,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:57:48,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:57:48,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:57:48,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe65740deb775998f4050 HTTP/1.1" 200 None 2026-03-07 08:57:48,351 - lava_callback - INFO - Completed processing callback for node 69abe65740deb775998f4050 INFO: 172.19.0.1:38992 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:58:00,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:58:00,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39880 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:58:47,183 - lava_callback - INFO - Received callback for node 69abe66840deb775998f4084 INFO: 172.19.0.1:39894 - "POST /node/69abe66840deb775998f4084 HTTP/1.0" 202 Accepted 2026-03-07 08:58:47,192 - lava_callback - INFO - Starting async job submit for node 69abe66840deb775998f4084 2026-03-07 08:58:47,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:58:47,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66840deb775998f4084 HTTP/1.1" 200 None 2026-03-07 08:58:47,237 - lava_callback - DEBUG - Processing node 69abe66840deb775998f4084: ltp-pty 2026-03-07 08:58:47,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:58:47,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:58:47,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69abe66840deb775998f4084/log.txt.gz 2026-03-07 08:58:48,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:58:48,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:58:48,349 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69abe66840deb775998f4084/lava-logs.yaml 2026-03-07 08:58:48,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:58:48,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:58:48,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69abe66840deb775998f4084/lava_callback.json.gz 2026-03-07 08:58:48,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:58:48,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66840deb775998f4084 HTTP/1.1" 200 None 2026-03-07 08:58:48,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:58:48,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:58:48,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:58:48,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66840deb775998f4084 HTTP/1.1" 200 None 2026-03-07 08:58:48,760 - lava_callback - INFO - Completed processing callback for node 69abe66840deb775998f4084 INFO: 172.19.0.1:56578 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:59:00,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:00,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57840 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:59:07,768 - lava_callback - INFO - Received callback for node 69abe8ca40deb775998f4298 INFO: 172.19.0.1:57856 - "POST /node/69abe8ca40deb775998f4298 HTTP/1.0" 202 Accepted 2026-03-07 08:59:07,778 - lava_callback - INFO - Starting async job submit for node 69abe8ca40deb775998f4298 2026-03-07 08:59:07,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:07,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe8ca40deb775998f4298 HTTP/1.1" 200 None 2026-03-07 08:59:07,816 - lava_callback - DEBUG - Processing node 69abe8ca40deb775998f4298: baseline-arm 2026-03-07 08:59:07,825 - lava_callback - WARNING - Failed to upload log 2026-03-07 08:59:07,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:59:08,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:59:08,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe8ca40deb775998f4298/lava-logs.yaml 2026-03-07 08:59:08,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:59:08,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:59:08,242 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe8ca40deb775998f4298/lava_callback.json.gz 2026-03-07 08:59:08,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:08,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe8ca40deb775998f4298 HTTP/1.1" 200 None 2026-03-07 08:59:08,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:08,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:59:08,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:08,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe8ca40deb775998f4298 HTTP/1.1" 200 None 2026-03-07 08:59:08,340 - lava_callback - INFO - Completed processing callback for node 69abe8ca40deb775998f4298 INFO: 172.19.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60364 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:59:30,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:30,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59876 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:59:44,500 - lava_callback - INFO - Received callback for node 69abe55740deb775998f3f13 INFO: 172.19.0.1:42952 - "POST /node/69abe55740deb775998f3f13 HTTP/1.0" 202 Accepted 2026-03-07 08:59:44,508 - lava_callback - INFO - Starting async job submit for node 69abe55740deb775998f3f13 2026-03-07 08:59:44,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:44,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55740deb775998f3f13 HTTP/1.1" 200 None 2026-03-07 08:59:44,571 - lava_callback - DEBUG - Processing node 69abe55740deb775998f3f13: baseline-x86 2026-03-07 08:59:45,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:59:46,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:59:46,072 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f13/log.txt.gz INFO: 172.19.0.1:42964 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:59:46,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:59:47,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:59:47,441 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f13/lava-logs.yaml 2026-03-07 08:59:47,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:59:47,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:59:47,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f13/lava_callback.json.gz DEBUG: Setup failed for 69abe55740deb775998f3f13. Transitting job node result: incomplete -> fail 2026-03-07 08:59:47,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:47,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55740deb775998f3f13 HTTP/1.1" 200 None 2026-03-07 08:59:47,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:47,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf4740deb775998f3bd2 HTTP/1.1" 200 None 2026-03-07 08:59:47,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:47,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe55740deb775998f3f13 HTTP/1.1" 200 None 2026-03-07 08:59:48,012 - lava_callback - INFO - Completed processing callback for node 69abe55740deb775998f3f13 INFO: 172.19.0.1:52958 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:00:00,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:00,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58310 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:00:27,830 - lava_callback - INFO - Received callback for node 69abe66a40deb775998f4095 INFO: 172.19.0.1:58322 - "POST /node/69abe66a40deb775998f4095 HTTP/1.0" 202 Accepted 2026-03-07 09:00:27,838 - lava_callback - INFO - Starting async job submit for node 69abe66a40deb775998f4095 2026-03-07 09:00:27,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:27,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66a40deb775998f4095 HTTP/1.1" 200 None 2026-03-07 09:00:27,882 - lava_callback - DEBUG - Processing node 69abe66a40deb775998f4095: ltp-sched 2026-03-07 09:00:28,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:28,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:28,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69abe66a40deb775998f4095/log.txt.gz 2026-03-07 09:00:28,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:29,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:29,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69abe66a40deb775998f4095/lava-logs.yaml 2026-03-07 09:00:29,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:29,483 - lava_callback - INFO - Received callback for node 69abe66f40deb775998f40a4 INFO: 172.19.0.1:58332 - "POST /node/69abe66f40deb775998f40a4 HTTP/1.0" 202 Accepted 2026-03-07 09:00:29,497 - lava_callback - INFO - Starting async job submit for node 69abe66f40deb775998f40a4 2026-03-07 09:00:29,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:29,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66f40deb775998f40a4 HTTP/1.1" 200 None 2026-03-07 09:00:29,558 - lava_callback - DEBUG - Processing node 69abe66f40deb775998f40a4: ltp-syscalls-ipc 2026-03-07 09:00:29,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:29,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69abe66a40deb775998f4095/lava_callback.json.gz 2026-03-07 09:00:29,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:29,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66a40deb775998f4095 HTTP/1.1" 200 None 2026-03-07 09:00:29,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:29,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:00:29,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:30,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66a40deb775998f4095 HTTP/1.1" 200 None 2026-03-07 09:00:30,092 - lava_callback - INFO - Completed processing callback for node 69abe66a40deb775998f4095 2026-03-07 09:00:30,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:30,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:30,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 09:00:30,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:30,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69abe66f40deb775998f40a4/log.txt.gz 2026-03-07 09:00:31,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:31,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:31,403 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69abe66f40deb775998f40a4/lava-logs.yaml 2026-03-07 09:00:31,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:31,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:31,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69abe66f40deb775998f40a4/lava_callback.json.gz 2026-03-07 09:00:31,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:31,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66f40deb775998f40a4 HTTP/1.1" 200 None 2026-03-07 09:00:31,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:31,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:00:31,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:31,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66f40deb775998f40a4 HTTP/1.1" 200 None 2026-03-07 09:00:31,818 - lava_callback - INFO - Completed processing callback for node 69abe66f40deb775998f40a4 INFO: 172.19.0.1:55742 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:00:37,246 - lava_callback - INFO - Received callback for node 69abe66c40deb775998f409e INFO: 172.19.0.1:55746 - "POST /node/69abe66c40deb775998f409e HTTP/1.0" 202 Accepted 2026-03-07 09:00:37,253 - lava_callback - INFO - Starting async job submit for node 69abe66c40deb775998f409e 2026-03-07 09:00:37,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:37,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66c40deb775998f409e HTTP/1.1" 200 None 2026-03-07 09:00:37,302 - lava_callback - DEBUG - Processing node 69abe66c40deb775998f409e: ltp-smoke 2026-03-07 09:00:37,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:38,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:38,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe66c40deb775998f409e/log.txt.gz 2026-03-07 09:00:38,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:38,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:38,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe66c40deb775998f409e/lava-logs.yaml 2026-03-07 09:00:38,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:38,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:38,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe66c40deb775998f409e/lava_callback.json.gz 2026-03-07 09:00:38,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:38,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66c40deb775998f409e HTTP/1.1" 200 None 2026-03-07 09:00:38,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:38,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:00:38,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:39,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66c40deb775998f409e HTTP/1.1" 200 None 2026-03-07 09:00:39,053 - lava_callback - INFO - Completed processing callback for node 69abe66c40deb775998f409e 2026-03-07 09:00:41,082 - lava_callback - INFO - Received callback for node 69a9462a7ee78ae610cab476 INFO: 172.19.0.1:33782 - "POST /node/69a9462a7ee78ae610cab476 HTTP/1.0" 202 Accepted 2026-03-07 09:00:41,091 - lava_callback - INFO - Starting async job submit for node 69a9462a7ee78ae610cab476 2026-03-07 09:00:41,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:41,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9462a7ee78ae610cab476 HTTP/1.1" 200 None 2026-03-07 09:00:41,122 - lava_callback - DEBUG - Processing node 69a9462a7ee78ae610cab476: baseline-arm64-baylibre 2026-03-07 09:00:41,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9462a7ee78ae610cab476 2026-03-07 09:00:41,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:41,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9462a7ee78ae610cab476 HTTP/1.1" 200 None 2026-03-07 09:00:41,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:41,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 09:00:41,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:41,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9462a7ee78ae610cab476 HTTP/1.1" 200 None 2026-03-07 09:00:41,221 - lava_callback - ERROR - Error processing callback for node 69a9462a7ee78ae610cab476: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40082 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:01:00,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:00,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43306 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:01:41,002 - lava_callback - INFO - Received callback for node 69a946717ee78ae610cab4e5 INFO: 172.19.0.1:34744 - "POST /node/69a946717ee78ae610cab4e5 HTTP/1.0" 202 Accepted 2026-03-07 09:01:41,010 - lava_callback - INFO - Starting async job submit for node 69a946717ee78ae610cab4e5 2026-03-07 09:01:41,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:41,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946717ee78ae610cab4e5 HTTP/1.1" 200 None 2026-03-07 09:01:41,028 - lava_callback - DEBUG - Processing node 69a946717ee78ae610cab4e5: baseline-arm-baylibre 2026-03-07 09:01:41,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a946717ee78ae610cab4e5 2026-03-07 09:01:41,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:41,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946717ee78ae610cab4e5 HTTP/1.1" 200 None 2026-03-07 09:01:41,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:41,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:01:41,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:41,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a946717ee78ae610cab4e5 HTTP/1.1" 200 None 2026-03-07 09:01:41,090 - lava_callback - ERROR - Error processing callback for node 69a946717ee78ae610cab4e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 09:01:49,721 - lava_callback - INFO - Received callback for node 69abe94340deb775998f42f1 INFO: 172.19.0.1:39292 - "POST /node/69abe94340deb775998f42f1 HTTP/1.0" 202 Accepted 2026-03-07 09:01:49,727 - lava_callback - INFO - Starting async job submit for node 69abe94340deb775998f42f1 2026-03-07 09:01:49,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:49,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe94340deb775998f42f1 HTTP/1.1" 200 None 2026-03-07 09:01:49,764 - lava_callback - DEBUG - Processing node 69abe94340deb775998f42f1: baseline-arm-pengutronix 2026-03-07 09:01:49,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:01:50,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:01:50,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe94340deb775998f42f1/log.txt.gz 2026-03-07 09:01:50,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:01:50,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:01:50,345 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe94340deb775998f42f1/lava-logs.yaml 2026-03-07 09:01:50,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:01:50,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:01:50,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe94340deb775998f42f1/lava_callback.json.gz 2026-03-07 09:01:50,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:50,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe94340deb775998f42f1 HTTP/1.1" 200 None INFO: 172.19.0.1:39308 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:01:50,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:50,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:01:50,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:50,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe94340deb775998f42f1 HTTP/1.1" 200 None 2026-03-07 09:01:50,575 - lava_callback - INFO - Completed processing callback for node 69abe94340deb775998f42f1 INFO: 172.19.0.1:39316 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:02:00,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:00,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47640 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:02:37,136 - lava_callback - INFO - Received callback for node 69abe98d40deb775998f4366 INFO: 172.19.0.1:47644 - "POST /node/69abe98d40deb775998f4366 HTTP/1.0" 202 Accepted 2026-03-07 09:02:37,143 - lava_callback - INFO - Starting async job submit for node 69abe98d40deb775998f4366 2026-03-07 09:02:37,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:37,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98d40deb775998f4366 HTTP/1.1" 200 None 2026-03-07 09:02:37,179 - lava_callback - DEBUG - Processing node 69abe98d40deb775998f4366: baseline-arm64 2026-03-07 09:02:37,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:37,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:37,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98d40deb775998f4366/log.txt.gz 2026-03-07 09:02:37,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:38,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:38,014 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98d40deb775998f4366/lava-logs.yaml 2026-03-07 09:02:38,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:38,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:38,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98d40deb775998f4366/lava_callback.json.gz 2026-03-07 09:02:38,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:38,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98d40deb775998f4366 HTTP/1.1" 200 None 2026-03-07 09:02:38,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:38,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:02:38,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:38,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98d40deb775998f4366 HTTP/1.1" 200 None 2026-03-07 09:02:38,334 - lava_callback - INFO - Completed processing callback for node 69abe98d40deb775998f4366 2026-03-07 09:02:39,406 - lava_callback - INFO - Received callback for node 69abe99c40deb775998f4391 INFO: 172.19.0.1:47660 - "POST /node/69abe99c40deb775998f4391 HTTP/1.0" 202 Accepted 2026-03-07 09:02:39,413 - lava_callback - INFO - Starting async job submit for node 69abe99c40deb775998f4391 2026-03-07 09:02:39,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:39,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99c40deb775998f4391 HTTP/1.1" 200 None 2026-03-07 09:02:39,434 - lava_callback - DEBUG - Processing node 69abe99c40deb775998f4391: baseline-nfs-arm64 2026-03-07 09:02:39,436 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:02:39,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:39,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:39,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99c40deb775998f4391/lava-logs.yaml 2026-03-07 09:02:39,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:39,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:39,707 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99c40deb775998f4391/lava_callback.json.gz 2026-03-07 09:02:39,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:39,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99c40deb775998f4391 HTTP/1.1" 200 None 2026-03-07 09:02:39,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:39,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:02:39,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:39,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99c40deb775998f4391 HTTP/1.1" 200 None 2026-03-07 09:02:39,779 - lava_callback - INFO - Completed processing callback for node 69abe99c40deb775998f4391 2026-03-07 09:02:41,124 - lava_callback - INFO - Received callback for node 69a9469f7ee78ae610cab52a INFO: 172.19.0.1:55034 - "POST /node/69a9469f7ee78ae610cab52a HTTP/1.0" 202 Accepted 2026-03-07 09:02:41,133 - lava_callback - INFO - Starting async job submit for node 69a9469f7ee78ae610cab52a 2026-03-07 09:02:41,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:41,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9469f7ee78ae610cab52a HTTP/1.1" 200 None 2026-03-07 09:02:41,192 - lava_callback - DEBUG - Processing node 69a9469f7ee78ae610cab52a: baseline-arm-baylibre 2026-03-07 09:02:41,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9469f7ee78ae610cab52a 2026-03-07 09:02:41,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:41,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9469f7ee78ae610cab52a HTTP/1.1" 200 None 2026-03-07 09:02:41,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:41,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:02:41,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:41,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9469f7ee78ae610cab52a HTTP/1.1" 200 None 2026-03-07 09:02:41,318 - lava_callback - ERROR - Error processing callback for node 69a9469f7ee78ae610cab52a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55042 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:02:46,852 - lava_callback - INFO - Received callback for node 69abe98140deb775998f432d INFO: 172.19.0.1:55052 - "POST /node/69abe98140deb775998f432d HTTP/1.0" 202 Accepted 2026-03-07 09:02:46,859 - lava_callback - INFO - Starting async job submit for node 69abe98140deb775998f432d 2026-03-07 09:02:46,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:46,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98140deb775998f432d HTTP/1.1" 200 None 2026-03-07 09:02:46,893 - lava_callback - DEBUG - Processing node 69abe98140deb775998f432d: baseline-arm64 2026-03-07 09:02:47,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:47,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:47,171 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f432d/log.txt.gz 2026-03-07 09:02:47,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:47,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:47,572 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f432d/lava-logs.yaml 2026-03-07 09:02:47,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:47,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:47,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f432d/lava_callback.json.gz 2026-03-07 09:02:47,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:47,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98140deb775998f432d HTTP/1.1" 200 None 2026-03-07 09:02:47,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:47,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:02:47,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:47,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98140deb775998f432d HTTP/1.1" 200 None 2026-03-07 09:02:47,832 - lava_callback - INFO - Completed processing callback for node 69abe98140deb775998f432d INFO: 172.19.0.1:55110 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:00,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:00,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 09:03:03,892 - lava_callback - INFO - Received callback for node 69abe98640deb775998f4341 INFO: 172.19.0.1:44512 - "POST /node/69abe98640deb775998f4341 HTTP/1.0" 202 Accepted 2026-03-07 09:03:03,899 - lava_callback - INFO - Starting async job submit for node 69abe98640deb775998f4341 2026-03-07 09:03:03,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:03,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98640deb775998f4341 HTTP/1.1" 200 None 2026-03-07 09:03:03,948 - lava_callback - DEBUG - Processing node 69abe98640deb775998f4341: baseline-arm64 2026-03-07 09:03:04,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:04,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:04,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98640deb775998f4341/log.txt.gz 2026-03-07 09:03:04,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:04,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:04,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98640deb775998f4341/lava-logs.yaml 2026-03-07 09:03:04,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:05,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:05,207 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98640deb775998f4341/lava_callback.json.gz 2026-03-07 09:03:05,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:05,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98640deb775998f4341 HTTP/1.1" 200 None 2026-03-07 09:03:05,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:05,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:05,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:05,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98640deb775998f4341 HTTP/1.1" 200 None 2026-03-07 09:03:05,434 - lava_callback - INFO - Completed processing callback for node 69abe98640deb775998f4341 INFO: 172.19.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44532 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:08,135 - lava_callback - INFO - Received callback for node 69abe67440deb775998f40aa INFO: 172.19.0.1:44546 - "POST /node/69abe67440deb775998f40aa HTTP/1.0" 202 Accepted 2026-03-07 09:03:08,145 - lava_callback - INFO - Starting async job submit for node 69abe67440deb775998f40aa 2026-03-07 09:03:08,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:08,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe67440deb775998f40aa HTTP/1.1" 200 None 2026-03-07 09:03:08,227 - lava_callback - DEBUG - Processing node 69abe67440deb775998f40aa: ltp-watchqueue 2026-03-07 09:03:08,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:09,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:09,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69abe67440deb775998f40aa/log.txt.gz 2026-03-07 09:03:09,661 - lava_callback - INFO - Received callback for node 69abe98240deb775998f4333 INFO: 172.19.0.1:44560 - "POST /node/69abe98240deb775998f4333 HTTP/1.0" 202 Accepted 2026-03-07 09:03:09,681 - lava_callback - INFO - Starting async job submit for node 69abe98240deb775998f4333 2026-03-07 09:03:09,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:09,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98240deb775998f4333 HTTP/1.1" 200 None 2026-03-07 09:03:09,788 - lava_callback - DEBUG - Processing node 69abe98240deb775998f4333: baseline-arm64 2026-03-07 09:03:09,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:10,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:10,321 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69abe67440deb775998f40aa/lava-logs.yaml 2026-03-07 09:03:10,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:10,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:10,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:10,459 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98240deb775998f4333/log.txt.gz 2026-03-07 09:03:10,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:10,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:10,894 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69abe67440deb775998f40aa/lava_callback.json.gz 2026-03-07 09:03:10,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:10,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe67440deb775998f40aa HTTP/1.1" 200 None 2026-03-07 09:03:10,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:11,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:03:11,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:11,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe67440deb775998f40aa HTTP/1.1" 200 None 2026-03-07 09:03:11,078 - lava_callback - INFO - Completed processing callback for node 69abe67440deb775998f40aa 2026-03-07 09:03:11,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:11,288 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98240deb775998f4333/lava-logs.yaml 2026-03-07 09:03:11,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:11,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:11,887 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98240deb775998f4333/lava_callback.json.gz 2026-03-07 09:03:11,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:11,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98240deb775998f4333 HTTP/1.1" 200 None 2026-03-07 09:03:11,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:11,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:11,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:12,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98240deb775998f4333 HTTP/1.1" 200 None 2026-03-07 09:03:12,007 - lava_callback - INFO - Completed processing callback for node 69abe98240deb775998f4333 2026-03-07 09:03:14,356 - lava_callback - INFO - Received callback for node 69abe98440deb775998f4339 INFO: 172.19.0.1:37692 - "POST /node/69abe98440deb775998f4339 HTTP/1.0" 202 Accepted 2026-03-07 09:03:14,364 - lava_callback - INFO - Starting async job submit for node 69abe98440deb775998f4339 2026-03-07 09:03:14,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:14,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98440deb775998f4339 HTTP/1.1" 200 None 2026-03-07 09:03:14,410 - lava_callback - DEBUG - Processing node 69abe98440deb775998f4339: baseline-arm64 2026-03-07 09:03:14,627 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:03:14,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:14,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:14,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98440deb775998f4339/lava-logs.yaml 2026-03-07 09:03:14,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:15,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:15,126 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98440deb775998f4339/lava_callback.json.gz INFO: 172.19.0.1:37706 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 09:03:15,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:15,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98440deb775998f4339 HTTP/1.1" 200 None 2026-03-07 09:03:15,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:15,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:15,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:15,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98440deb775998f4339 HTTP/1.1" 200 None 2026-03-07 09:03:15,310 - lava_callback - INFO - Completed processing callback for node 69abe98440deb775998f4339 INFO: 172.19.0.1:37708 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:16,797 - lava_callback - INFO - Received callback for node 69abe98940deb775998f435c INFO: 172.19.0.1:37718 - "POST /node/69abe98940deb775998f435c HTTP/1.0" 202 Accepted 2026-03-07 09:03:16,807 - lava_callback - INFO - Starting async job submit for node 69abe98940deb775998f435c 2026-03-07 09:03:16,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:16,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98940deb775998f435c HTTP/1.1" 200 None 2026-03-07 09:03:16,863 - lava_callback - DEBUG - Processing node 69abe98940deb775998f435c: baseline-arm64 2026-03-07 09:03:17,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:17,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:17,514 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98940deb775998f435c/log.txt.gz 2026-03-07 09:03:17,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:17,985 - lava_callback - INFO - Received callback for node 69abe98b40deb775998f435f INFO: 172.19.0.1:37728 - "POST /node/69abe98b40deb775998f435f HTTP/1.0" 202 Accepted 2026-03-07 09:03:17,994 - lava_callback - INFO - Starting async job submit for node 69abe98b40deb775998f435f 2026-03-07 09:03:18,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:18,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98b40deb775998f435f HTTP/1.1" 200 None 2026-03-07 09:03:18,103 - lava_callback - DEBUG - Processing node 69abe98b40deb775998f435f: baseline-arm64 2026-03-07 09:03:18,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:18,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98940deb775998f435c/lava-logs.yaml 2026-03-07 09:03:18,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:18,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:18,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:18,997 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98b40deb775998f435f/log.txt.gz 2026-03-07 09:03:19,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:19,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98940deb775998f435c/lava_callback.json.gz 2026-03-07 09:03:19,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:19,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98940deb775998f435c HTTP/1.1" 200 None 2026-03-07 09:03:19,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:19,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:19,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:19,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:19,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98940deb775998f435c HTTP/1.1" 200 None 2026-03-07 09:03:19,305 - lava_callback - INFO - Completed processing callback for node 69abe98940deb775998f435c 2026-03-07 09:03:19,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:19,885 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98b40deb775998f435f/lava-logs.yaml 2026-03-07 09:03:19,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:20,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:20,063 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98b40deb775998f435f/lava_callback.json.gz 2026-03-07 09:03:20,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:20,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98b40deb775998f435f HTTP/1.1" 200 None 2026-03-07 09:03:20,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:20,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:20,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:20,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98b40deb775998f435f HTTP/1.1" 200 None 2026-03-07 09:03:20,217 - lava_callback - INFO - Completed processing callback for node 69abe98b40deb775998f435f 2026-03-07 09:03:21,084 - lava_callback - INFO - Received callback for node 69a946cd7ee78ae610cab582 INFO: 172.19.0.1:40966 - "POST /node/69a946cd7ee78ae610cab582 HTTP/1.0" 202 Accepted 2026-03-07 09:03:21,093 - lava_callback - INFO - Starting async job submit for node 69a946cd7ee78ae610cab582 2026-03-07 09:03:21,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:21,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946cd7ee78ae610cab582 HTTP/1.1" 200 None 2026-03-07 09:03:21,117 - lava_callback - DEBUG - Processing node 69a946cd7ee78ae610cab582: baseline-arm-baylibre 2026-03-07 09:03:21,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a946cd7ee78ae610cab582 2026-03-07 09:03:21,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:21,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946cd7ee78ae610cab582 HTTP/1.1" 200 None 2026-03-07 09:03:21,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:21,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:03:21,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:21,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a946cd7ee78ae610cab582 HTTP/1.1" 200 None 2026-03-07 09:03:21,196 - lava_callback - ERROR - Error processing callback for node 69a946cd7ee78ae610cab582: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 09:03:21,239 - lava_callback - INFO - Received callback for node 69abe99040deb775998f4371 INFO: 172.19.0.1:40972 - "POST /node/69abe99040deb775998f4371 HTTP/1.0" 202 Accepted 2026-03-07 09:03:21,248 - lava_callback - INFO - Starting async job submit for node 69abe99040deb775998f4371 2026-03-07 09:03:21,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:21,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99040deb775998f4371 HTTP/1.1" 200 None 2026-03-07 09:03:21,312 - lava_callback - DEBUG - Processing node 69abe99040deb775998f4371: baseline-arm64 2026-03-07 09:03:21,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:21,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:21,965 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99040deb775998f4371/log.txt.gz 2026-03-07 09:03:22,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:22,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:22,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99040deb775998f4371/lava-logs.yaml 2026-03-07 09:03:22,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:22,637 - lava_callback - INFO - Received callback for node 69abe98840deb775998f4356 INFO: 172.19.0.1:40986 - "POST /node/69abe98840deb775998f4356 HTTP/1.0" 202 Accepted 2026-03-07 09:03:22,647 - lava_callback - INFO - Starting async job submit for node 69abe98840deb775998f4356 2026-03-07 09:03:22,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:22,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98840deb775998f4356 HTTP/1.1" 200 None 2026-03-07 09:03:22,701 - lava_callback - DEBUG - Processing node 69abe98840deb775998f4356: baseline-arm64 2026-03-07 09:03:22,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:22,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99040deb775998f4371/lava_callback.json.gz 2026-03-07 09:03:22,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:22,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99040deb775998f4371 HTTP/1.1" 200 None 2026-03-07 09:03:22,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:23,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:23,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:23,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:23,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99040deb775998f4371 HTTP/1.1" 200 None 2026-03-07 09:03:23,164 - lava_callback - INFO - Completed processing callback for node 69abe99040deb775998f4371 2026-03-07 09:03:23,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:23,453 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98840deb775998f4356/log.txt.gz 2026-03-07 09:03:23,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:24,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:24,183 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98840deb775998f4356/lava-logs.yaml 2026-03-07 09:03:24,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:24,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:24,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98840deb775998f4356/lava_callback.json.gz 2026-03-07 09:03:24,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:24,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98840deb775998f4356 HTTP/1.1" 200 None 2026-03-07 09:03:24,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:24,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:24,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:24,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98840deb775998f4356 HTTP/1.1" 200 None 2026-03-07 09:03:24,482 - lava_callback - INFO - Completed processing callback for node 69abe98840deb775998f4356 2026-03-07 09:03:26,002 - lava_callback - INFO - Received callback for node 69abe98c40deb775998f4362 INFO: 172.19.0.1:41002 - "POST /node/69abe98c40deb775998f4362 HTTP/1.0" 202 Accepted 2026-03-07 09:03:26,013 - lava_callback - INFO - Starting async job submit for node 69abe98c40deb775998f4362 2026-03-07 09:03:26,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:26,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98c40deb775998f4362 HTTP/1.1" 200 None 2026-03-07 09:03:26,068 - lava_callback - DEBUG - Processing node 69abe98c40deb775998f4362: baseline-arm64 INFO: 172.19.0.1:41018 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:26,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:26,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:26,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98c40deb775998f4362/log.txt.gz 2026-03-07 09:03:27,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:27,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:27,608 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98c40deb775998f4362/lava-logs.yaml 2026-03-07 09:03:27,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:27,667 - lava_callback - INFO - Received callback for node 69abe98140deb775998f4330 INFO: 172.19.0.1:41022 - "POST /node/69abe98140deb775998f4330 HTTP/1.0" 202 Accepted 2026-03-07 09:03:27,674 - lava_callback - INFO - Starting async job submit for node 69abe98140deb775998f4330 2026-03-07 09:03:27,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:27,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98140deb775998f4330 HTTP/1.1" 200 None 2026-03-07 09:03:27,724 - lava_callback - DEBUG - Processing node 69abe98140deb775998f4330: baseline-arm64 2026-03-07 09:03:27,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:27,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98c40deb775998f4362/lava_callback.json.gz 2026-03-07 09:03:27,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:27,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98c40deb775998f4362 HTTP/1.1" 200 None 2026-03-07 09:03:27,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:28,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:28,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:28,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98c40deb775998f4362 HTTP/1.1" 200 None 2026-03-07 09:03:28,169 - lava_callback - INFO - Completed processing callback for node 69abe98c40deb775998f4362 2026-03-07 09:03:28,209 - lava_callback - INFO - Received callback for node 69abe98340deb775998f4336 INFO: 172.19.0.1:41026 - "POST /node/69abe98340deb775998f4336 HTTP/1.0" 202 Accepted 2026-03-07 09:03:28,249 - lava_callback - INFO - Starting async job submit for node 69abe98340deb775998f4336 2026-03-07 09:03:28,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:28,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:28,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98340deb775998f4336 HTTP/1.1" 200 None 2026-03-07 09:03:28,375 - lava_callback - DEBUG - Processing node 69abe98340deb775998f4336: baseline-arm64 2026-03-07 09:03:28,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:28,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f4330/log.txt.gz 2026-03-07 09:03:29,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:29,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:29,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:29,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98340deb775998f4336/log.txt.gz 2026-03-07 09:03:29,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:29,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f4330/lava-logs.yaml 2026-03-07 09:03:29,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:29,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:30,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:30,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f4330/lava_callback.json.gz 2026-03-07 09:03:30,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:30,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:30,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98340deb775998f4336/lava-logs.yaml 2026-03-07 09:03:30,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98140deb775998f4330 HTTP/1.1" 200 None 2026-03-07 09:03:30,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:30,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:30,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:30,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:30,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98140deb775998f4330 HTTP/1.1" 200 None 2026-03-07 09:03:30,379 - lava_callback - INFO - Completed processing callback for node 69abe98140deb775998f4330 2026-03-07 09:03:30,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:30,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-07 09:03:30,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:30,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98340deb775998f4336/lava_callback.json.gz 2026-03-07 09:03:31,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:31,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98340deb775998f4336 HTTP/1.1" 200 None 2026-03-07 09:03:31,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:31,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:31,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:31,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98340deb775998f4336 HTTP/1.1" 200 None 2026-03-07 09:03:31,180 - lava_callback - INFO - Completed processing callback for node 69abe98340deb775998f4336 INFO: 172.19.0.1:58582 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:39,756 - lava_callback - INFO - Received callback for node 69abe9a040deb775998f439a INFO: 172.19.0.1:41798 - "POST /node/69abe9a040deb775998f439a HTTP/1.0" 202 Accepted 2026-03-07 09:03:39,767 - lava_callback - INFO - Starting async job submit for node 69abe9a040deb775998f439a 2026-03-07 09:03:39,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:39,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9a040deb775998f439a HTTP/1.1" 200 None 2026-03-07 09:03:39,848 - lava_callback - DEBUG - Processing node 69abe9a040deb775998f439a: baseline-nfs-arm64 2026-03-07 09:03:40,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:40,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:40,612 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a040deb775998f439a/log.txt.gz 2026-03-07 09:03:40,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:41,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:41,261 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a040deb775998f439a/lava-logs.yaml 2026-03-07 09:03:41,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:41,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:41,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a040deb775998f439a/lava_callback.json.gz 2026-03-07 09:03:41,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:41,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9a040deb775998f439a HTTP/1.1" 200 None 2026-03-07 09:03:41,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:41,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:41,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:41,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9a040deb775998f439a HTTP/1.1" 200 None 2026-03-07 09:03:41,505 - lava_callback - INFO - Completed processing callback for node 69abe9a040deb775998f439a 2026-03-07 09:03:45,266 - lava_callback - INFO - Received callback for node 69abe99240deb775998f4379 INFO: 172.19.0.1:41808 - "POST /node/69abe99240deb775998f4379 HTTP/1.0" 202 Accepted 2026-03-07 09:03:45,272 - lava_callback - INFO - Starting async job submit for node 69abe99240deb775998f4379 2026-03-07 09:03:45,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:45,324 - lava_callback - INFO - Received callback for node 69abe99a40deb775998f438b INFO: 172.19.0.1:41810 - "POST /node/69abe99a40deb775998f438b HTTP/1.0" 202 Accepted 2026-03-07 09:03:45,338 - lava_callback - INFO - Starting async job submit for node 69abe99a40deb775998f438b 2026-03-07 09:03:45,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99240deb775998f4379 HTTP/1.1" 200 None 2026-03-07 09:03:45,374 - lava_callback - DEBUG - Processing node 69abe99240deb775998f4379: baseline-arm64 2026-03-07 09:03:45,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:45,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99a40deb775998f438b HTTP/1.1" 200 None 2026-03-07 09:03:45,471 - lava_callback - DEBUG - Processing node 69abe99a40deb775998f438b: baseline-nfs-arm64 2026-03-07 09:03:45,710 - lava_callback - INFO - Received callback for node 69abe9a240deb775998f43a1 INFO: 172.19.0.1:41822 - "POST /node/69abe9a240deb775998f43a1 HTTP/1.0" 202 Accepted 2026-03-07 09:03:45,731 - lava_callback - INFO - Starting async job submit for node 69abe9a240deb775998f43a1 2026-03-07 09:03:45,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:46,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9a240deb775998f43a1 HTTP/1.1" 200 None 2026-03-07 09:03:46,146 - lava_callback - DEBUG - Processing node 69abe9a240deb775998f43a1: baseline-nfs-arm64 2026-03-07 09:03:46,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:41834 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:46,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:47,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:47,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:47,139 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99240deb775998f4379/log.txt.gz 2026-03-07 09:03:47,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:47,246 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99a40deb775998f438b/log.txt.gz 2026-03-07 09:03:47,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:47,370 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a240deb775998f43a1/log.txt.gz 2026-03-07 09:03:47,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:48,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,061 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99240deb775998f4379/lava-logs.yaml 2026-03-07 09:03:48,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:48,575 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99240deb775998f4379/lava_callback.json.gz 2026-03-07 09:03:48,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:48,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:48,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99240deb775998f4379 HTTP/1.1" 200 None 2026-03-07 09:03:48,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:48,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a240deb775998f43a1/lava-logs.yaml 2026-03-07 09:03:48,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:48,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99a40deb775998f438b/lava-logs.yaml 2026-03-07 09:03:48,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:48,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:48,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99240deb775998f4379 HTTP/1.1" 200 None 2026-03-07 09:03:48,685 - lava_callback - INFO - Completed processing callback for node 69abe99240deb775998f4379 2026-03-07 09:03:49,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:49,322 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a240deb775998f43a1/lava_callback.json.gz 2026-03-07 09:03:49,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:49,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,362 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99a40deb775998f438b/lava_callback.json.gz 2026-03-07 09:03:49,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9a240deb775998f43a1 HTTP/1.1" 200 None 2026-03-07 09:03:49,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99a40deb775998f438b HTTP/1.1" 200 None 2026-03-07 09:03:49,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:49,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:49,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9a240deb775998f43a1 HTTP/1.1" 200 None 2026-03-07 09:03:49,478 - lava_callback - INFO - Completed processing callback for node 69abe9a240deb775998f43a1 2026-03-07 09:03:49,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99a40deb775998f438b HTTP/1.1" 200 None 2026-03-07 09:03:49,550 - lava_callback - INFO - Completed processing callback for node 69abe99a40deb775998f438b INFO: 172.19.0.1:48048 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:57,466 - lava_callback - INFO - Received callback for node 69abe56040deb775998f3f24 INFO: 172.19.0.1:48056 - "POST /node/69abe56040deb775998f3f24 HTTP/1.0" 202 Accepted 2026-03-07 09:03:57,474 - lava_callback - INFO - Starting async job submit for node 69abe56040deb775998f3f24 2026-03-07 09:03:57,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:57,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe56040deb775998f3f24 HTTP/1.1" 200 None 2026-03-07 09:03:57,559 - lava_callback - DEBUG - Processing node 69abe56040deb775998f3f24: ltp-smoke 2026-03-07 09:03:58,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:58,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:58,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe56040deb775998f3f24/log.txt.gz 2026-03-07 09:03:58,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:58,927 - lava_callback - INFO - Received callback for node 69abe9af40deb775998f43ea INFO: 172.19.0.1:48062 - "POST /node/69abe9af40deb775998f43ea HTTP/1.0" 202 Accepted 2026-03-07 09:03:58,936 - lava_callback - INFO - Starting async job submit for node 69abe9af40deb775998f43ea 2026-03-07 09:03:58,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:59,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9af40deb775998f43ea HTTP/1.1" 200 None 2026-03-07 09:03:59,016 - lava_callback - DEBUG - Processing node 69abe9af40deb775998f43ea: baseline-arm64-broonie 2026-03-07 09:03:59,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:59,389 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe56040deb775998f3f24/lava-logs.yaml 2026-03-07 09:03:59,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:59,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:59,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:59,556 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe56040deb775998f3f24/lava_callback.json.gz 2026-03-07 09:03:59,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:59,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe56040deb775998f3f24 HTTP/1.1" 200 None 2026-03-07 09:03:59,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:59,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2b40deb775998f3bab HTTP/1.1" 200 None 2026-03-07 09:03:59,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:59,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe56040deb775998f3f24 HTTP/1.1" 200 None 2026-03-07 09:03:59,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:59,941 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9af40deb775998f43ea/log.txt.gz 2026-03-07 09:04:00,133 - lava_callback - INFO - Completed processing callback for node 69abe56040deb775998f3f24 2026-03-07 09:04:00,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:00,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:00,514 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9af40deb775998f43ea/lava-logs.yaml 2026-03-07 09:04:00,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:00,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:00,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-07 09:04:00,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:00,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9af40deb775998f43ea/lava_callback.json.gz 2026-03-07 09:04:01,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9af40deb775998f43ea HTTP/1.1" 200 None 2026-03-07 09:04:01,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:01,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9af40deb775998f43ea HTTP/1.1" 200 None 2026-03-07 09:04:01,114 - lava_callback - INFO - Completed processing callback for node 69abe9af40deb775998f43ea 2026-03-07 09:04:01,190 - lava_callback - INFO - Received callback for node 69a946fb7ee78ae610cab5ad INFO: 172.19.0.1:60742 - "POST /node/69a946fb7ee78ae610cab5ad HTTP/1.0" 202 Accepted 2026-03-07 09:04:01,200 - lava_callback - INFO - Starting async job submit for node 69a946fb7ee78ae610cab5ad 2026-03-07 09:04:01,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946fb7ee78ae610cab5ad HTTP/1.1" 200 None 2026-03-07 09:04:01,225 - lava_callback - DEBUG - Processing node 69a946fb7ee78ae610cab5ad: baseline-arm-baylibre 2026-03-07 09:04:01,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a946fb7ee78ae610cab5ad 2026-03-07 09:04:01,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946fb7ee78ae610cab5ad HTTP/1.1" 200 None 2026-03-07 09:04:01,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:04:01,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a946fb7ee78ae610cab5ad HTTP/1.1" 200 None 2026-03-07 09:04:01,307 - lava_callback - ERROR - Error processing callback for node 69a946fb7ee78ae610cab5ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 09:04:05,715 - lava_callback - INFO - Received callback for node 69abe99540deb775998f437f INFO: 172.19.0.1:60752 - "POST /node/69abe99540deb775998f437f HTTP/1.0" 202 Accepted 2026-03-07 09:04:05,726 - lava_callback - INFO - Starting async job submit for node 69abe99540deb775998f437f 2026-03-07 09:04:05,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:05,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99540deb775998f437f HTTP/1.1" 200 None 2026-03-07 09:04:05,815 - lava_callback - DEBUG - Processing node 69abe99540deb775998f437f: baseline-nfs-arm64 INFO: 172.19.0.1:60754 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:06,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:60758 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:06,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:06,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99540deb775998f437f/log.txt.gz 2026-03-07 09:04:06,920 - lava_callback - INFO - Received callback for node 69abe99b40deb775998f438e INFO: 172.19.0.1:60760 - "POST /node/69abe99b40deb775998f438e HTTP/1.0" 202 Accepted 2026-03-07 09:04:06,932 - lava_callback - INFO - Starting async job submit for node 69abe99b40deb775998f438e 2026-03-07 09:04:07,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:07,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:07,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99b40deb775998f438e HTTP/1.1" 200 None 2026-03-07 09:04:07,069 - lava_callback - DEBUG - Processing node 69abe99b40deb775998f438e: baseline-nfs-arm64 2026-03-07 09:04:07,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:07,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99540deb775998f437f/lava-logs.yaml 2026-03-07 09:04:07,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:07,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:08,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:08,110 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99b40deb775998f438e/log.txt.gz 2026-03-07 09:04:08,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:08,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99540deb775998f437f/lava_callback.json.gz 2026-03-07 09:04:08,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:08,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99540deb775998f437f HTTP/1.1" 200 None 2026-03-07 09:04:08,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:08,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:08,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:08,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99540deb775998f437f HTTP/1.1" 200 None 2026-03-07 09:04:08,550 - lava_callback - INFO - Completed processing callback for node 69abe99540deb775998f437f 2026-03-07 09:04:08,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:09,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:09,133 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99b40deb775998f438e/lava-logs.yaml 2026-03-07 09:04:09,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:09,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:09,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99b40deb775998f438e/lava_callback.json.gz 2026-03-07 09:04:09,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:09,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99b40deb775998f438e HTTP/1.1" 200 None 2026-03-07 09:04:09,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:09,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:09,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:09,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99b40deb775998f438e HTTP/1.1" 200 None 2026-03-07 09:04:09,470 - lava_callback - INFO - Completed processing callback for node 69abe99b40deb775998f438e 2026-03-07 09:04:10,299 - lava_callback - INFO - Received callback for node 69abe99740deb775998f4385 INFO: 172.19.0.1:47164 - "POST /node/69abe99740deb775998f4385 HTTP/1.0" 202 Accepted 2026-03-07 09:04:10,309 - lava_callback - INFO - Starting async job submit for node 69abe99740deb775998f4385 2026-03-07 09:04:10,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:10,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99740deb775998f4385 HTTP/1.1" 200 None 2026-03-07 09:04:10,387 - lava_callback - DEBUG - Processing node 69abe99740deb775998f4385: baseline-nfs-arm64 2026-03-07 09:04:11,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:11,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:11,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99740deb775998f4385/log.txt.gz 2026-03-07 09:04:11,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:12,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:12,026 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99740deb775998f4385/lava-logs.yaml 2026-03-07 09:04:12,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:12,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:12,192 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99740deb775998f4385/lava_callback.json.gz 2026-03-07 09:04:12,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:12,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99740deb775998f4385 HTTP/1.1" 200 None 2026-03-07 09:04:12,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:12,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:12,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:12,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99740deb775998f4385 HTTP/1.1" 200 None 2026-03-07 09:04:12,335 - lava_callback - INFO - Completed processing callback for node 69abe99740deb775998f4385 2026-03-07 09:04:14,956 - lava_callback - INFO - Received callback for node 69abe9ca40deb775998f4448 INFO: 172.19.0.1:47166 - "POST /node/69abe9ca40deb775998f4448 HTTP/1.0" 202 Accepted 2026-03-07 09:04:14,966 - lava_callback - INFO - Starting async job submit for node 69abe9ca40deb775998f4448 2026-03-07 09:04:14,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:15,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9ca40deb775998f4448 HTTP/1.1" 200 None 2026-03-07 09:04:15,009 - lava_callback - DEBUG - Processing node 69abe9ca40deb775998f4448: baseline-arm64-pengutronix INFO: 172.19.0.1:47174 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 09:04:15,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:15,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:15,590 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9ca40deb775998f4448/log.txt.gz 2026-03-07 09:04:15,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:15,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:15,919 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9ca40deb775998f4448/lava-logs.yaml 2026-03-07 09:04:15,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:16,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:16,379 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9ca40deb775998f4448/lava_callback.json.gz 2026-03-07 09:04:16,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:16,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9ca40deb775998f4448 HTTP/1.1" 200 None 2026-03-07 09:04:16,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:16,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:16,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:16,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9ca40deb775998f4448 HTTP/1.1" 200 None 2026-03-07 09:04:16,479 - lava_callback - INFO - Completed processing callback for node 69abe9ca40deb775998f4448 INFO: 172.19.0.1:47188 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:17,335 - lava_callback - INFO - Received callback for node 69abe9b840deb775998f4404 INFO: 172.19.0.1:47196 - "POST /node/69abe9b840deb775998f4404 HTTP/1.0" 202 Accepted 2026-03-07 09:04:17,345 - lava_callback - INFO - Starting async job submit for node 69abe9b840deb775998f4404 2026-03-07 09:04:17,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:17,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b840deb775998f4404 HTTP/1.1" 200 None 2026-03-07 09:04:17,410 - lava_callback - DEBUG - Processing node 69abe9b840deb775998f4404: baseline-arm64-broonie 2026-03-07 09:04:17,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:18,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:18,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b840deb775998f4404/log.txt.gz 2026-03-07 09:04:18,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:18,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:18,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b840deb775998f4404/lava-logs.yaml 2026-03-07 09:04:18,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:18,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:18,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b840deb775998f4404/lava_callback.json.gz 2026-03-07 09:04:18,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:18,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b840deb775998f4404 HTTP/1.1" 200 None 2026-03-07 09:04:18,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:18,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:18,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:18,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b840deb775998f4404 HTTP/1.1" 200 None 2026-03-07 09:04:18,995 - lava_callback - INFO - Completed processing callback for node 69abe9b840deb775998f4404 2026-03-07 09:04:24,901 - lava_callback - INFO - Received callback for node 69abe9cb40deb775998f444b INFO: 172.19.0.1:34102 - "POST /node/69abe9cb40deb775998f444b HTTP/1.0" 202 Accepted 2026-03-07 09:04:24,912 - lava_callback - INFO - Starting async job submit for node 69abe9cb40deb775998f444b 2026-03-07 09:04:24,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:24,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cb40deb775998f444b HTTP/1.1" 200 None 2026-03-07 09:04:24,959 - lava_callback - DEBUG - Processing node 69abe9cb40deb775998f444b: baseline-arm64-pengutronix 2026-03-07 09:04:25,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:25,418 - lava_callback - INFO - Received callback for node 69abe98f40deb775998f436e INFO: 172.19.0.1:34118 - "POST /node/69abe98f40deb775998f436e HTTP/1.0" 202 Accepted 2026-03-07 09:04:25,432 - lava_callback - INFO - Starting async job submit for node 69abe98f40deb775998f436e 2026-03-07 09:04:25,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:25,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98f40deb775998f436e HTTP/1.1" 200 None 2026-03-07 09:04:25,500 - lava_callback - DEBUG - Processing node 69abe98f40deb775998f436e: baseline-arm64 2026-03-07 09:04:25,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:25,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cb40deb775998f444b/log.txt.gz 2026-03-07 09:04:25,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:26,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:34122 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:26,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:26,547 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98f40deb775998f436e/log.txt.gz 2026-03-07 09:04:26,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:26,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cb40deb775998f444b/lava-logs.yaml 2026-03-07 09:04:26,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:26,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:27,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:27,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cb40deb775998f444b/lava_callback.json.gz 2026-03-07 09:04:27,240 - lava_callback - INFO - Received callback for node 69abe9bc40deb775998f440a INFO: 172.19.0.1:34126 - "POST /node/69abe9bc40deb775998f440a HTTP/1.0" 202 Accepted 2026-03-07 09:04:27,261 - lava_callback - INFO - Starting async job submit for node 69abe9bc40deb775998f440a 2026-03-07 09:04:27,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:27,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:27,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cb40deb775998f444b HTTP/1.1" 200 None 2026-03-07 09:04:27,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:27,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9bc40deb775998f440a HTTP/1.1" 200 None 2026-03-07 09:04:27,347 - lava_callback - DEBUG - Processing node 69abe9bc40deb775998f440a: baseline-arm64-broonie 2026-03-07 09:04:27,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:27,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:27,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98f40deb775998f436e/lava-logs.yaml 2026-03-07 09:04:27,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:27,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:27,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9cb40deb775998f444b HTTP/1.1" 200 None 2026-03-07 09:04:27,539 - lava_callback - INFO - Completed processing callback for node 69abe9cb40deb775998f444b 2026-03-07 09:04:27,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:28,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:28,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98f40deb775998f436e/lava_callback.json.gz 2026-03-07 09:04:28,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:28,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:28,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9bc40deb775998f440a/log.txt.gz 2026-03-07 09:04:28,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98f40deb775998f436e HTTP/1.1" 200 None 2026-03-07 09:04:28,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:28,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:28,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:28,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:28,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98f40deb775998f436e HTTP/1.1" 200 None 2026-03-07 09:04:28,407 - lava_callback - INFO - Completed processing callback for node 69abe98f40deb775998f436e 2026-03-07 09:04:28,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:28,972 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9bc40deb775998f440a/lava-logs.yaml 2026-03-07 09:04:28,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:29,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:29,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9bc40deb775998f440a/lava_callback.json.gz 2026-03-07 09:04:29,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:29,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9bc40deb775998f440a HTTP/1.1" 200 None 2026-03-07 09:04:29,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:29,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:29,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:29,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9bc40deb775998f440a HTTP/1.1" 200 None 2026-03-07 09:04:29,253 - lava_callback - INFO - Completed processing callback for node 69abe9bc40deb775998f440a 2026-03-07 09:04:30,387 - lava_callback - INFO - Received callback for node 69abe9cd40deb775998f444e INFO: 172.19.0.1:32824 - "POST /node/69abe9cd40deb775998f444e HTTP/1.0" 202 Accepted 2026-03-07 09:04:30,397 - lava_callback - INFO - Starting async job submit for node 69abe9cd40deb775998f444e 2026-03-07 09:04:30,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:30,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cd40deb775998f444e HTTP/1.1" 200 None 2026-03-07 09:04:30,472 - lava_callback - DEBUG - Processing node 69abe9cd40deb775998f444e: baseline-arm64-pengutronix 2026-03-07 09:04:30,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:30,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:30,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-07 09:04:31,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:31,151 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cd40deb775998f444e/log.txt.gz 2026-03-07 09:04:31,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:31,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:31,870 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cd40deb775998f444e/lava-logs.yaml 2026-03-07 09:04:31,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:32,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:32,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cd40deb775998f444e/lava_callback.json.gz 2026-03-07 09:04:32,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:32,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cd40deb775998f444e HTTP/1.1" 200 None 2026-03-07 09:04:32,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:32,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:32,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:32,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9cd40deb775998f444e HTTP/1.1" 200 None 2026-03-07 09:04:32,128 - lava_callback - INFO - Completed processing callback for node 69abe9cd40deb775998f444e INFO: 172.19.0.1:32832 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:37,679 - lava_callback - INFO - Received callback for node 69abe9b240deb775998f43f4 INFO: 172.19.0.1:32846 - "POST /node/69abe9b240deb775998f43f4 HTTP/1.0" 202 Accepted 2026-03-07 09:04:37,685 - lava_callback - INFO - Starting async job submit for node 69abe9b240deb775998f43f4 2026-03-07 09:04:37,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:37,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b240deb775998f43f4 HTTP/1.1" 200 None 2026-03-07 09:04:37,720 - lava_callback - DEBUG - Processing node 69abe9b240deb775998f43f4: baseline-arm64-broonie 2026-03-07 09:04:38,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:38,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:38,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b240deb775998f43f4/log.txt.gz 2026-03-07 09:04:38,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:38,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:38,557 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b240deb775998f43f4/lava-logs.yaml 2026-03-07 09:04:38,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:38,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:38,690 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b240deb775998f43f4/lava_callback.json.gz 2026-03-07 09:04:38,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:38,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b240deb775998f43f4 HTTP/1.1" 200 None 2026-03-07 09:04:38,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:38,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:38,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:38,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b240deb775998f43f4 HTTP/1.1" 200 None 2026-03-07 09:04:38,775 - lava_callback - INFO - Completed processing callback for node 69abe9b240deb775998f43f4 2026-03-07 09:04:41,105 - lava_callback - INFO - Received callback for node 69a947277ee78ae610cab601 INFO: 172.19.0.1:33318 - "POST /node/69a947277ee78ae610cab601 HTTP/1.0" 202 Accepted 2026-03-07 09:04:41,110 - lava_callback - INFO - Starting async job submit for node 69a947277ee78ae610cab601 2026-03-07 09:04:41,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:41,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947277ee78ae610cab601 HTTP/1.1" 200 None 2026-03-07 09:04:41,136 - lava_callback - DEBUG - Processing node 69a947277ee78ae610cab601: baseline-arm-baylibre 2026-03-07 09:04:41,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a947277ee78ae610cab601 2026-03-07 09:04:41,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:41,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947277ee78ae610cab601 HTTP/1.1" 200 None 2026-03-07 09:04:41,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:41,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:04:41,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:41,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a947277ee78ae610cab601 HTTP/1.1" 200 None 2026-03-07 09:04:41,189 - lava_callback - ERROR - Error processing callback for node 69a947277ee78ae610cab601: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 09:04:45,782 - lava_callback - INFO - Received callback for node 69abe9c240deb775998f4418 INFO: 172.19.0.1:33322 - "POST /node/69abe9c240deb775998f4418 HTTP/1.0" 202 Accepted 2026-03-07 09:04:45,788 - lava_callback - INFO - Starting async job submit for node 69abe9c240deb775998f4418 2026-03-07 09:04:45,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:45,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c240deb775998f4418 HTTP/1.1" 200 None 2026-03-07 09:04:45,830 - lava_callback - DEBUG - Processing node 69abe9c240deb775998f4418: baseline-arm64-clabbe 2026-03-07 09:04:46,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:46,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:46,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c240deb775998f4418/log.txt.gz 2026-03-07 09:04:46,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:46,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:46,481 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c240deb775998f4418/lava-logs.yaml 2026-03-07 09:04:46,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:33334 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:46,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:46,615 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c240deb775998f4418/lava_callback.json.gz 2026-03-07 09:04:46,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:46,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c240deb775998f4418 HTTP/1.1" 200 None 2026-03-07 09:04:46,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:46,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:46,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:46,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9c240deb775998f4418 HTTP/1.1" 200 None 2026-03-07 09:04:46,713 - lava_callback - INFO - Completed processing callback for node 69abe9c240deb775998f4418 2026-03-07 09:04:47,413 - lava_callback - INFO - Received callback for node 69abe9b440deb775998f43f7 INFO: 172.19.0.1:33350 - "POST /node/69abe9b440deb775998f43f7 HTTP/1.0" 202 Accepted 2026-03-07 09:04:47,419 - lava_callback - INFO - Starting async job submit for node 69abe9b440deb775998f43f7 2026-03-07 09:04:47,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:47,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b440deb775998f43f7 HTTP/1.1" 200 None 2026-03-07 09:04:47,459 - lava_callback - DEBUG - Processing node 69abe9b440deb775998f43f7: baseline-arm64-broonie 2026-03-07 09:04:47,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:47,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:47,840 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b440deb775998f43f7/log.txt.gz 2026-03-07 09:04:47,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:48,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:48,199 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b440deb775998f43f7/lava-logs.yaml 2026-03-07 09:04:48,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:48,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:48,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b440deb775998f43f7/lava_callback.json.gz 2026-03-07 09:04:48,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:48,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b440deb775998f43f7 HTTP/1.1" 200 None 2026-03-07 09:04:48,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:48,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:48,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:48,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b440deb775998f43f7 HTTP/1.1" 200 None 2026-03-07 09:04:48,466 - lava_callback - INFO - Completed processing callback for node 69abe9b440deb775998f43f7 2026-03-07 09:04:48,833 - lava_callback - INFO - Received callback for node 69abe9b540deb775998f43fa INFO: 172.19.0.1:33360 - "POST /node/69abe9b540deb775998f43fa HTTP/1.0" 202 Accepted 2026-03-07 09:04:48,840 - lava_callback - INFO - Starting async job submit for node 69abe9b540deb775998f43fa 2026-03-07 09:04:48,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:48,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b540deb775998f43fa HTTP/1.1" 200 None 2026-03-07 09:04:48,887 - lava_callback - DEBUG - Processing node 69abe9b540deb775998f43fa: baseline-arm64-broonie 2026-03-07 09:04:49,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:49,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:49,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b540deb775998f43fa/log.txt.gz 2026-03-07 09:04:49,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:49,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:49,655 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b540deb775998f43fa/lava-logs.yaml 2026-03-07 09:04:49,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:49,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:49,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b540deb775998f43fa/lava_callback.json.gz 2026-03-07 09:04:49,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:49,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b540deb775998f43fa HTTP/1.1" 200 None 2026-03-07 09:04:49,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:49,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:49,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:49,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b540deb775998f43fa HTTP/1.1" 200 None 2026-03-07 09:04:49,874 - lava_callback - INFO - Completed processing callback for node 69abe9b540deb775998f43fa 2026-03-07 09:04:53,314 - lava_callback - INFO - Received callback for node 69abe9c140deb775998f4413 INFO: 172.19.0.1:34292 - "POST /node/69abe9c140deb775998f4413 HTTP/1.0" 202 Accepted 2026-03-07 09:04:53,321 - lava_callback - INFO - Starting async job submit for node 69abe9c140deb775998f4413 2026-03-07 09:04:53,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:53,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c140deb775998f4413 HTTP/1.1" 200 None 2026-03-07 09:04:53,358 - lava_callback - DEBUG - Processing node 69abe9c140deb775998f4413: baseline-arm64-clabbe 2026-03-07 09:04:53,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:53,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:53,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c140deb775998f4413/log.txt.gz 2026-03-07 09:04:53,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:54,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:54,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c140deb775998f4413/lava-logs.yaml 2026-03-07 09:04:54,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:54,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:54,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c140deb775998f4413/lava_callback.json.gz 2026-03-07 09:04:54,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:54,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c140deb775998f4413 HTTP/1.1" 200 None 2026-03-07 09:04:54,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:54,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:54,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:54,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9c140deb775998f4413 HTTP/1.1" 200 None 2026-03-07 09:04:54,474 - lava_callback - INFO - Completed processing callback for node 69abe9c140deb775998f4413 INFO: 172.19.0.1:34302 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:57,038 - lava_callback - INFO - Received callback for node 69abe61b40deb775998f3f96 INFO: 172.19.0.1:34312 - "POST /node/69abe61b40deb775998f3f96 HTTP/1.0" 202 Accepted 2026-03-07 09:04:57,044 - lava_callback - INFO - Starting async job submit for node 69abe61b40deb775998f3f96 2026-03-07 09:04:57,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:57,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61b40deb775998f3f96 HTTP/1.1" 200 None 2026-03-07 09:04:57,113 - lava_callback - DEBUG - Processing node 69abe61b40deb775998f3f96: baseline-arm 2026-03-07 09:04:57,327 - lava_callback - INFO - Received callback for node 69abe9be40deb775998f440d INFO: 172.19.0.1:34322 - "POST /node/69abe9be40deb775998f440d HTTP/1.0" 202 Accepted 2026-03-07 09:04:57,383 - lava_callback - INFO - Starting async job submit for node 69abe9be40deb775998f440d 2026-03-07 09:04:57,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:57,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9be40deb775998f440d HTTP/1.1" 200 None 2026-03-07 09:04:57,557 - lava_callback - DEBUG - Processing node 69abe9be40deb775998f440d: baseline-arm64-broonie 2026-03-07 09:04:58,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:58,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:58,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:58,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9be40deb775998f440d/log.txt.gz 2026-03-07 09:04:58,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:58,465 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f96/log.txt.gz 2026-03-07 09:04:58,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:58,934 - lava_callback - INFO - Received callback for node 69abe99f40deb775998f4397 INFO: 172.19.0.1:34324 - "POST /node/69abe99f40deb775998f4397 HTTP/1.0" 202 Accepted 2026-03-07 09:04:58,952 - lava_callback - INFO - Starting async job submit for node 69abe99f40deb775998f4397 2026-03-07 09:04:58,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:58,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:58,997 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9be40deb775998f440d/lava-logs.yaml 2026-03-07 09:04:58,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:59,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:59,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99f40deb775998f4397 HTTP/1.1" 200 None 2026-03-07 09:04:59,017 - lava_callback - DEBUG - Processing node 69abe99f40deb775998f4397: baseline-nfs-arm64 2026-03-07 09:04:59,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:59,243 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9be40deb775998f440d/lava_callback.json.gz 2026-03-07 09:04:59,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:59,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:59,369 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f96/lava-logs.yaml 2026-03-07 09:04:59,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9be40deb775998f440d HTTP/1.1" 200 None 2026-03-07 09:04:59,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:59,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:59,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:59,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:59,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:59,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9be40deb775998f440d HTTP/1.1" 200 None 2026-03-07 09:04:59,637 - lava_callback - INFO - Completed processing callback for node 69abe9be40deb775998f440d 2026-03-07 09:04:59,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:59,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f96/lava_callback.json.gz 2026-03-07 09:04:59,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:59,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99f40deb775998f4397/log.txt.gz DEBUG: Setup failed for 69abe61b40deb775998f3f96. Transitting job node result: incomplete -> fail 2026-03-07 09:05:00,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61b40deb775998f3f96 HTTP/1.1" 200 None 2026-03-07 09:05:00,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:05:00,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:00,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61b40deb775998f3f96 HTTP/1.1" 200 None 2026-03-07 09:05:00,371 - lava_callback - INFO - Completed processing callback for node 69abe61b40deb775998f3f96 2026-03-07 09:05:00,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:00,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99f40deb775998f4397/lava-logs.yaml 2026-03-07 09:05:00,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:00,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:00,695 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99f40deb775998f4397/lava_callback.json.gz 2026-03-07 09:05:00,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99f40deb775998f4397 HTTP/1.1" 200 None 2026-03-07 09:05:00,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:05:00,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99f40deb775998f4397 HTTP/1.1" 200 None 2026-03-07 09:05:00,785 - lava_callback - INFO - Completed processing callback for node 69abe99f40deb775998f4397 2026-03-07 09:05:00,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.19.0.1:44644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44654 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:05:07,185 - lava_callback - INFO - Received callback for node 69abe9ba40deb775998f4407 INFO: 172.19.0.1:44658 - "POST /node/69abe9ba40deb775998f4407 HTTP/1.0" 202 Accepted 2026-03-07 09:05:07,196 - lava_callback - INFO - Starting async job submit for node 69abe9ba40deb775998f4407 2026-03-07 09:05:07,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:07,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9ba40deb775998f4407 HTTP/1.1" 200 None 2026-03-07 09:05:07,264 - lava_callback - DEBUG - Processing node 69abe9ba40deb775998f4407: baseline-arm64-broonie 2026-03-07 09:05:07,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:07,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:07,831 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9ba40deb775998f4407/log.txt.gz 2026-03-07 09:05:07,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:08,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:08,189 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9ba40deb775998f4407/lava-logs.yaml 2026-03-07 09:05:08,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:08,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:08,339 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9ba40deb775998f4407/lava_callback.json.gz 2026-03-07 09:05:08,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:08,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9ba40deb775998f4407 HTTP/1.1" 200 None 2026-03-07 09:05:08,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:08,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:05:08,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:08,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9ba40deb775998f4407 HTTP/1.1" 200 None 2026-03-07 09:05:08,431 - lava_callback - INFO - Completed processing callback for node 69abe9ba40deb775998f4407 INFO: 172.19.0.1:41962 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 09:05:16,152 - lava_callback - INFO - Received callback for node 69abe9c540deb775998f443c INFO: 172.19.0.1:41978 - "POST /node/69abe9c540deb775998f443c HTTP/1.0" 202 Accepted 2026-03-07 09:05:16,158 - lava_callback - INFO - Starting async job submit for node 69abe9c540deb775998f443c 2026-03-07 09:05:16,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:16,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c540deb775998f443c HTTP/1.1" 200 None 2026-03-07 09:05:16,195 - lava_callback - DEBUG - Processing node 69abe9c540deb775998f443c: baseline-arm64-clabbe 2026-03-07 09:05:16,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:41984 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:05:16,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:16,560 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c540deb775998f443c/log.txt.gz 2026-03-07 09:05:16,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:16,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:16,875 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c540deb775998f443c/lava-logs.yaml 2026-03-07 09:05:16,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:17,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:17,042 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c540deb775998f443c/lava_callback.json.gz 2026-03-07 09:05:17,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:17,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c540deb775998f443c HTTP/1.1" 200 None 2026-03-07 09:05:17,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:17,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:05:17,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:17,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9c540deb775998f443c HTTP/1.1" 200 None 2026-03-07 09:05:17,122 - lava_callback - INFO - Completed processing callback for node 69abe9c540deb775998f443c 2026-03-07 09:05:17,277 - lava_callback - INFO - Received callback for node 69abe9b140deb775998f43f0 INFO: 172.19.0.1:41990 - "POST /node/69abe9b140deb775998f43f0 HTTP/1.0" 202 Accepted 2026-03-07 09:05:17,284 - lava_callback - INFO - Starting async job submit for node 69abe9b140deb775998f43f0 2026-03-07 09:05:17,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:17,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b140deb775998f43f0 HTTP/1.1" 200 None 2026-03-07 09:05:17,337 - lava_callback - DEBUG - Processing node 69abe9b140deb775998f43f0: baseline-arm64-broonie 2026-03-07 09:05:17,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:17,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:17,717 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b140deb775998f43f0/log.txt.gz 2026-03-07 09:05:17,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:18,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:18,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b140deb775998f43f0/lava-logs.yaml 2026-03-07 09:05:18,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:18,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:18,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b140deb775998f43f0/lava_callback.json.gz 2026-03-07 09:05:18,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:18,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b140deb775998f43f0 HTTP/1.1" 200 None 2026-03-07 09:05:18,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:18,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:05:18,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:18,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b140deb775998f43f0 HTTP/1.1" 200 None 2026-03-07 09:05:18,277 - lava_callback - INFO - Completed processing callback for node 69abe9b140deb775998f43f0 INFO: 172.19.0.1:33852 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:05:30,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:30,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33904 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:05:41,177 - lava_callback - INFO - Received callback for node 69a947577ee78ae610cab631 INFO: 172.19.0.1:44544 - "POST /node/69a947577ee78ae610cab631 HTTP/1.0" 202 Accepted 2026-03-07 09:05:41,183 - lava_callback - INFO - Starting async job submit for node 69a947577ee78ae610cab631 2026-03-07 09:05:41,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:41,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947577ee78ae610cab631 HTTP/1.1" 200 None 2026-03-07 09:05:41,206 - lava_callback - DEBUG - Processing node 69a947577ee78ae610cab631: baseline-arm-baylibre 2026-03-07 09:05:41,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a947577ee78ae610cab631 2026-03-07 09:05:41,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:41,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947577ee78ae610cab631 HTTP/1.1" 200 None 2026-03-07 09:05:41,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:41,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:05:41,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:41,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a947577ee78ae610cab631 HTTP/1.1" 200 None 2026-03-07 09:05:41,263 - lava_callback - ERROR - Error processing callback for node 69a947577ee78ae610cab631: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45824 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:06:03,464 - lava_callback - INFO - Received callback for node 69abe99640deb775998f4382 INFO: 172.19.0.1:56404 - "POST /node/69abe99640deb775998f4382 HTTP/1.0" 202 Accepted 2026-03-07 09:06:03,470 - lava_callback - INFO - Starting async job submit for node 69abe99640deb775998f4382 2026-03-07 09:06:03,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:03,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99640deb775998f4382 HTTP/1.1" 200 None 2026-03-07 09:06:03,504 - lava_callback - DEBUG - Processing node 69abe99640deb775998f4382: baseline-nfs-arm64 2026-03-07 09:06:03,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:04,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:04,060 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99640deb775998f4382/log.txt.gz 2026-03-07 09:06:04,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:04,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:04,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99640deb775998f4382/lava-logs.yaml 2026-03-07 09:06:04,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:04,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:04,744 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99640deb775998f4382/lava_callback.json.gz 2026-03-07 09:06:04,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:04,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99640deb775998f4382 HTTP/1.1" 200 None 2026-03-07 09:06:04,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:04,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:06:04,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:04,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99640deb775998f4382 HTTP/1.1" 200 None 2026-03-07 09:06:04,823 - lava_callback - INFO - Completed processing callback for node 69abe99640deb775998f4382 INFO: 172.19.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56418 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:06:13,183 - lava_callback - INFO - Received callback for node 69abe9c740deb775998f4443 INFO: 172.19.0.1:32854 - "POST /node/69abe9c740deb775998f4443 HTTP/1.0" 202 Accepted 2026-03-07 09:06:13,189 - lava_callback - INFO - Starting async job submit for node 69abe9c740deb775998f4443 2026-03-07 09:06:13,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:13,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c740deb775998f4443 HTTP/1.1" 200 None 2026-03-07 09:06:13,226 - lava_callback - DEBUG - Processing node 69abe9c740deb775998f4443: baseline-arm64-clabbe 2026-03-07 09:06:13,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:13,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:13,614 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c740deb775998f4443/log.txt.gz 2026-03-07 09:06:13,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:13,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:13,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c740deb775998f4443/lava-logs.yaml 2026-03-07 09:06:13,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:14,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:14,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c740deb775998f4443/lava_callback.json.gz 2026-03-07 09:06:14,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:14,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c740deb775998f4443 HTTP/1.1" 200 None 2026-03-07 09:06:14,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:14,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:06:14,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:14,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9c740deb775998f4443 HTTP/1.1" 200 None 2026-03-07 09:06:14,202 - lava_callback - INFO - Completed processing callback for node 69abe9c740deb775998f4443 INFO: 172.19.0.1:32870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35196 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:06:30,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:30,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:46702 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:06:37,296 - lava_callback - INFO - Received callback for node 69abe9c340deb775998f441b INFO: 172.19.0.1:46710 - "POST /node/69abe9c340deb775998f441b HTTP/1.0" 202 Accepted 2026-03-07 09:06:37,302 - lava_callback - INFO - Starting async job submit for node 69abe9c340deb775998f441b 2026-03-07 09:06:37,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:37,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c340deb775998f441b HTTP/1.1" 200 None 2026-03-07 09:06:37,347 - lava_callback - DEBUG - Processing node 69abe9c340deb775998f441b: baseline-arm64-clabbe 2026-03-07 09:06:37,426 - lava_callback - INFO - Received callback for node 69abe9b740deb775998f43fd INFO: 172.19.0.1:46722 - "POST /node/69abe9b740deb775998f43fd HTTP/1.0" 202 Accepted 2026-03-07 09:06:37,442 - lava_callback - INFO - Starting async job submit for node 69abe9b740deb775998f43fd 2026-03-07 09:06:37,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:37,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b740deb775998f43fd HTTP/1.1" 200 None 2026-03-07 09:06:37,589 - lava_callback - DEBUG - Processing node 69abe9b740deb775998f43fd: baseline-arm64-broonie 2026-03-07 09:06:37,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:37,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:38,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,036 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c340deb775998f441b/log.txt.gz 2026-03-07 09:06:38,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b740deb775998f43fd/log.txt.gz 2026-03-07 09:06:38,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:38,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:38,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,604 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c340deb775998f441b/lava-logs.yaml 2026-03-07 09:06:38,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:38,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,632 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b740deb775998f43fd/lava-logs.yaml 2026-03-07 09:06:38,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:38,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c340deb775998f441b/lava_callback.json.gz 2026-03-07 09:06:38,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b740deb775998f43fd/lava_callback.json.gz 2026-03-07 09:06:38,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c340deb775998f441b HTTP/1.1" 200 None 2026-03-07 09:06:38,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b740deb775998f43fd HTTP/1.1" 200 None 2026-03-07 09:06:38,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:06:38,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:06:38,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9c340deb775998f441b HTTP/1.1" 200 None 2026-03-07 09:06:38,931 - lava_callback - INFO - Completed processing callback for node 69abe9c340deb775998f441b 2026-03-07 09:06:38,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b740deb775998f43fd HTTP/1.1" 200 None 2026-03-07 09:06:38,959 - lava_callback - INFO - Completed processing callback for node 69abe9b740deb775998f43fd 2026-03-07 09:06:41,228 - lava_callback - INFO - Received callback for node 69a947917ee78ae610cab68d INFO: 172.19.0.1:59390 - "POST /node/69a947917ee78ae610cab68d HTTP/1.0" 202 Accepted 2026-03-07 09:06:41,233 - lava_callback - INFO - Starting async job submit for node 69a947917ee78ae610cab68d 2026-03-07 09:06:41,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:41,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947917ee78ae610cab68d HTTP/1.1" 200 None 2026-03-07 09:06:41,249 - lava_callback - DEBUG - Processing node 69a947917ee78ae610cab68d: baseline-arm64-baylibre 2026-03-07 09:06:41,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a947917ee78ae610cab68d 2026-03-07 09:06:41,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:41,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947917ee78ae610cab68d HTTP/1.1" 200 None 2026-03-07 09:06:41,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:41,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 09:06:41,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:41,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a947917ee78ae610cab68d HTTP/1.1" 200 None 2026-03-07 09:06:41,314 - lava_callback - ERROR - Error processing callback for node 69a947917ee78ae610cab68d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42860 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:07:00,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:07:00,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53170 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:53182 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:07:36,708 - lava_callback - INFO - Received callback for node 69abe64540deb775998f403b INFO: 172.19.0.1:53184 - "POST /node/69abe64540deb775998f403b HTTP/1.0" 202 Accepted 2026-03-07 09:07:36,757 - lava_callback - INFO - Starting async job submit for node 69abe64540deb775998f403b 2026-03-07 09:07:36,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:07:36,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64540deb775998f403b HTTP/1.1" 200 None 2026-03-07 09:07:36,796 - lava_callback - DEBUG - Processing node 69abe64540deb775998f403b: baseline-arm-pengutronix 2026-03-07 09:07:36,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:07:37,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:07:37,111 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64540deb775998f403b/log.txt.gz 2026-03-07 09:07:37,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:07:37,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:07:37,416 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64540deb775998f403b/lava-logs.yaml 2026-03-07 09:07:37,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:07:37,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:07:37,547 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64540deb775998f403b/lava_callback.json.gz DEBUG: Setup failed for 69abe64540deb775998f403b. Transitting job node result: incomplete -> fail 2026-03-07 09:07:37,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:07:37,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64540deb775998f403b HTTP/1.1" 200 None 2026-03-07 09:07:37,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:07:37,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:07:37,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:07:37,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe64540deb775998f403b HTTP/1.1" 200 None 2026-03-07 09:07:37,726 - lava_callback - INFO - Completed processing callback for node 69abe64540deb775998f403b INFO: 172.19.0.1:40200 - "GET /wiki HTTP/1.0" 404 Not Found INFO: 172.19.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48176 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:08:00,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:08:00,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39052 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:08:41,393 - lava_callback - INFO - Received callback for node 69a9480f7ee78ae610cab6f5 INFO: 172.19.0.1:39488 - "POST /node/69a9480f7ee78ae610cab6f5 HTTP/1.0" 202 Accepted 2026-03-07 09:08:41,398 - lava_callback - INFO - Starting async job submit for node 69a9480f7ee78ae610cab6f5 2026-03-07 09:08:41,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:08:41,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9480f7ee78ae610cab6f5 HTTP/1.1" 200 None 2026-03-07 09:08:41,424 - lava_callback - DEBUG - Processing node 69a9480f7ee78ae610cab6f5: baseline-arm64-baylibre 2026-03-07 09:08:41,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9480f7ee78ae610cab6f5 2026-03-07 09:08:41,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:08:41,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9480f7ee78ae610cab6f5 HTTP/1.1" 200 None 2026-03-07 09:08:41,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:08:41,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 09:08:41,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:08:41,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9480f7ee78ae610cab6f5 HTTP/1.1" 200 None 2026-03-07 09:08:41,492 - lava_callback - ERROR - Error processing callback for node 69a9480f7ee78ae610cab6f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47628 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:11:01,468 - lava_callback - INFO - Received callback for node 69a948957ee78ae610cab7b0 INFO: 172.19.0.1:42408 - "POST /node/69a948957ee78ae610cab7b0 HTTP/1.0" 202 Accepted 2026-03-07 09:11:01,473 - lava_callback - INFO - Starting async job submit for node 69a948957ee78ae610cab7b0 2026-03-07 09:11:01,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:11:01,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a948957ee78ae610cab7b0 HTTP/1.1" 200 None 2026-03-07 09:11:01,499 - lava_callback - DEBUG - Processing node 69a948957ee78ae610cab7b0: baseline-arm64-baylibre 2026-03-07 09:11:01,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a948957ee78ae610cab7b0 2026-03-07 09:11:01,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:11:01,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a948957ee78ae610cab7b0 HTTP/1.1" 200 None 2026-03-07 09:11:01,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:11:01,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 09:11:01,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:11:01,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a948957ee78ae610cab7b0 HTTP/1.1" 200 None 2026-03-07 09:11:01,556 - lava_callback - ERROR - Error processing callback for node 69a948957ee78ae610cab7b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48080 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:14:46,744 - lava_callback - INFO - Received callback for node 69abe98740deb775998f4344 INFO: 172.19.0.1:48088 - "POST /node/69abe98740deb775998f4344 HTTP/1.0" 202 Accepted 2026-03-07 09:14:46,751 - lava_callback - INFO - Starting async job submit for node 69abe98740deb775998f4344 2026-03-07 09:14:46,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:14:46,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98740deb775998f4344 HTTP/1.1" 200 None 2026-03-07 09:14:46,807 - lava_callback - DEBUG - Processing node 69abe98740deb775998f4344: baseline-arm64 2026-03-07 09:14:47,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:14:47,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:14:47,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98740deb775998f4344/log.txt.gz 2026-03-07 09:14:48,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:14:48,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:14:48,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98740deb775998f4344/lava-logs.yaml 2026-03-07 09:14:48,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:14:48,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:14:48,487 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98740deb775998f4344/lava_callback.json.gz 2026-03-07 09:14:48,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:14:48,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98740deb775998f4344 HTTP/1.1" 200 None 2026-03-07 09:14:48,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:14:48,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:14:48,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:14:48,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98740deb775998f4344 HTTP/1.1" 200 None 2026-03-07 09:14:48,570 - lava_callback - INFO - Completed processing callback for node 69abe98740deb775998f4344 INFO: 172.19.0.1:45904 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:15:00,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:15:00,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56488 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:16:04,520 - lava_callback - INFO - Received callback for node 69abeccc40deb775998f46b7 INFO: 172.19.0.1:44418 - "POST /node/69abeccc40deb775998f46b7 HTTP/1.0" 202 Accepted 2026-03-07 09:16:04,525 - lava_callback - INFO - Starting async job submit for node 69abeccc40deb775998f46b7 2026-03-07 09:16:04,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:04,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abeccc40deb775998f46b7 HTTP/1.1" 200 None 2026-03-07 09:16:04,544 - lava_callback - DEBUG - Processing node 69abeccc40deb775998f46b7: baseline-arm 2026-03-07 09:16:04,549 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:16:04,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:16:04,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:16:04,700 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abeccc40deb775998f46b7/lava-logs.yaml 2026-03-07 09:16:04,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:16:04,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:16:04,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abeccc40deb775998f46b7/lava_callback.json.gz 2026-03-07 09:16:04,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:04,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abeccc40deb775998f46b7 HTTP/1.1" 200 None 2026-03-07 09:16:04,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:04,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:16:04,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:04,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abeccc40deb775998f46b7 HTTP/1.1" 200 None 2026-03-07 09:16:04,938 - lava_callback - INFO - Completed processing callback for node 69abeccc40deb775998f46b7 INFO: 172.19.0.1:44428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42108 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:16:25,938 - lava_callback - INFO - Received callback for node 69abe99440deb775998f437c INFO: 172.19.0.1:34746 - "POST /node/69abe99440deb775998f437c HTTP/1.0" 202 Accepted 2026-03-07 09:16:25,945 - lava_callback - INFO - Starting async job submit for node 69abe99440deb775998f437c 2026-03-07 09:16:25,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:25,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99440deb775998f437c HTTP/1.1" 200 None 2026-03-07 09:16:25,997 - lava_callback - DEBUG - Processing node 69abe99440deb775998f437c: baseline-arm64 2026-03-07 09:16:26,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:34748 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:16:26,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:16:26,535 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99440deb775998f437c/log.txt.gz 2026-03-07 09:16:26,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:16:27,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:16:27,092 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99440deb775998f437c/lava-logs.yaml 2026-03-07 09:16:27,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:16:27,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:16:27,278 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99440deb775998f437c/lava_callback.json.gz DEBUG: Setup failed for 69abe99440deb775998f437c. Transitting job node result: incomplete -> fail 2026-03-07 09:16:27,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:27,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99440deb775998f437c HTTP/1.1" 200 None 2026-03-07 09:16:27,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:27,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:16:27,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:27,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99440deb775998f437c HTTP/1.1" 200 None 2026-03-07 09:16:27,533 - lava_callback - INFO - Completed processing callback for node 69abe99440deb775998f437c 2026-03-07 09:16:30,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:31,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59440 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:19:11,577 - lava_callback - INFO - Received callback for node 69abed2d40deb775998f46e5 INFO: 172.19.0.1:40686 - "POST /node/69abed2d40deb775998f46e5 HTTP/1.0" 202 Accepted 2026-03-07 09:19:11,583 - lava_callback - INFO - Starting async job submit for node 69abed2d40deb775998f46e5 2026-03-07 09:19:11,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:11,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abed2d40deb775998f46e5 HTTP/1.1" 200 None 2026-03-07 09:19:11,618 - lava_callback - DEBUG - Processing node 69abed2d40deb775998f46e5: baseline-x86 2026-03-07 09:19:11,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:12,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:12,028 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69abed2d40deb775998f46e5/log.txt.gz 2026-03-07 09:19:12,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:12,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:12,448 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69abed2d40deb775998f46e5/lava-logs.yaml 2026-03-07 09:19:12,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:12,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:12,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69abed2d40deb775998f46e5/lava_callback.json.gz 2026-03-07 09:19:12,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:12,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abed2d40deb775998f46e5 HTTP/1.1" 200 None 2026-03-07 09:19:12,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:12,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf4740deb775998f3bd2 HTTP/1.1" 200 None 2026-03-07 09:19:12,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:12,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abed2d40deb775998f46e5 HTTP/1.1" 200 None 2026-03-07 09:19:12,784 - lava_callback - INFO - Completed processing callback for node 69abed2d40deb775998f46e5 INFO: 172.19.0.1:40692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50132 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:19:31,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:31,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56268 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:19:47,623 - lava_callback - INFO - Received callback for node 69abe67140deb775998f40a7 INFO: 172.19.0.1:56282 - "POST /node/69abe67140deb775998f40a7 HTTP/1.0" 202 Accepted 2026-03-07 09:19:47,669 - lava_callback - INFO - Starting async job submit for node 69abe67140deb775998f40a7 2026-03-07 09:19:47,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:47,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe67140deb775998f40a7 HTTP/1.1" 200 None 2026-03-07 09:19:47,710 - lava_callback - DEBUG - Processing node 69abe67140deb775998f40a7: ltp-timers 2026-03-07 09:19:47,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:47,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:47,947 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69abe67140deb775998f40a7/log.txt.gz 2026-03-07 09:19:47,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:48,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:48,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69abe67140deb775998f40a7/lava-logs.yaml 2026-03-07 09:19:48,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:48,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:48,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69abe67140deb775998f40a7/lava_callback.json.gz 2026-03-07 09:19:48,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:48,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe67140deb775998f40a7 HTTP/1.1" 200 None 2026-03-07 09:19:48,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:48,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:19:48,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:48,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe67140deb775998f40a7 HTTP/1.1" 200 None 2026-03-07 09:19:48,434 - lava_callback - INFO - Completed processing callback for node 69abe67140deb775998f40a7 INFO: 172.19.0.1:41704 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:20:01,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:20:01,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37492 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:22:25,828 - lava_callback - INFO - Received callback for node 69abe99940deb775998f4388 INFO: 172.19.0.1:52480 - "POST /node/69abe99940deb775998f4388 HTTP/1.0" 202 Accepted 2026-03-07 09:22:25,836 - lava_callback - INFO - Starting async job submit for node 69abe99940deb775998f4388 2026-03-07 09:22:25,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:25,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99940deb775998f4388 HTTP/1.1" 200 None 2026-03-07 09:22:25,894 - lava_callback - DEBUG - Processing node 69abe99940deb775998f4388: baseline-nfs-arm64 INFO: 172.19.0.1:52494 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:22:26,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:22:27,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:22:27,141 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99940deb775998f4388/log.txt.gz 2026-03-07 09:22:27,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:22:27,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:22:27,986 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99940deb775998f4388/lava-logs.yaml 2026-03-07 09:22:28,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:22:28,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:22:28,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99940deb775998f4388/lava_callback.json.gz DEBUG: Setup failed for 69abe99940deb775998f4388. Transitting job node result: incomplete -> fail 2026-03-07 09:22:28,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:28,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99940deb775998f4388 HTTP/1.1" 200 None 2026-03-07 09:22:28,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:28,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:22:28,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:28,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99940deb775998f4388 HTTP/1.1" 200 None 2026-03-07 09:22:28,461 - lava_callback - INFO - Completed processing callback for node 69abe99940deb775998f4388 2026-03-07 09:22:31,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:31,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44932 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:22:42,151 - lava_callback - INFO - Received callback for node 69a94b4e7ee78ae610caba4a INFO: 172.19.0.1:53050 - "POST /node/69a94b4e7ee78ae610caba4a HTTP/1.0" 202 Accepted 2026-03-07 09:22:42,157 - lava_callback - INFO - Starting async job submit for node 69a94b4e7ee78ae610caba4a 2026-03-07 09:22:42,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:42,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94b4e7ee78ae610caba4a HTTP/1.1" 200 None 2026-03-07 09:22:42,173 - lava_callback - DEBUG - Processing node 69a94b4e7ee78ae610caba4a: baseline-arm64-baylibre 2026-03-07 09:22:42,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94b4e7ee78ae610caba4a 2026-03-07 09:22:42,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:42,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94b4e7ee78ae610caba4a HTTP/1.1" 200 None 2026-03-07 09:22:42,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:42,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 09:22:42,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:42,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94b4e7ee78ae610caba4a HTTP/1.1" 200 None 2026-03-07 09:22:42,231 - lava_callback - ERROR - Error processing callback for node 69a94b4e7ee78ae610caba4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41518 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:25:22,243 - lava_callback - INFO - Received callback for node 69a94bfb7ee78ae610cababf INFO: 172.19.0.1:38666 - "POST /node/69a94bfb7ee78ae610cababf HTTP/1.0" 202 Accepted 2026-03-07 09:25:22,248 - lava_callback - INFO - Starting async job submit for node 69a94bfb7ee78ae610cababf 2026-03-07 09:25:22,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:25:22,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94bfb7ee78ae610cababf HTTP/1.1" 200 None 2026-03-07 09:25:22,265 - lava_callback - DEBUG - Processing node 69a94bfb7ee78ae610cababf: baseline-arm64-baylibre 2026-03-07 09:25:22,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94bfb7ee78ae610cababf 2026-03-07 09:25:22,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:25:22,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94bfb7ee78ae610cababf HTTP/1.1" 200 None 2026-03-07 09:25:22,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:25:22,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 09:25:22,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:25:22,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94bfb7ee78ae610cababf HTTP/1.1" 200 None 2026-03-07 09:25:22,350 - lava_callback - ERROR - Error processing callback for node 69a94bfb7ee78ae610cababf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58228 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:26:00,377 - lava_callback - INFO - Received callback for node 69abef1740deb775998f479d INFO: 172.19.0.1:41694 - "POST /node/69abef1740deb775998f479d HTTP/1.0" 202 Accepted 2026-03-07 09:26:00,383 - lava_callback - INFO - Starting async job submit for node 69abef1740deb775998f479d 2026-03-07 09:26:00,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:26:00,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abef1740deb775998f479d HTTP/1.1" 200 None 2026-03-07 09:26:00,399 - lava_callback - DEBUG - Processing node 69abef1740deb775998f479d: baseline-nfs-arm64 2026-03-07 09:26:00,401 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:26:00,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:26:00,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:26:00,557 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abef1740deb775998f479d/lava-logs.yaml 2026-03-07 09:26:00,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:26:00,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:26:00,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abef1740deb775998f479d/lava_callback.json.gz 2026-03-07 09:26:00,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:26:00,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abef1740deb775998f479d HTTP/1.1" 200 None 2026-03-07 09:26:00,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:26:00,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:26:00,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:26:00,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abef1740deb775998f479d HTTP/1.1" 200 None 2026-03-07 09:26:00,840 - lava_callback - INFO - Completed processing callback for node 69abef1740deb775998f479d 2026-03-07 09:26:01,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:26:01,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33626 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:27:02,347 - lava_callback - INFO - Received callback for node 69a94c527ee78ae610cabaf7 INFO: 172.19.0.1:44554 - "POST /node/69a94c527ee78ae610cabaf7 HTTP/1.0" 202 Accepted 2026-03-07 09:27:02,352 - lava_callback - INFO - Starting async job submit for node 69a94c527ee78ae610cabaf7 2026-03-07 09:27:02,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:27:02,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94c527ee78ae610cabaf7 HTTP/1.1" 200 None 2026-03-07 09:27:02,369 - lava_callback - DEBUG - Processing node 69a94c527ee78ae610cabaf7: baseline-arm64-baylibre 2026-03-07 09:27:02,370 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94c527ee78ae610cabaf7 2026-03-07 09:27:02,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:27:02,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94c527ee78ae610cabaf7 HTTP/1.1" 200 None 2026-03-07 09:27:02,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:27:02,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 09:27:02,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:27:02,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94c527ee78ae610cabaf7 HTTP/1.1" 200 None 2026-03-07 09:27:02,440 - lava_callback - ERROR - Error processing callback for node 69a94c527ee78ae610cabaf7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43204 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:28:09,910 - lava_callback - INFO - Received callback for node 69abef7c40deb775998f47cd INFO: 172.19.0.1:56480 - "POST /node/69abef7c40deb775998f47cd HTTP/1.0" 202 Accepted 2026-03-07 09:28:09,917 - lava_callback - INFO - Starting async job submit for node 69abef7c40deb775998f47cd 2026-03-07 09:28:09,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:09,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abef7c40deb775998f47cd HTTP/1.1" 200 None 2026-03-07 09:28:09,961 - lava_callback - DEBUG - Processing node 69abef7c40deb775998f47cd: baseline-arm64 2026-03-07 09:28:10,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:28:10,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:28:10,308 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abef7c40deb775998f47cd/log.txt.gz 2026-03-07 09:28:10,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:28:10,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:28:10,582 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abef7c40deb775998f47cd/lava-logs.yaml 2026-03-07 09:28:10,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:28:10,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:28:10,746 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abef7c40deb775998f47cd/lava_callback.json.gz 2026-03-07 09:28:10,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:10,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abef7c40deb775998f47cd HTTP/1.1" 200 None 2026-03-07 09:28:10,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:10,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:28:10,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:10,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abef7c40deb775998f47cd HTTP/1.1" 200 None 2026-03-07 09:28:10,925 - lava_callback - INFO - Completed processing callback for node 69abef7c40deb775998f47cd INFO: 172.19.0.1:56486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56492 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:28:22,452 - lava_callback - INFO - Received callback for node 69a94ca87ee78ae610cabb36 INFO: 172.19.0.1:42784 - "POST /node/69a94ca87ee78ae610cabb36 HTTP/1.0" 202 Accepted 2026-03-07 09:28:22,458 - lava_callback - INFO - Starting async job submit for node 69a94ca87ee78ae610cabb36 2026-03-07 09:28:22,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:22,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94ca87ee78ae610cabb36 HTTP/1.1" 200 None 2026-03-07 09:28:22,499 - lava_callback - DEBUG - Processing node 69a94ca87ee78ae610cabb36: baseline-arm64-baylibre 2026-03-07 09:28:22,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94ca87ee78ae610cabb36 2026-03-07 09:28:22,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:22,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94ca87ee78ae610cabb36 HTTP/1.1" 200 None 2026-03-07 09:28:22,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:22,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 09:28:22,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:22,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94ca87ee78ae610cabb36 HTTP/1.1" 200 None 2026-03-07 09:28:22,576 - lava_callback - ERROR - Error processing callback for node 69a94ca87ee78ae610cabb36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42800 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:28:31,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:31,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57486 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:29:32,942 - lava_callback - INFO - Received callback for node 69abefc640deb775998f47f3 INFO: 172.19.0.1:45316 - "POST /node/69abefc640deb775998f47f3 HTTP/1.0" 202 Accepted 2026-03-07 09:29:32,949 - lava_callback - INFO - Starting async job submit for node 69abefc640deb775998f47f3 2026-03-07 09:29:32,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:29:32,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abefc640deb775998f47f3 HTTP/1.1" 200 None 2026-03-07 09:29:32,994 - lava_callback - DEBUG - Processing node 69abefc640deb775998f47f3: baseline-arm64 2026-03-07 09:29:33,128 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:29:33,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:29:33,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:29:33,404 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abefc640deb775998f47f3/lava-logs.yaml 2026-03-07 09:29:33,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:29:33,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:29:33,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abefc640deb775998f47f3/lava_callback.json.gz 2026-03-07 09:29:33,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:29:33,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abefc640deb775998f47f3 HTTP/1.1" 200 None 2026-03-07 09:29:33,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:29:33,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:29:33,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:29:33,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abefc640deb775998f47f3 HTTP/1.1" 200 None 2026-03-07 09:29:33,742 - lava_callback - INFO - Completed processing callback for node 69abefc640deb775998f47f3 INFO: 172.19.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40058 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:30:01,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:30:01,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53112 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:33:22,714 - lava_callback - INFO - Received callback for node 69a94dd57ee78ae610cabc16 INFO: 172.19.0.1:57004 - "POST /node/69a94dd57ee78ae610cabc16 HTTP/1.0" 202 Accepted 2026-03-07 09:33:22,719 - lava_callback - INFO - Starting async job submit for node 69a94dd57ee78ae610cabc16 2026-03-07 09:33:22,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:33:22,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94dd57ee78ae610cabc16 HTTP/1.1" 200 None 2026-03-07 09:33:22,744 - lava_callback - DEBUG - Processing node 69a94dd57ee78ae610cabc16: baseline-arm64-baylibre 2026-03-07 09:33:22,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94dd57ee78ae610cabc16 2026-03-07 09:33:22,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:33:22,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94dd57ee78ae610cabc16 HTTP/1.1" 200 None 2026-03-07 09:33:22,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:33:22,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 09:33:22,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:33:22,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94dd57ee78ae610cabc16 HTTP/1.1" 200 None 2026-03-07 09:33:22,796 - lava_callback - ERROR - Error processing callback for node 69a94dd57ee78ae610cabc16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38368 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:36:32,542 - lava_callback - INFO - Received callback for node 69abe98e40deb775998f436b INFO: 172.19.0.1:43462 - "POST /node/69abe98e40deb775998f436b HTTP/1.0" 202 Accepted 2026-03-07 09:36:32,548 - lava_callback - INFO - Starting async job submit for node 69abe98e40deb775998f436b 2026-03-07 09:36:32,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:36:32,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98e40deb775998f436b HTTP/1.1" 200 None 2026-03-07 09:36:32,584 - lava_callback - DEBUG - Processing node 69abe98e40deb775998f436b: baseline-arm64 2026-03-07 09:36:32,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:36:33,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:36:33,006 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98e40deb775998f436b/log.txt.gz 2026-03-07 09:36:33,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:36:33,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:36:33,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98e40deb775998f436b/lava-logs.yaml 2026-03-07 09:36:33,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:36:33,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:36:33,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98e40deb775998f436b/lava_callback.json.gz 2026-03-07 09:36:33,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:36:33,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98e40deb775998f436b HTTP/1.1" 200 None 2026-03-07 09:36:33,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:36:33,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:36:33,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:36:33,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98e40deb775998f436b HTTP/1.1" 200 None 2026-03-07 09:36:33,667 - lava_callback - INFO - Completed processing callback for node 69abe98e40deb775998f436b INFO: 172.19.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57836 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:37:01,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:37:01,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46928 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:38:03,264 - lava_callback - INFO - Received callback for node 69abe99d40deb775998f4394 INFO: 172.19.0.1:57692 - "POST /node/69abe99d40deb775998f4394 HTTP/1.0" 202 Accepted 2026-03-07 09:38:03,270 - lava_callback - INFO - Starting async job submit for node 69abe99d40deb775998f4394 2026-03-07 09:38:03,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:38:03,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99d40deb775998f4394 HTTP/1.1" 200 None 2026-03-07 09:38:03,316 - lava_callback - DEBUG - Processing node 69abe99d40deb775998f4394: baseline-nfs-arm64 2026-03-07 09:38:03,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:38:03,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:38:03,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99d40deb775998f4394/log.txt.gz 2026-03-07 09:38:04,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:38:04,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:38:04,283 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99d40deb775998f4394/lava-logs.yaml 2026-03-07 09:38:04,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:38:04,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:38:04,452 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99d40deb775998f4394/lava_callback.json.gz 2026-03-07 09:38:04,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:38:04,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99d40deb775998f4394 HTTP/1.1" 200 None 2026-03-07 09:38:04,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:38:04,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:38:04,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:38:04,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99d40deb775998f4394 HTTP/1.1" 200 None 2026-03-07 09:38:04,533 - lava_callback - INFO - Completed processing callback for node 69abe99d40deb775998f4394 INFO: 172.19.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33586 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:38:31,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:38:31,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43112 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:39:23,066 - lava_callback - INFO - Received callback for node 69a94f3a7ee78ae610cabd1d INFO: 172.19.0.1:37414 - "POST /node/69a94f3a7ee78ae610cabd1d HTTP/1.0" 202 Accepted 2026-03-07 09:39:23,071 - lava_callback - INFO - Starting async job submit for node 69a94f3a7ee78ae610cabd1d 2026-03-07 09:39:23,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:39:23,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94f3a7ee78ae610cabd1d HTTP/1.1" 200 None 2026-03-07 09:39:23,088 - lava_callback - DEBUG - Processing node 69a94f3a7ee78ae610cabd1d: baseline-arm64-baylibre 2026-03-07 09:39:23,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94f3a7ee78ae610cabd1d 2026-03-07 09:39:23,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:39:23,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94f3a7ee78ae610cabd1d HTTP/1.1" 200 None 2026-03-07 09:39:23,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:39:23,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 09:39:23,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:39:23,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94f3a7ee78ae610cabd1d HTTP/1.1" 200 None 2026-03-07 09:39:23,147 - lava_callback - ERROR - Error processing callback for node 69a94f3a7ee78ae610cabd1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43330 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:43:48,870 - lava_callback - INFO - Received callback for node 69abf26f40deb775998f4909 INFO: 172.19.0.1:43342 - "POST /node/69abf26f40deb775998f4909 HTTP/1.0" 202 Accepted 2026-03-07 09:43:48,876 - lava_callback - INFO - Starting async job submit for node 69abf26f40deb775998f4909 2026-03-07 09:43:48,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:43:48,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf26f40deb775998f4909 HTTP/1.1" 200 None 2026-03-07 09:43:48,938 - lava_callback - DEBUG - Processing node 69abf26f40deb775998f4909: ltp-timers 2026-03-07 09:43:49,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:43:49,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:43:49,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69abf26f40deb775998f4909/log.txt.gz 2026-03-07 09:43:49,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:43:49,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:43:49,892 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69abf26f40deb775998f4909/lava-logs.yaml 2026-03-07 09:43:49,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:43:50,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:43:50,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69abf26f40deb775998f4909/lava_callback.json.gz 2026-03-07 09:43:50,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:43:50,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf26f40deb775998f4909 HTTP/1.1" 200 None 2026-03-07 09:43:50,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:43:50,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:43:50,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:43:50,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf26f40deb775998f4909 HTTP/1.1" 200 None 2026-03-07 09:43:50,174 - lava_callback - INFO - Completed processing callback for node 69abf26f40deb775998f4909 INFO: 172.19.0.1:32988 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:44:01,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:44:01,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33526 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:47:56,640 - lava_callback - INFO - Received callback for node 69abf20840deb775998f48dc INFO: 172.19.0.1:33528 - "POST /node/69abf20840deb775998f48dc HTTP/1.0" 202 Accepted 2026-03-07 09:47:56,647 - lava_callback - INFO - Starting async job submit for node 69abf20840deb775998f48dc 2026-03-07 09:47:56,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:47:56,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf20840deb775998f48dc HTTP/1.1" 200 None 2026-03-07 09:47:56,707 - lava_callback - DEBUG - Processing node 69abf20840deb775998f48dc: baseline-arm64 2026-03-07 09:47:57,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:47:57,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:47:57,274 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf20840deb775998f48dc/log.txt.gz 2026-03-07 09:47:57,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:47:57,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:47:57,719 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf20840deb775998f48dc/lava-logs.yaml 2026-03-07 09:47:57,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:47:57,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:47:57,914 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf20840deb775998f48dc/lava_callback.json.gz DEBUG: Setup failed for 69abf20840deb775998f48dc. Transitting job node result: incomplete -> fail 2026-03-07 09:47:57,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:47:58,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf20840deb775998f48dc HTTP/1.1" 200 None 2026-03-07 09:47:58,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:47:58,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:47:58,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:47:58,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf20840deb775998f48dc HTTP/1.1" 200 None 2026-03-07 09:47:58,131 - lava_callback - INFO - Completed processing callback for node 69abf20840deb775998f48dc 2026-03-07 09:48:01,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:01,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 09:48:01,321 - lava_callback - INFO - Received callback for node 69abf43340deb775998f49a8 INFO: 172.19.0.1:34266 - "POST /node/69abf43340deb775998f49a8 HTTP/1.0" 202 Accepted 2026-03-07 09:48:01,327 - lava_callback - INFO - Starting async job submit for node 69abf43340deb775998f49a8 2026-03-07 09:48:01,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:01,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf43340deb775998f49a8 HTTP/1.1" 200 None 2026-03-07 09:48:01,343 - lava_callback - DEBUG - Processing node 69abf43340deb775998f49a8: baseline-nfs-arm64 2026-03-07 09:48:01,344 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:48:01,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:48:01,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:48:01,492 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf43340deb775998f49a8/lava-logs.yaml 2026-03-07 09:48:01,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:48:01,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:48:01,659 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf43340deb775998f49a8/lava_callback.json.gz 2026-03-07 09:48:01,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:01,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf43340deb775998f49a8 HTTP/1.1" 200 None 2026-03-07 09:48:01,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:01,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:48:01,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:01,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf43340deb775998f49a8 HTTP/1.1" 200 None 2026-03-07 09:48:01,718 - lava_callback - INFO - Completed processing callback for node 69abf43340deb775998f49a8 INFO: 172.19.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49508 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:48:31,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:31,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:49520 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:48:39,203 - lava_callback - INFO - Received callback for node 69abf05640deb775998f4828 INFO: 172.19.0.1:49522 - "POST /node/69abf05640deb775998f4828 HTTP/1.0" 202 Accepted 2026-03-07 09:48:39,210 - lava_callback - INFO - Starting async job submit for node 69abf05640deb775998f4828 2026-03-07 09:48:39,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:39,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf05640deb775998f4828 HTTP/1.1" 200 None 2026-03-07 09:48:39,285 - lava_callback - DEBUG - Processing node 69abf05640deb775998f4828: ltp-smoke 2026-03-07 09:48:39,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:48:40,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:48:40,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf05640deb775998f4828/log.txt.gz 2026-03-07 09:48:40,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:48:40,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:48:40,480 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf05640deb775998f4828/lava-logs.yaml 2026-03-07 09:48:40,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:48:40,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:48:40,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf05640deb775998f4828/lava_callback.json.gz 2026-03-07 09:48:40,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:40,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf05640deb775998f4828 HTTP/1.1" 200 None 2026-03-07 09:48:40,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:40,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2b40deb775998f3bab HTTP/1.1" 200 None 2026-03-07 09:48:40,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:40,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf05640deb775998f4828 HTTP/1.1" 200 None 2026-03-07 09:48:40,986 - lava_callback - INFO - Completed processing callback for node 69abf05640deb775998f4828 INFO: 172.19.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42430 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:49:01,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:01,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 09:49:03,560 - lava_callback - INFO - Received callback for node 69a951887ee78ae610cabf28 INFO: 172.19.0.1:43570 - "POST /node/69a951887ee78ae610cabf28 HTTP/1.0" 202 Accepted 2026-03-07 09:49:03,566 - lava_callback - INFO - Starting async job submit for node 69a951887ee78ae610cabf28 2026-03-07 09:49:03,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:03,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a951887ee78ae610cabf28 HTTP/1.1" 200 None 2026-03-07 09:49:03,592 - lava_callback - DEBUG - Processing node 69a951887ee78ae610cabf28: baseline-arm64-baylibre 2026-03-07 09:49:03,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a951887ee78ae610cabf28 2026-03-07 09:49:03,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:03,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a951887ee78ae610cabf28 HTTP/1.1" 200 None 2026-03-07 09:49:03,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:03,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 09:49:03,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:03,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a951887ee78ae610cabf28 HTTP/1.1" 200 None 2026-03-07 09:49:03,650 - lava_callback - ERROR - Error processing callback for node 69a951887ee78ae610cabf28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47916 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:49:56,770 - lava_callback - INFO - Received callback for node 69abf09d40deb775998f4849 INFO: 172.19.0.1:47922 - "POST /node/69abf09d40deb775998f4849 HTTP/1.0" 202 Accepted 2026-03-07 09:49:56,782 - lava_callback - INFO - Starting async job submit for node 69abf09d40deb775998f4849 2026-03-07 09:49:56,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:56,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf09d40deb775998f4849 HTTP/1.1" 200 None 2026-03-07 09:49:56,856 - lava_callback - DEBUG - Processing node 69abf09d40deb775998f4849: baseline-arm 2026-03-07 09:49:57,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:49:57,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:49:57,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abf09d40deb775998f4849/log.txt.gz 2026-03-07 09:49:57,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:49:58,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:49:58,215 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abf09d40deb775998f4849/lava-logs.yaml 2026-03-07 09:49:58,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:49:58,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:49:58,391 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abf09d40deb775998f4849/lava_callback.json.gz DEBUG: Setup failed for 69abf09d40deb775998f4849. Transitting job node result: incomplete -> fail 2026-03-07 09:49:58,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:58,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf09d40deb775998f4849 HTTP/1.1" 200 None 2026-03-07 09:49:58,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:58,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:49:58,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:58,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf09d40deb775998f4849 HTTP/1.1" 200 None 2026-03-07 09:49:58,702 - lava_callback - INFO - Completed processing callback for node 69abf09d40deb775998f4849 2026-03-07 09:50:01,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:50:01,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45040 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:50:49,049 - lava_callback - INFO - Received callback for node 69abf4c040deb775998f49e2 INFO: 172.19.0.1:45042 - "POST /node/69abf4c040deb775998f49e2 HTTP/1.0" 202 Accepted 2026-03-07 09:50:49,056 - lava_callback - INFO - Starting async job submit for node 69abf4c040deb775998f49e2 2026-03-07 09:50:49,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:50:49,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf4c040deb775998f49e2 HTTP/1.1" 200 None 2026-03-07 09:50:49,111 - lava_callback - DEBUG - Processing node 69abf4c040deb775998f49e2: baseline-arm64 2026-03-07 09:50:49,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:50:49,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:50:49,392 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf4c040deb775998f49e2/log.txt.gz 2026-03-07 09:50:49,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:50:49,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:50:49,627 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf4c040deb775998f49e2/lava-logs.yaml 2026-03-07 09:50:49,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:50:49,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:50:49,774 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf4c040deb775998f49e2/lava_callback.json.gz 2026-03-07 09:50:49,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:50:49,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf4c040deb775998f49e2 HTTP/1.1" 200 None 2026-03-07 09:50:49,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:50:49,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:50:49,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:50:49,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf4c040deb775998f49e2 HTTP/1.1" 200 None 2026-03-07 09:50:49,914 - lava_callback - INFO - Completed processing callback for node 69abf4c040deb775998f49e2 INFO: 172.19.0.1:57608 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:51:01,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:51:01,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36812 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:53:29,276 - lava_callback - INFO - Received callback for node 69abf55340deb775998f4a0d INFO: 172.19.0.1:36814 - "POST /node/69abf55340deb775998f4a0d HTTP/1.0" 202 Accepted 2026-03-07 09:53:29,282 - lava_callback - INFO - Starting async job submit for node 69abf55340deb775998f4a0d 2026-03-07 09:53:29,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:53:29,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf55340deb775998f4a0d HTTP/1.1" 200 None 2026-03-07 09:53:29,326 - lava_callback - DEBUG - Processing node 69abf55340deb775998f4a0d: baseline-arm64 2026-03-07 09:53:29,461 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:53:29,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:53:29,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:53:29,750 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf55340deb775998f4a0d/lava-logs.yaml 2026-03-07 09:53:29,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:53:29,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:53:29,893 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf55340deb775998f4a0d/lava_callback.json.gz 2026-03-07 09:53:29,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:53:29,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf55340deb775998f4a0d HTTP/1.1" 200 None 2026-03-07 09:53:29,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:53:29,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:53:29,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:53:30,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf55340deb775998f4a0d HTTP/1.1" 200 None 2026-03-07 09:53:30,071 - lava_callback - INFO - Completed processing callback for node 69abf55340deb775998f4a0d 2026-03-07 09:53:31,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:53:31,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42970 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:54:33,745 - lava_callback - INFO - Received callback for node 69abf15540deb775998f4895 INFO: 172.19.0.1:49224 - "POST /node/69abf15540deb775998f4895 HTTP/1.0" 202 Accepted 2026-03-07 09:54:33,793 - lava_callback - INFO - Starting async job submit for node 69abf15540deb775998f4895 2026-03-07 09:54:33,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:54:33,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf15540deb775998f4895 HTTP/1.1" 200 None 2026-03-07 09:54:33,832 - lava_callback - DEBUG - Processing node 69abf15540deb775998f4895: baseline-arm-pengutronix 2026-03-07 09:54:33,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:54:34,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:54:34,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf15540deb775998f4895/log.txt.gz 2026-03-07 09:54:34,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:54:34,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:54:34,352 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf15540deb775998f4895/lava-logs.yaml 2026-03-07 09:54:34,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:54:34,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:54:34,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf15540deb775998f4895/lava_callback.json.gz DEBUG: Setup failed for 69abf15540deb775998f4895. Transitting job node result: incomplete -> fail 2026-03-07 09:54:34,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:54:34,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf15540deb775998f4895 HTTP/1.1" 200 None 2026-03-07 09:54:34,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:54:34,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:54:34,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:54:34,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf15540deb775998f4895 HTTP/1.1" 200 None 2026-03-07 09:54:34,648 - lava_callback - INFO - Completed processing callback for node 69abf15540deb775998f4895 INFO: 172.19.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50216 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:55:01,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:55:01,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41834 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:57:04,062 - lava_callback - INFO - Received callback for node 69a953677ee78ae610cac0f3 INFO: 172.19.0.1:44924 - "POST /node/69a953677ee78ae610cac0f3 HTTP/1.0" 202 Accepted 2026-03-07 09:57:04,068 - lava_callback - INFO - Starting async job submit for node 69a953677ee78ae610cac0f3 2026-03-07 09:57:04,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:57:04,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a953677ee78ae610cac0f3 HTTP/1.1" 200 None 2026-03-07 09:57:04,086 - lava_callback - DEBUG - Processing node 69a953677ee78ae610cac0f3: baseline-arm64-baylibre 2026-03-07 09:57:04,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a953677ee78ae610cac0f3 2026-03-07 09:57:04,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:57:04,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a953677ee78ae610cac0f3 HTTP/1.1" 200 None 2026-03-07 09:57:04,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:57:04,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 09:57:04,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:57:04,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a953677ee78ae610cac0f3 HTTP/1.1" 200 None 2026-03-07 09:57:04,155 - lava_callback - ERROR - Error processing callback for node 69a953677ee78ae610cac0f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59314 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:01:11,226 - lava_callback - INFO - Received callback for node 69abf2c240deb775998f4926 INFO: 172.19.0.1:46552 - "POST /node/69abf2c240deb775998f4926 HTTP/1.0" 202 Accepted 2026-03-07 10:01:11,234 - lava_callback - INFO - Starting async job submit for node 69abf2c240deb775998f4926 2026-03-07 10:01:11,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:11,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf2c240deb775998f4926 HTTP/1.1" 200 None 2026-03-07 10:01:11,294 - lava_callback - DEBUG - Processing node 69abf2c240deb775998f4926: baseline-nfs-arm64 2026-03-07 10:01:12,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:01:12,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:01:12,584 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf2c240deb775998f4926/log.txt.gz 2026-03-07 10:01:13,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:01:13,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:01:13,413 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf2c240deb775998f4926/lava-logs.yaml 2026-03-07 10:01:13,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:01:13,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:01:13,641 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf2c240deb775998f4926/lava_callback.json.gz DEBUG: Setup failed for 69abf2c240deb775998f4926. Transitting job node result: incomplete -> fail 2026-03-07 10:01:13,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:13,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf2c240deb775998f4926 HTTP/1.1" 200 None 2026-03-07 10:01:13,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:13,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:01:13,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:13,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf2c240deb775998f4926 HTTP/1.1" 200 None 2026-03-07 10:01:13,915 - lava_callback - INFO - Completed processing callback for node 69abf2c240deb775998f4926 INFO: 172.19.0.1:46568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46574 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:01:21,864 - lava_callback - INFO - Received callback for node 69abf75a40deb775998f4a91 INFO: 172.19.0.1:41156 - "POST /node/69abf75a40deb775998f4a91 HTTP/1.0" 202 Accepted 2026-03-07 10:01:21,870 - lava_callback - INFO - Starting async job submit for node 69abf75a40deb775998f4a91 2026-03-07 10:01:21,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:21,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf75a40deb775998f4a91 HTTP/1.1" 200 None 2026-03-07 10:01:21,892 - lava_callback - DEBUG - Processing node 69abf75a40deb775998f4a91: baseline-nfs-arm64 2026-03-07 10:01:21,893 - lava_callback - WARNING - Failed to upload log 2026-03-07 10:01:21,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:01:22,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:01:22,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf75a40deb775998f4a91/lava-logs.yaml 2026-03-07 10:01:22,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:01:22,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:01:22,196 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf75a40deb775998f4a91/lava_callback.json.gz 2026-03-07 10:01:22,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:22,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf75a40deb775998f4a91 HTTP/1.1" 200 None 2026-03-07 10:01:22,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:22,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:01:22,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:22,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf75a40deb775998f4a91 HTTP/1.1" 200 None 2026-03-07 10:01:22,259 - lava_callback - INFO - Completed processing callback for node 69abf75a40deb775998f4a91 INFO: 172.19.0.1:41164 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:01:31,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:31,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49018 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:04:54,378 - lava_callback - INFO - Received callback for node 69abf80c40deb775998f4adb INFO: 172.19.0.1:46514 - "POST /node/69abf80c40deb775998f4adb HTTP/1.0" 202 Accepted 2026-03-07 10:04:54,385 - lava_callback - INFO - Starting async job submit for node 69abf80c40deb775998f4adb 2026-03-07 10:04:54,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:04:54,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf80c40deb775998f4adb HTTP/1.1" 200 None 2026-03-07 10:04:54,438 - lava_callback - DEBUG - Processing node 69abf80c40deb775998f4adb: baseline-arm64 2026-03-07 10:04:54,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:04:54,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:04:54,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf80c40deb775998f4adb/log.txt.gz 2026-03-07 10:04:54,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:04:55,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:04:55,036 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf80c40deb775998f4adb/lava-logs.yaml 2026-03-07 10:04:55,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:04:55,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:04:55,191 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf80c40deb775998f4adb/lava_callback.json.gz 2026-03-07 10:04:55,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:04:55,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf80c40deb775998f4adb HTTP/1.1" 200 None 2026-03-07 10:04:55,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:04:55,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:04:55,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:04:55,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf80c40deb775998f4adb HTTP/1.1" 200 None 2026-03-07 10:04:55,351 - lava_callback - INFO - Completed processing callback for node 69abf80c40deb775998f4adb INFO: 172.19.0.1:46520 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:05:01,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:05:01,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43756 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:06:29,776 - lava_callback - INFO - Received callback for node 69abf85740deb775998f4af4 INFO: 172.19.0.1:33770 - "POST /node/69abf85740deb775998f4af4 HTTP/1.0" 202 Accepted 2026-03-07 10:06:29,786 - lava_callback - INFO - Starting async job submit for node 69abf85740deb775998f4af4 2026-03-07 10:06:29,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:06:29,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf85740deb775998f4af4 HTTP/1.1" 200 None 2026-03-07 10:06:29,836 - lava_callback - DEBUG - Processing node 69abf85740deb775998f4af4: baseline-arm64 2026-03-07 10:06:29,975 - lava_callback - WARNING - Failed to upload log 2026-03-07 10:06:30,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:06:30,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:06:30,260 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf85740deb775998f4af4/lava-logs.yaml 2026-03-07 10:06:30,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:06:30,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:06:30,415 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf85740deb775998f4af4/lava_callback.json.gz 2026-03-07 10:06:30,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:06:30,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf85740deb775998f4af4 HTTP/1.1" 200 None 2026-03-07 10:06:30,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:06:30,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:06:30,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:06:30,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf85740deb775998f4af4 HTTP/1.1" 200 None 2026-03-07 10:06:30,580 - lava_callback - INFO - Completed processing callback for node 69abf85740deb775998f4af4 2026-03-07 10:06:31,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:06:31,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59782 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:07:08,796 - lava_callback - INFO - Received callback for node 69abf70e40deb775998f4a82 INFO: 172.19.0.1:59796 - "POST /node/69abf70e40deb775998f4a82 HTTP/1.0" 202 Accepted 2026-03-07 10:07:08,803 - lava_callback - INFO - Starting async job submit for node 69abf70e40deb775998f4a82 2026-03-07 10:07:08,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:07:08,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf70e40deb775998f4a82 HTTP/1.1" 200 None 2026-03-07 10:07:08,864 - lava_callback - DEBUG - Processing node 69abf70e40deb775998f4a82: baseline-arm64 2026-03-07 10:07:09,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:07:09,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:07:09,433 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf70e40deb775998f4a82/log.txt.gz 2026-03-07 10:07:09,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:07:09,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:07:09,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf70e40deb775998f4a82/lava-logs.yaml 2026-03-07 10:07:09,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:07:10,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:07:10,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf70e40deb775998f4a82/lava_callback.json.gz DEBUG: Setup failed for 69abf70e40deb775998f4a82. Transitting job node result: incomplete -> fail 2026-03-07 10:07:10,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:07:10,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf70e40deb775998f4a82 HTTP/1.1" 200 None 2026-03-07 10:07:10,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:07:10,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:07:10,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:07:10,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf70e40deb775998f4a82 HTTP/1.1" 200 None 2026-03-07 10:07:10,360 - lava_callback - INFO - Completed processing callback for node 69abf70e40deb775998f4a82 INFO: 172.19.0.1:54392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42256 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:07:31,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:07:31,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44866 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:13:47,872 - lava_callback - INFO - Received callback for node 69abf91940deb775998f4b39 INFO: 172.19.0.1:44868 - "POST /node/69abf91940deb775998f4b39 HTTP/1.0" 202 Accepted 2026-03-07 10:13:47,879 - lava_callback - INFO - Starting async job submit for node 69abf91940deb775998f4b39 2026-03-07 10:13:47,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:13:47,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf91940deb775998f4b39 HTTP/1.1" 200 None 2026-03-07 10:13:47,942 - lava_callback - DEBUG - Processing node 69abf91940deb775998f4b39: baseline-arm64 2026-03-07 10:13:48,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:13:48,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:13:48,476 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf91940deb775998f4b39/log.txt.gz 2026-03-07 10:13:48,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:13:48,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:13:48,940 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf91940deb775998f4b39/lava-logs.yaml 2026-03-07 10:13:48,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:13:49,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:13:49,134 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf91940deb775998f4b39/lava_callback.json.gz DEBUG: Setup failed for 69abf91940deb775998f4b39. Transitting job node result: incomplete -> fail 2026-03-07 10:13:49,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:13:49,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf91940deb775998f4b39 HTTP/1.1" 200 None 2026-03-07 10:13:49,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:13:49,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:13:49,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:13:49,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf91940deb775998f4b39 HTTP/1.1" 200 None 2026-03-07 10:13:49,369 - lava_callback - INFO - Completed processing callback for node 69abf91940deb775998f4b39 INFO: 172.19.0.1:42358 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:14:01,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:14:01,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58048 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:19:42,525 - lava_callback - INFO - Received callback for node 69abf79c40deb775998f4aaf INFO: 172.19.0.1:37982 - "POST /node/69abf79c40deb775998f4aaf HTTP/1.0" 202 Accepted 2026-03-07 10:19:42,531 - lava_callback - INFO - Starting async job submit for node 69abf79c40deb775998f4aaf 2026-03-07 10:19:42,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:19:42,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf79c40deb775998f4aaf HTTP/1.1" 200 None 2026-03-07 10:19:42,622 - lava_callback - DEBUG - Processing node 69abf79c40deb775998f4aaf: ltp-smoke 2026-03-07 10:19:43,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:19:43,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:19:43,274 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf79c40deb775998f4aaf/log.txt.gz 2026-03-07 10:19:43,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:19:43,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:19:43,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf79c40deb775998f4aaf/lava-logs.yaml 2026-03-07 10:19:43,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:19:44,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:19:44,003 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf79c40deb775998f4aaf/lava_callback.json.gz 2026-03-07 10:19:44,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:19:44,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf79c40deb775998f4aaf HTTP/1.1" 200 None 2026-03-07 10:19:44,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:19:44,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2b40deb775998f3bab HTTP/1.1" 200 None 2026-03-07 10:19:44,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:19:44,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf79c40deb775998f4aaf HTTP/1.1" 200 None 2026-03-07 10:19:44,313 - lava_callback - INFO - Completed processing callback for node 69abf79c40deb775998f4aaf INFO: 172.19.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51630 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:20:01,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:20:01,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42910 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:20:54,018 - lava_callback - INFO - Received callback for node 69abf7e840deb775998f4ac9 INFO: 172.19.0.1:39372 - "POST /node/69abf7e840deb775998f4ac9 HTTP/1.0" 202 Accepted 2026-03-07 10:20:54,025 - lava_callback - INFO - Starting async job submit for node 69abf7e840deb775998f4ac9 2026-03-07 10:20:54,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:20:54,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf7e840deb775998f4ac9 HTTP/1.1" 200 None 2026-03-07 10:20:54,120 - lava_callback - DEBUG - Processing node 69abf7e840deb775998f4ac9: baseline-arm 2026-03-07 10:20:54,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:20:54,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:20:54,886 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abf7e840deb775998f4ac9/log.txt.gz 2026-03-07 10:20:55,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:39378 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:21:00,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:21:00,164 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abf7e840deb775998f4ac9/lava-logs.yaml 2026-03-07 10:21:00,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:21:00,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:21:00,375 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abf7e840deb775998f4ac9/lava_callback.json.gz DEBUG: Setup failed for 69abf7e840deb775998f4ac9. Transitting job node result: incomplete -> fail 2026-03-07 10:21:00,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:21:00,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf7e840deb775998f4ac9 HTTP/1.1" 200 None 2026-03-07 10:21:00,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:21:00,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 10:21:00,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:21:00,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf7e840deb775998f4ac9 HTTP/1.1" 200 None 2026-03-07 10:21:00,650 - lava_callback - INFO - Completed processing callback for node 69abf7e840deb775998f4ac9 2026-03-07 10:21:01,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:21:01,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47054 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:23:25,436 - lava_callback - INFO - Received callback for node 69a959897ee78ae610cac5ce INFO: 172.19.0.1:36566 - "POST /node/69a959897ee78ae610cac5ce HTTP/1.0" 202 Accepted 2026-03-07 10:23:25,442 - lava_callback - INFO - Starting async job submit for node 69a959897ee78ae610cac5ce 2026-03-07 10:23:25,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:23:25,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a959897ee78ae610cac5ce HTTP/1.1" 200 None 2026-03-07 10:23:25,463 - lava_callback - DEBUG - Processing node 69a959897ee78ae610cac5ce: baseline-arm-baylibre 2026-03-07 10:23:25,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a959897ee78ae610cac5ce 2026-03-07 10:23:25,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:23:25,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a959897ee78ae610cac5ce HTTP/1.1" 200 None 2026-03-07 10:23:25,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:23:25,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:23:25,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:23:25,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a959897ee78ae610cac5ce HTTP/1.1" 200 None 2026-03-07 10:23:25,530 - lava_callback - ERROR - Error processing callback for node 69a959897ee78ae610cac5ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42516 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:25:54,811 - lava_callback - INFO - Received callback for node 69abf8aa40deb775998f4b12 INFO: 172.19.0.1:33408 - "POST /node/69abf8aa40deb775998f4b12 HTTP/1.0" 202 Accepted 2026-03-07 10:25:54,857 - lava_callback - INFO - Starting async job submit for node 69abf8aa40deb775998f4b12 2026-03-07 10:25:54,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:25:54,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf8aa40deb775998f4b12 HTTP/1.1" 200 None 2026-03-07 10:25:54,897 - lava_callback - DEBUG - Processing node 69abf8aa40deb775998f4b12: baseline-arm-pengutronix 2026-03-07 10:25:55,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:25:55,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:25:55,165 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf8aa40deb775998f4b12/log.txt.gz 2026-03-07 10:25:55,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:25:55,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:25:55,423 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf8aa40deb775998f4b12/lava-logs.yaml 2026-03-07 10:25:55,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:25:55,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:25:55,588 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf8aa40deb775998f4b12/lava_callback.json.gz DEBUG: Setup failed for 69abf8aa40deb775998f4b12. Transitting job node result: incomplete -> fail 2026-03-07 10:25:55,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:25:55,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf8aa40deb775998f4b12 HTTP/1.1" 200 None 2026-03-07 10:25:55,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:25:55,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 10:25:55,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:25:55,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf8aa40deb775998f4b12 HTTP/1.1" 200 None 2026-03-07 10:25:55,744 - lava_callback - INFO - Completed processing callback for node 69abf8aa40deb775998f4b12 INFO: 172.19.0.1:33410 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:26:01,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:26:01,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54556 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:27:01,551 - lava_callback - INFO - Received callback for node 69abf8cb40deb775998f4b21 INFO: 172.19.0.1:45362 - "POST /node/69abf8cb40deb775998f4b21 HTTP/1.0" 202 Accepted 2026-03-07 10:27:01,558 - lava_callback - INFO - Starting async job submit for node 69abf8cb40deb775998f4b21 2026-03-07 10:27:01,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:27:01,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf8cb40deb775998f4b21 HTTP/1.1" 200 None 2026-03-07 10:27:01,625 - lava_callback - DEBUG - Processing node 69abf8cb40deb775998f4b21: baseline-nfs-arm64 2026-03-07 10:27:02,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:27:02,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:27:02,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf8cb40deb775998f4b21/log.txt.gz 2026-03-07 10:27:03,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:27:03,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:27:03,724 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf8cb40deb775998f4b21/lava-logs.yaml 2026-03-07 10:27:03,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:27:03,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:27:03,943 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf8cb40deb775998f4b21/lava_callback.json.gz DEBUG: Setup failed for 69abf8cb40deb775998f4b21. Transitting job node result: incomplete -> fail 2026-03-07 10:27:04,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:27:04,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf8cb40deb775998f4b21 HTTP/1.1" 200 None 2026-03-07 10:27:04,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:27:04,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:27:04,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:27:04,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf8cb40deb775998f4b21 HTTP/1.1" 200 None 2026-03-07 10:27:04,175 - lava_callback - INFO - Completed processing callback for node 69abf8cb40deb775998f4b21 INFO: 172.19.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38458 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:27:31,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:27:31,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42018 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:29:45,740 - lava_callback - INFO - Received callback for node 69a95b177ee78ae610cac755 INFO: 172.19.0.1:57074 - "POST /node/69a95b177ee78ae610cac755 HTTP/1.0" 202 Accepted 2026-03-07 10:29:45,749 - lava_callback - INFO - Starting async job submit for node 69a95b177ee78ae610cac755 2026-03-07 10:29:45,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:29:45,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95b177ee78ae610cac755 HTTP/1.1" 200 None 2026-03-07 10:29:45,776 - lava_callback - DEBUG - Processing node 69a95b177ee78ae610cac755: baseline-arm-baylibre 2026-03-07 10:29:45,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a95b177ee78ae610cac755 2026-03-07 10:29:45,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:29:45,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95b177ee78ae610cac755 HTTP/1.1" 200 None 2026-03-07 10:29:45,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:29:45,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:29:45,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:29:45,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a95b177ee78ae610cac755 HTTP/1.1" 200 None 2026-03-07 10:29:45,851 - lava_callback - ERROR - Error processing callback for node 69a95b177ee78ae610cac755: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55500 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:55502 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.19.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55524 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.19.0.1:51536 - "GET /config.json HTTP/1.0" 404 Not Found INFO: 172.19.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59476 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:33:05,908 - lava_callback - INFO - Received callback for node 69a95bd07ee78ae610cac831 INFO: 172.19.0.1:52746 - "POST /node/69a95bd07ee78ae610cac831 HTTP/1.0" 202 Accepted 2026-03-07 10:33:05,914 - lava_callback - INFO - Starting async job submit for node 69a95bd07ee78ae610cac831 2026-03-07 10:33:05,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:05,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95bd07ee78ae610cac831 HTTP/1.1" 200 None 2026-03-07 10:33:05,930 - lava_callback - DEBUG - Processing node 69a95bd07ee78ae610cac831: baseline-arm-baylibre 2026-03-07 10:33:05,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a95bd07ee78ae610cac831 2026-03-07 10:33:05,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:05,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95bd07ee78ae610cac831 HTTP/1.1" 200 None 2026-03-07 10:33:05,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:05,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:33:05,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:05,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a95bd07ee78ae610cac831 HTTP/1.1" 200 None 2026-03-07 10:33:05,982 - lava_callback - ERROR - Error processing callback for node 69a95bd07ee78ae610cac831: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49338 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:33:45,931 - lava_callback - INFO - Received callback for node 69a95bfd7ee78ae610cac84d INFO: 172.19.0.1:59954 - "POST /node/69a95bfd7ee78ae610cac84d HTTP/1.0" 202 Accepted 2026-03-07 10:33:45,937 - lava_callback - INFO - Starting async job submit for node 69a95bfd7ee78ae610cac84d 2026-03-07 10:33:45,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:45,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95bfd7ee78ae610cac84d HTTP/1.1" 200 None 2026-03-07 10:33:45,952 - lava_callback - DEBUG - Processing node 69a95bfd7ee78ae610cac84d: baseline-arm-baylibre 2026-03-07 10:33:45,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a95bfd7ee78ae610cac84d 2026-03-07 10:33:45,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:45,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95bfd7ee78ae610cac84d HTTP/1.1" 200 None 2026-03-07 10:33:45,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:45,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:33:45,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:46,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a95bfd7ee78ae610cac84d HTTP/1.1" 200 None 2026-03-07 10:33:46,013 - lava_callback - ERROR - Error processing callback for node 69a95bfd7ee78ae610cac84d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45574 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:36:06,197 - lava_callback - INFO - Received callback for node 69a95c817ee78ae610cac8f1 INFO: 172.19.0.1:35814 - "POST /node/69a95c817ee78ae610cac8f1 HTTP/1.0" 202 Accepted 2026-03-07 10:36:06,203 - lava_callback - INFO - Starting async job submit for node 69a95c817ee78ae610cac8f1 2026-03-07 10:36:06,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:36:06,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95c817ee78ae610cac8f1 HTTP/1.1" 200 None 2026-03-07 10:36:06,220 - lava_callback - DEBUG - Processing node 69a95c817ee78ae610cac8f1: baseline-arm-baylibre 2026-03-07 10:36:06,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a95c817ee78ae610cac8f1 2026-03-07 10:36:06,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:36:06,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95c817ee78ae610cac8f1 HTTP/1.1" 200 None 2026-03-07 10:36:06,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:36:06,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:36:06,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:36:06,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a95c817ee78ae610cac8f1 HTTP/1.1" 200 None 2026-03-07 10:36:06,314 - lava_callback - ERROR - Error processing callback for node 69a95c817ee78ae610cac8f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47250 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:37:01,025 - lava_callback - INFO - Received callback for node 69abfbc140deb775998f4bcb INFO: 172.19.0.1:50742 - "POST /node/69abfbc140deb775998f4bcb HTTP/1.0" 202 Accepted 2026-03-07 10:37:01,033 - lava_callback - INFO - Starting async job submit for node 69abfbc140deb775998f4bcb 2026-03-07 10:37:01,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:37:01,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfbc140deb775998f4bcb HTTP/1.1" 200 None 2026-03-07 10:37:01,109 - lava_callback - DEBUG - Processing node 69abfbc140deb775998f4bcb: ltp-smoke 2026-03-07 10:37:01,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:37:01,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:37:01,768 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69abfbc140deb775998f4bcb/log.txt.gz 2026-03-07 10:37:02,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:37:02,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:37:02,306 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69abfbc140deb775998f4bcb/lava-logs.yaml 2026-03-07 10:37:02,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:37:02,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:37:02,501 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69abfbc140deb775998f4bcb/lava_callback.json.gz 2026-03-07 10:37:02,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:37:02,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfbc140deb775998f4bcb HTTP/1.1" 200 None 2026-03-07 10:37:02,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:37:02,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2b40deb775998f3bab HTTP/1.1" 200 None 2026-03-07 10:37:02,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:37:02,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abfbc140deb775998f4bcb HTTP/1.1" 200 None 2026-03-07 10:37:02,828 - lava_callback - INFO - Completed processing callback for node 69abfbc140deb775998f4bcb INFO: 172.19.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38096 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:37:31,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:37:31,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39374 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:38:06,157 - lava_callback - INFO - Received callback for node 69a95d077ee78ae610cac986 INFO: 172.19.0.1:39474 - "POST /node/69a95d077ee78ae610cac986 HTTP/1.0" 202 Accepted 2026-03-07 10:38:06,162 - lava_callback - INFO - Starting async job submit for node 69a95d077ee78ae610cac986 2026-03-07 10:38:06,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:06,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95d077ee78ae610cac986 HTTP/1.1" 200 None 2026-03-07 10:38:06,178 - lava_callback - DEBUG - Processing node 69a95d077ee78ae610cac986: baseline-arm-baylibre 2026-03-07 10:38:06,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a95d077ee78ae610cac986 2026-03-07 10:38:06,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:06,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95d077ee78ae610cac986 HTTP/1.1" 200 None 2026-03-07 10:38:06,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:06,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:38:06,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:06,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a95d077ee78ae610cac986 HTTP/1.1" 200 None 2026-03-07 10:38:06,240 - lava_callback - ERROR - Error processing callback for node 69a95d077ee78ae610cac986: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34838 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:38:55,701 - lava_callback - INFO - Received callback for node 69abfc0d40deb775998f4bea INFO: 172.19.0.1:60916 - "POST /node/69abfc0d40deb775998f4bea HTTP/1.0" 202 Accepted 2026-03-07 10:38:55,708 - lava_callback - INFO - Starting async job submit for node 69abfc0d40deb775998f4bea 2026-03-07 10:38:55,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:55,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfc0d40deb775998f4bea HTTP/1.1" 200 None 2026-03-07 10:38:55,778 - lava_callback - DEBUG - Processing node 69abfc0d40deb775998f4bea: baseline-arm 2026-03-07 10:38:56,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:60918 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:38:56,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:38:56,552 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abfc0d40deb775998f4bea/log.txt.gz 2026-03-07 10:38:56,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:38:57,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:38:57,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abfc0d40deb775998f4bea/lava-logs.yaml 2026-03-07 10:38:57,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:38:57,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:38:57,360 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abfc0d40deb775998f4bea/lava_callback.json.gz DEBUG: Setup failed for 69abfc0d40deb775998f4bea. Transitting job node result: incomplete -> fail 2026-03-07 10:38:57,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:57,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfc0d40deb775998f4bea HTTP/1.1" 200 None 2026-03-07 10:38:57,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:57,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 10:38:57,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:57,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abfc0d40deb775998f4bea HTTP/1.1" 200 None 2026-03-07 10:38:57,628 - lava_callback - INFO - Completed processing callback for node 69abfc0d40deb775998f4bea 2026-03-07 10:39:01,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:39:01,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:40632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45430 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:45:35,816 - lava_callback - INFO - Received callback for node 69abfd4040deb775998f4c3b INFO: 172.19.0.1:60248 - "POST /node/69abfd4040deb775998f4c3b HTTP/1.0" 202 Accepted 2026-03-07 10:45:35,865 - lava_callback - INFO - Starting async job submit for node 69abfd4040deb775998f4c3b 2026-03-07 10:45:35,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:45:35,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfd4040deb775998f4c3b HTTP/1.1" 200 None 2026-03-07 10:45:35,904 - lava_callback - DEBUG - Processing node 69abfd4040deb775998f4c3b: baseline-arm-pengutronix 2026-03-07 10:45:36,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:45:36,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:45:36,190 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abfd4040deb775998f4c3b/log.txt.gz 2026-03-07 10:45:36,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:60258 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:45:36,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:45:36,558 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abfd4040deb775998f4c3b/lava-logs.yaml 2026-03-07 10:45:36,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:45:36,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:45:36,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abfd4040deb775998f4c3b/lava_callback.json.gz DEBUG: Setup failed for 69abfd4040deb775998f4c3b. Transitting job node result: incomplete -> fail 2026-03-07 10:45:36,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:45:36,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfd4040deb775998f4c3b HTTP/1.1" 200 None 2026-03-07 10:45:36,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:45:36,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 10:45:36,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:45:36,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abfd4040deb775998f4c3b HTTP/1.1" 200 None 2026-03-07 10:45:36,865 - lava_callback - INFO - Completed processing callback for node 69abfd4040deb775998f4c3b INFO: 172.19.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56068 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:46:01,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:46:01,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33986 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:47:20,861 - lava_callback - INFO - Received callback for node 69abfd8040deb775998f4c58 INFO: 172.19.0.1:36696 - "POST /node/69abfd8040deb775998f4c58 HTTP/1.0" 202 Accepted 2026-03-07 10:47:20,869 - lava_callback - INFO - Starting async job submit for node 69abfd8040deb775998f4c58 2026-03-07 10:47:20,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:47:20,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfd8040deb775998f4c58 HTTP/1.1" 200 None 2026-03-07 10:47:20,927 - lava_callback - DEBUG - Processing node 69abfd8040deb775998f4c58: baseline-nfs-arm64 2026-03-07 10:47:21,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:47:22,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:47:22,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abfd8040deb775998f4c58/log.txt.gz 2026-03-07 10:47:22,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:47:23,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:47:23,019 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abfd8040deb775998f4c58/lava-logs.yaml 2026-03-07 10:47:23,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:47:23,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:47:23,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abfd8040deb775998f4c58/lava_callback.json.gz DEBUG: Setup failed for 69abfd8040deb775998f4c58. Transitting job node result: incomplete -> fail 2026-03-07 10:47:23,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:47:23,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfd8040deb775998f4c58 HTTP/1.1" 200 None 2026-03-07 10:47:23,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:47:23,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:47:23,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:47:23,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abfd8040deb775998f4c58 HTTP/1.1" 200 None 2026-03-07 10:47:23,496 - lava_callback - INFO - Completed processing callback for node 69abfd8040deb775998f4c58 INFO: 172.19.0.1:36700 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:47:31,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:47:31,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48922 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:48924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56602 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:14:48,215 - lava_callback - INFO - Received callback for node 69a965a27ee78ae610cad0ef INFO: 172.19.0.1:56618 - "POST /node/69a965a27ee78ae610cad0ef HTTP/1.0" 202 Accepted 2026-03-07 11:14:48,220 - lava_callback - INFO - Starting async job submit for node 69a965a27ee78ae610cad0ef 2026-03-07 11:14:48,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:14:48,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a965a27ee78ae610cad0ef HTTP/1.1" 200 None 2026-03-07 11:14:48,238 - lava_callback - DEBUG - Processing node 69a965a27ee78ae610cad0ef: baseline-arm-baylibre 2026-03-07 11:14:48,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a965a27ee78ae610cad0ef 2026-03-07 11:14:48,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:14:48,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a965a27ee78ae610cad0ef HTTP/1.1" 200 None 2026-03-07 11:14:48,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:14:48,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:14:48,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:14:48,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a965a27ee78ae610cad0ef HTTP/1.1" 200 None 2026-03-07 11:14:48,291 - lava_callback - ERROR - Error processing callback for node 69a965a27ee78ae610cad0ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50174 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:17:08,277 - lava_callback - INFO - Received callback for node 69a966237ee78ae610cad15c INFO: 172.19.0.1:50188 - "POST /node/69a966237ee78ae610cad15c HTTP/1.0" 202 Accepted 2026-03-07 11:17:08,283 - lava_callback - INFO - Starting async job submit for node 69a966237ee78ae610cad15c 2026-03-07 11:17:08,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:08,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a966237ee78ae610cad15c HTTP/1.1" 200 None 2026-03-07 11:17:08,302 - lava_callback - DEBUG - Processing node 69a966237ee78ae610cad15c: baseline-arm-baylibre 2026-03-07 11:17:08,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a966237ee78ae610cad15c 2026-03-07 11:17:08,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:08,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a966237ee78ae610cad15c HTTP/1.1" 200 None 2026-03-07 11:17:08,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:08,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:17:08,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:08,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a966237ee78ae610cad15c HTTP/1.1" 200 None 2026-03-07 11:17:08,367 - lava_callback - ERROR - Error processing callback for node 69a966237ee78ae610cad15c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50816 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:17:48,300 - lava_callback - INFO - Received callback for node 69a966507ee78ae610cad174 INFO: 172.19.0.1:50824 - "POST /node/69a966507ee78ae610cad174 HTTP/1.0" 202 Accepted 2026-03-07 11:17:48,306 - lava_callback - INFO - Starting async job submit for node 69a966507ee78ae610cad174 2026-03-07 11:17:48,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:48,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a966507ee78ae610cad174 HTTP/1.1" 200 None 2026-03-07 11:17:48,352 - lava_callback - DEBUG - Processing node 69a966507ee78ae610cad174: baseline-arm-baylibre 2026-03-07 11:17:48,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a966507ee78ae610cad174 2026-03-07 11:17:48,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:48,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a966507ee78ae610cad174 HTTP/1.1" 200 None 2026-03-07 11:17:48,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:48,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:17:48,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:48,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a966507ee78ae610cad174 HTTP/1.1" 200 None 2026-03-07 11:17:48,412 - lava_callback - ERROR - Error processing callback for node 69a966507ee78ae610cad174: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58264 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:18:28,339 - lava_callback - INFO - Received callback for node 69a9667d7ee78ae610cad1c7 INFO: 172.19.0.1:58272 - "POST /node/69a9667d7ee78ae610cad1c7 HTTP/1.0" 202 Accepted 2026-03-07 11:18:28,345 - lava_callback - INFO - Starting async job submit for node 69a9667d7ee78ae610cad1c7 2026-03-07 11:18:28,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:18:28,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9667d7ee78ae610cad1c7 HTTP/1.1" 200 None 2026-03-07 11:18:28,361 - lava_callback - DEBUG - Processing node 69a9667d7ee78ae610cad1c7: baseline-arm-baylibre 2026-03-07 11:18:28,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9667d7ee78ae610cad1c7 2026-03-07 11:18:28,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:18:28,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9667d7ee78ae610cad1c7 HTTP/1.1" 200 None 2026-03-07 11:18:28,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:18:28,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:18:28,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:18:28,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9667d7ee78ae610cad1c7 HTTP/1.1" 200 None 2026-03-07 11:18:28,419 - lava_callback - ERROR - Error processing callback for node 69a9667d7ee78ae610cad1c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60012 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:20:48,517 - lava_callback - INFO - Received callback for node 69a967007ee78ae610cad23e INFO: 172.19.0.1:60018 - "POST /node/69a967007ee78ae610cad23e HTTP/1.0" 202 Accepted 2026-03-07 11:20:48,522 - lava_callback - INFO - Starting async job submit for node 69a967007ee78ae610cad23e 2026-03-07 11:20:48,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:20:48,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a967007ee78ae610cad23e HTTP/1.1" 200 None 2026-03-07 11:20:48,540 - lava_callback - DEBUG - Processing node 69a967007ee78ae610cad23e: baseline-arm-baylibre 2026-03-07 11:20:48,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a967007ee78ae610cad23e 2026-03-07 11:20:48,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:20:48,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a967007ee78ae610cad23e HTTP/1.1" 200 None 2026-03-07 11:20:48,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:20:48,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:20:48,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:20:48,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a967007ee78ae610cad23e HTTP/1.1" 200 None 2026-03-07 11:20:48,592 - lava_callback - ERROR - Error processing callback for node 69a967007ee78ae610cad23e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51896 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:21:28,506 - lava_callback - INFO - Received callback for node 69a9672d7ee78ae610cad285 INFO: 172.19.0.1:51898 - "POST /node/69a9672d7ee78ae610cad285 HTTP/1.0" 202 Accepted 2026-03-07 11:21:28,512 - lava_callback - INFO - Starting async job submit for node 69a9672d7ee78ae610cad285 2026-03-07 11:21:28,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:21:28,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9672d7ee78ae610cad285 HTTP/1.1" 200 None 2026-03-07 11:21:28,529 - lava_callback - DEBUG - Processing node 69a9672d7ee78ae610cad285: baseline-arm-baylibre 2026-03-07 11:21:28,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9672d7ee78ae610cad285 2026-03-07 11:21:28,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:21:28,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9672d7ee78ae610cad285 HTTP/1.1" 200 None 2026-03-07 11:21:28,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:21:28,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:21:28,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:21:28,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9672d7ee78ae610cad285 HTTP/1.1" 200 None 2026-03-07 11:21:28,584 - lava_callback - ERROR - Error processing callback for node 69a9672d7ee78ae610cad285: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40184 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:23:48,696 - lava_callback - INFO - Received callback for node 69a967ba7ee78ae610cad308 INFO: 172.19.0.1:40198 - "POST /node/69a967ba7ee78ae610cad308 HTTP/1.0" 202 Accepted 2026-03-07 11:23:48,702 - lava_callback - INFO - Starting async job submit for node 69a967ba7ee78ae610cad308 2026-03-07 11:23:48,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:23:48,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a967ba7ee78ae610cad308 HTTP/1.1" 200 None 2026-03-07 11:23:48,728 - lava_callback - DEBUG - Processing node 69a967ba7ee78ae610cad308: baseline-arm64-baylibre 2026-03-07 11:23:48,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a967ba7ee78ae610cad308 2026-03-07 11:23:48,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:23:48,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a967ba7ee78ae610cad308 HTTP/1.1" 200 None 2026-03-07 11:23:48,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:23:48,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85aff440c1da21c2371fe HTTP/1.1" 200 None 2026-03-07 11:23:48,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:23:48,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a967ba7ee78ae610cad308 HTTP/1.1" 200 None 2026-03-07 11:23:48,782 - lava_callback - ERROR - Error processing callback for node 69a967ba7ee78ae610cad308: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37738 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:30:29,003 - lava_callback - INFO - Received callback for node 69a9694a7ee78ae610cad428 INFO: 172.19.0.1:37742 - "POST /node/69a9694a7ee78ae610cad428 HTTP/1.0" 202 Accepted 2026-03-07 11:30:29,009 - lava_callback - INFO - Starting async job submit for node 69a9694a7ee78ae610cad428 2026-03-07 11:30:29,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:30:29,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9694a7ee78ae610cad428 HTTP/1.1" 200 None 2026-03-07 11:30:29,057 - lava_callback - DEBUG - Processing node 69a9694a7ee78ae610cad428: baseline-arm64-baylibre 2026-03-07 11:30:29,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9694a7ee78ae610cad428 2026-03-07 11:30:29,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:30:29,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9694a7ee78ae610cad428 HTTP/1.1" 200 None 2026-03-07 11:30:29,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:30:29,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:30:29,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:30:29,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9694a7ee78ae610cad428 HTTP/1.1" 200 None 2026-03-07 11:30:29,123 - lava_callback - ERROR - Error processing callback for node 69a9694a7ee78ae610cad428: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51036 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:39:29,476 - lava_callback - INFO - Received callback for node 69a96b637ee78ae610cad5a9 INFO: 172.19.0.1:51044 - "POST /node/69a96b637ee78ae610cad5a9 HTTP/1.0" 202 Accepted 2026-03-07 11:39:29,482 - lava_callback - INFO - Starting async job submit for node 69a96b637ee78ae610cad5a9 2026-03-07 11:39:29,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:39:29,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96b637ee78ae610cad5a9 HTTP/1.1" 200 None 2026-03-07 11:39:29,516 - lava_callback - DEBUG - Processing node 69a96b637ee78ae610cad5a9: baseline-arm64-baylibre 2026-03-07 11:39:29,516 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a96b637ee78ae610cad5a9 2026-03-07 11:39:29,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:39:29,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96b637ee78ae610cad5a9 HTTP/1.1" 200 None 2026-03-07 11:39:29,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:39:29,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:39:29,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:39:29,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a96b637ee78ae610cad5a9 HTTP/1.1" 200 None 2026-03-07 11:39:29,573 - lava_callback - ERROR - Error processing callback for node 69a96b637ee78ae610cad5a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46638 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:45:09,884 - lava_callback - INFO - Received callback for node 69a96cbc7ee78ae610cad6b2 INFO: 172.19.0.1:39646 - "POST /node/69a96cbc7ee78ae610cad6b2 HTTP/1.0" 202 Accepted 2026-03-07 11:45:09,889 - lava_callback - INFO - Starting async job submit for node 69a96cbc7ee78ae610cad6b2 2026-03-07 11:45:09,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:45:09,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96cbc7ee78ae610cad6b2 HTTP/1.1" 200 None 2026-03-07 11:45:09,905 - lava_callback - DEBUG - Processing node 69a96cbc7ee78ae610cad6b2: baseline-arm64-baylibre 2026-03-07 11:45:09,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a96cbc7ee78ae610cad6b2 2026-03-07 11:45:09,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:45:09,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96cbc7ee78ae610cad6b2 HTTP/1.1" 200 None 2026-03-07 11:45:09,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:45:09,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:45:09,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:45:09,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a96cbc7ee78ae610cad6b2 HTTP/1.1" 200 None 2026-03-07 11:45:09,966 - lava_callback - ERROR - Error processing callback for node 69a96cbc7ee78ae610cad6b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40588 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:46:29,843 - lava_callback - INFO - Received callback for node 69a96d137ee78ae610cad6e6 INFO: 172.19.0.1:41660 - "POST /node/69a96d137ee78ae610cad6e6 HTTP/1.0" 202 Accepted 2026-03-07 11:46:29,853 - lava_callback - INFO - Starting async job submit for node 69a96d137ee78ae610cad6e6 2026-03-07 11:46:29,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:46:29,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96d137ee78ae610cad6e6 HTTP/1.1" 200 None 2026-03-07 11:46:29,879 - lava_callback - DEBUG - Processing node 69a96d137ee78ae610cad6e6: baseline-arm64-baylibre 2026-03-07 11:46:29,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a96d137ee78ae610cad6e6 2026-03-07 11:46:29,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:46:29,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96d137ee78ae610cad6e6 HTTP/1.1" 200 None 2026-03-07 11:46:29,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:46:29,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:46:29,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:46:29,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a96d137ee78ae610cad6e6 HTTP/1.1" 200 None 2026-03-07 11:46:29,974 - lava_callback - ERROR - Error processing callback for node 69a96d137ee78ae610cad6e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58394 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:50:50,121 - lava_callback - INFO - Received callback for node 69a96e107ee78ae610cad799 INFO: 172.19.0.1:57464 - "POST /node/69a96e107ee78ae610cad799 HTTP/1.0" 202 Accepted 2026-03-07 11:50:50,126 - lava_callback - INFO - Starting async job submit for node 69a96e107ee78ae610cad799 2026-03-07 11:50:50,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:50:50,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96e107ee78ae610cad799 HTTP/1.1" 200 None 2026-03-07 11:50:50,144 - lava_callback - DEBUG - Processing node 69a96e107ee78ae610cad799: baseline-arm64-baylibre 2026-03-07 11:50:50,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a96e107ee78ae610cad799 2026-03-07 11:50:50,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:50:50,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96e107ee78ae610cad799 HTTP/1.1" 200 None 2026-03-07 11:50:50,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:50:50,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:50:50,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:50:50,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a96e107ee78ae610cad799 HTTP/1.1" 200 None 2026-03-07 11:50:50,229 - lava_callback - ERROR - Error processing callback for node 69a96e107ee78ae610cad799: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47776 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:57:50,467 - lava_callback - INFO - Received callback for node 69a96fb87ee78ae610cad8dc INFO: 172.19.0.1:43764 - "POST /node/69a96fb87ee78ae610cad8dc HTTP/1.0" 202 Accepted 2026-03-07 11:57:50,473 - lava_callback - INFO - Starting async job submit for node 69a96fb87ee78ae610cad8dc 2026-03-07 11:57:50,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:57:50,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96fb87ee78ae610cad8dc HTTP/1.1" 200 None 2026-03-07 11:57:50,489 - lava_callback - DEBUG - Processing node 69a96fb87ee78ae610cad8dc: baseline-arm64-baylibre 2026-03-07 11:57:50,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a96fb87ee78ae610cad8dc 2026-03-07 11:57:50,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:57:50,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96fb87ee78ae610cad8dc HTTP/1.1" 200 None 2026-03-07 11:57:50,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:57:50,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:57:50,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:57:50,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a96fb87ee78ae610cad8dc HTTP/1.1" 200 None 2026-03-07 11:57:50,546 - lava_callback - ERROR - Error processing callback for node 69a96fb87ee78ae610cad8dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52370 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:00:30,631 - lava_callback - INFO - Received callback for node 69a970497ee78ae610cad925 INFO: 172.19.0.1:40526 - "POST /node/69a970497ee78ae610cad925 HTTP/1.0" 202 Accepted 2026-03-07 12:00:30,637 - lava_callback - INFO - Starting async job submit for node 69a970497ee78ae610cad925 2026-03-07 12:00:30,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:00:30,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a970497ee78ae610cad925 HTTP/1.1" 200 None 2026-03-07 12:00:30,656 - lava_callback - DEBUG - Processing node 69a970497ee78ae610cad925: baseline-arm64-baylibre 2026-03-07 12:00:30,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a970497ee78ae610cad925 2026-03-07 12:00:30,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:00:30,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a970497ee78ae610cad925 HTTP/1.1" 200 None 2026-03-07 12:00:30,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:00:30,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:00:30,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:00:30,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a970497ee78ae610cad925 HTTP/1.1" 200 None 2026-03-07 12:00:30,744 - lava_callback - ERROR - Error processing callback for node 69a970497ee78ae610cad925: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56862 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:01:50,748 - lava_callback - INFO - Received callback for node 69a9709f7ee78ae610cad970 INFO: 172.19.0.1:54508 - "POST /node/69a9709f7ee78ae610cad970 HTTP/1.0" 202 Accepted 2026-03-07 12:01:50,754 - lava_callback - INFO - Starting async job submit for node 69a9709f7ee78ae610cad970 2026-03-07 12:01:50,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:01:50,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9709f7ee78ae610cad970 HTTP/1.1" 200 None 2026-03-07 12:01:50,775 - lava_callback - DEBUG - Processing node 69a9709f7ee78ae610cad970: baseline-arm64-baylibre 2026-03-07 12:01:50,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9709f7ee78ae610cad970 2026-03-07 12:01:50,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:01:50,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9709f7ee78ae610cad970 HTTP/1.1" 200 None 2026-03-07 12:01:50,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:01:50,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:01:50,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:01:50,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9709f7ee78ae610cad970 HTTP/1.1" 200 None 2026-03-07 12:01:50,854 - lava_callback - ERROR - Error processing callback for node 69a9709f7ee78ae610cad970: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50016 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:03:10,688 - lava_callback - INFO - Received callback for node 69a970f67ee78ae610cad9ae INFO: 172.19.0.1:49282 - "POST /node/69a970f67ee78ae610cad9ae HTTP/1.0" 202 Accepted 2026-03-07 12:03:10,693 - lava_callback - INFO - Starting async job submit for node 69a970f67ee78ae610cad9ae 2026-03-07 12:03:10,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:03:10,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a970f67ee78ae610cad9ae HTTP/1.1" 200 None 2026-03-07 12:03:10,709 - lava_callback - DEBUG - Processing node 69a970f67ee78ae610cad9ae: baseline-arm64-baylibre 2026-03-07 12:03:10,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a970f67ee78ae610cad9ae 2026-03-07 12:03:10,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:03:10,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a970f67ee78ae610cad9ae HTTP/1.1" 200 None 2026-03-07 12:03:10,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:03:10,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:03:10,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:03:10,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a970f67ee78ae610cad9ae HTTP/1.1" 200 None 2026-03-07 12:03:10,768 - lava_callback - ERROR - Error processing callback for node 69a970f67ee78ae610cad9ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37676 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:04:50,775 - lava_callback - INFO - Received callback for node 69a971547ee78ae610cad9f4 INFO: 172.19.0.1:52486 - "POST /node/69a971547ee78ae610cad9f4 HTTP/1.0" 202 Accepted 2026-03-07 12:04:50,781 - lava_callback - INFO - Starting async job submit for node 69a971547ee78ae610cad9f4 2026-03-07 12:04:50,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:04:50,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a971547ee78ae610cad9f4 HTTP/1.1" 200 None 2026-03-07 12:04:50,807 - lava_callback - DEBUG - Processing node 69a971547ee78ae610cad9f4: baseline-arm64-baylibre 2026-03-07 12:04:50,807 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a971547ee78ae610cad9f4 2026-03-07 12:04:50,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:04:50,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a971547ee78ae610cad9f4 HTTP/1.1" 200 None 2026-03-07 12:04:50,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:04:50,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:04:50,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:04:50,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a971547ee78ae610cad9f4 HTTP/1.1" 200 None 2026-03-07 12:04:50,901 - lava_callback - ERROR - Error processing callback for node 69a971547ee78ae610cad9f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40588 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:06:10,847 - lava_callback - INFO - Received callback for node 69a971ab7ee78ae610cada2a INFO: 172.19.0.1:58074 - "POST /node/69a971ab7ee78ae610cada2a HTTP/1.0" 202 Accepted 2026-03-07 12:06:10,853 - lava_callback - INFO - Starting async job submit for node 69a971ab7ee78ae610cada2a 2026-03-07 12:06:10,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:06:10,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a971ab7ee78ae610cada2a HTTP/1.1" 200 None 2026-03-07 12:06:10,873 - lava_callback - DEBUG - Processing node 69a971ab7ee78ae610cada2a: baseline-arm64-baylibre 2026-03-07 12:06:10,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a971ab7ee78ae610cada2a 2026-03-07 12:06:10,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:06:10,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a971ab7ee78ae610cada2a HTTP/1.1" 200 None 2026-03-07 12:06:10,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:06:10,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:06:10,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:06:10,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a971ab7ee78ae610cada2a HTTP/1.1" 200 None 2026-03-07 12:06:10,940 - lava_callback - ERROR - Error processing callback for node 69a971ab7ee78ae610cada2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59056 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:07:50,994 - lava_callback - INFO - Received callback for node 69a972017ee78ae610cada6d INFO: 172.19.0.1:59604 - "POST /node/69a972017ee78ae610cada6d HTTP/1.0" 202 Accepted 2026-03-07 12:07:50,999 - lava_callback - INFO - Starting async job submit for node 69a972017ee78ae610cada6d 2026-03-07 12:07:51,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:07:51,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a972017ee78ae610cada6d HTTP/1.1" 200 None 2026-03-07 12:07:51,017 - lava_callback - DEBUG - Processing node 69a972017ee78ae610cada6d: baseline-arm64-baylibre 2026-03-07 12:07:51,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a972017ee78ae610cada6d 2026-03-07 12:07:51,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:07:51,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a972017ee78ae610cada6d HTTP/1.1" 200 None 2026-03-07 12:07:51,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:07:51,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:07:51,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:07:51,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a972017ee78ae610cada6d HTTP/1.1" 200 None 2026-03-07 12:07:51,102 - lava_callback - ERROR - Error processing callback for node 69a972017ee78ae610cada6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52502 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:42:33,148 - lava_callback - INFO - Received callback for node 69a97a357ee78ae610cadc29 INFO: 172.19.0.1:54368 - "POST /node/69a97a357ee78ae610cadc29 HTTP/1.0" 202 Accepted 2026-03-07 12:42:33,158 - lava_callback - INFO - Starting async job submit for node 69a97a357ee78ae610cadc29 2026-03-07 12:42:33,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:42:33,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a357ee78ae610cadc29 HTTP/1.1" 200 None 2026-03-07 12:42:33,183 - lava_callback - DEBUG - Processing node 69a97a357ee78ae610cadc29: baseline-arm-baylibre 2026-03-07 12:42:33,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97a357ee78ae610cadc29 2026-03-07 12:42:33,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:42:33,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a357ee78ae610cadc29 HTTP/1.1" 200 None 2026-03-07 12:42:33,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:42:33,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:42:33,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:42:33,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97a357ee78ae610cadc29 HTTP/1.1" 200 None 2026-03-07 12:42:33,286 - lava_callback - ERROR - Error processing callback for node 69a97a357ee78ae610cadc29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35274 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:43:32,839 - lava_callback - INFO - Received callback for node 69a97a607ee78ae610cadc36 INFO: 172.19.0.1:56906 - "POST /node/69a97a607ee78ae610cadc36 HTTP/1.0" 202 Accepted 2026-03-07 12:43:32,844 - lava_callback - INFO - Starting async job submit for node 69a97a607ee78ae610cadc36 2026-03-07 12:43:32,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:43:32,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a607ee78ae610cadc36 HTTP/1.1" 200 None 2026-03-07 12:43:32,861 - lava_callback - DEBUG - Processing node 69a97a607ee78ae610cadc36: baseline-arm-baylibre 2026-03-07 12:43:32,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97a607ee78ae610cadc36 2026-03-07 12:43:32,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:43:32,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a607ee78ae610cadc36 HTTP/1.1" 200 None 2026-03-07 12:43:32,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:43:32,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:43:32,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:43:32,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97a607ee78ae610cadc36 HTTP/1.1" 200 None 2026-03-07 12:43:32,918 - lava_callback - ERROR - Error processing callback for node 69a97a607ee78ae610cadc36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48124 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:44:12,965 - lava_callback - INFO - Received callback for node 69a97a8a7ee78ae610cadc81 INFO: 172.19.0.1:35992 - "POST /node/69a97a8a7ee78ae610cadc81 HTTP/1.0" 202 Accepted 2026-03-07 12:44:12,970 - lava_callback - INFO - Starting async job submit for node 69a97a8a7ee78ae610cadc81 2026-03-07 12:44:12,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:44:12,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a8a7ee78ae610cadc81 HTTP/1.1" 200 None 2026-03-07 12:44:12,986 - lava_callback - DEBUG - Processing node 69a97a8a7ee78ae610cadc81: baseline-arm-baylibre 2026-03-07 12:44:12,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97a8a7ee78ae610cadc81 2026-03-07 12:44:12,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:44:13,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a8a7ee78ae610cadc81 HTTP/1.1" 200 None 2026-03-07 12:44:13,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:44:13,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:44:13,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:44:13,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97a8a7ee78ae610cadc81 HTTP/1.1" 200 None 2026-03-07 12:44:13,041 - lava_callback - ERROR - Error processing callback for node 69a97a8a7ee78ae610cadc81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46748 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:45:33,044 - lava_callback - INFO - Received callback for node 69a97aeb7ee78ae610cadcc9 INFO: 172.19.0.1:50364 - "POST /node/69a97aeb7ee78ae610cadcc9 HTTP/1.0" 202 Accepted 2026-03-07 12:45:33,050 - lava_callback - INFO - Starting async job submit for node 69a97aeb7ee78ae610cadcc9 2026-03-07 12:45:33,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:45:33,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97aeb7ee78ae610cadcc9 HTTP/1.1" 200 None 2026-03-07 12:45:33,066 - lava_callback - DEBUG - Processing node 69a97aeb7ee78ae610cadcc9: baseline-arm-baylibre 2026-03-07 12:45:33,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97aeb7ee78ae610cadcc9 2026-03-07 12:45:33,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:45:33,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97aeb7ee78ae610cadcc9 HTTP/1.1" 200 None 2026-03-07 12:45:33,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:45:33,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:45:33,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:45:33,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97aeb7ee78ae610cadcc9 HTTP/1.1" 200 None 2026-03-07 12:45:33,123 - lava_callback - ERROR - Error processing callback for node 69a97aeb7ee78ae610cadcc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53756 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:46:53,085 - lava_callback - INFO - Received callback for node 69a97b287ee78ae610cadcfe INFO: 172.19.0.1:47664 - "POST /node/69a97b287ee78ae610cadcfe HTTP/1.0" 202 Accepted 2026-03-07 12:46:53,090 - lava_callback - INFO - Starting async job submit for node 69a97b287ee78ae610cadcfe 2026-03-07 12:46:53,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:46:53,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b287ee78ae610cadcfe HTTP/1.1" 200 None 2026-03-07 12:46:53,106 - lava_callback - DEBUG - Processing node 69a97b287ee78ae610cadcfe: baseline-arm-baylibre 2026-03-07 12:46:53,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97b287ee78ae610cadcfe 2026-03-07 12:46:53,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:46:53,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b287ee78ae610cadcfe HTTP/1.1" 200 None 2026-03-07 12:46:53,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:46:53,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:46:53,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:46:53,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97b287ee78ae610cadcfe HTTP/1.1" 200 None 2026-03-07 12:46:53,167 - lava_callback - ERROR - Error processing callback for node 69a97b287ee78ae610cadcfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44346 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:47:53,189 - lava_callback - INFO - Received callback for node 69a97b657ee78ae610cadd36 INFO: 172.19.0.1:34980 - "POST /node/69a97b657ee78ae610cadd36 HTTP/1.0" 202 Accepted 2026-03-07 12:47:53,194 - lava_callback - INFO - Starting async job submit for node 69a97b657ee78ae610cadd36 2026-03-07 12:47:53,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:47:53,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b657ee78ae610cadd36 HTTP/1.1" 200 None 2026-03-07 12:47:53,233 - lava_callback - DEBUG - Processing node 69a97b657ee78ae610cadd36: baseline-arm-baylibre 2026-03-07 12:47:53,233 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97b657ee78ae610cadd36 2026-03-07 12:47:53,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:47:53,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b657ee78ae610cadd36 HTTP/1.1" 200 None 2026-03-07 12:47:53,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:47:53,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:47:53,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:47:53,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97b657ee78ae610cadd36 HTTP/1.1" 200 None 2026-03-07 12:47:53,295 - lava_callback - ERROR - Error processing callback for node 69a97b657ee78ae610cadd36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36142 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:48:33,240 - lava_callback - INFO - Received callback for node 69a97b8d7ee78ae610cadd6c INFO: 172.19.0.1:36880 - "POST /node/69a97b8d7ee78ae610cadd6c HTTP/1.0" 202 Accepted 2026-03-07 12:48:33,246 - lava_callback - INFO - Starting async job submit for node 69a97b8d7ee78ae610cadd6c 2026-03-07 12:48:33,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:48:33,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b8d7ee78ae610cadd6c HTTP/1.1" 200 None 2026-03-07 12:48:33,262 - lava_callback - DEBUG - Processing node 69a97b8d7ee78ae610cadd6c: baseline-arm-baylibre 2026-03-07 12:48:33,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97b8d7ee78ae610cadd6c 2026-03-07 12:48:33,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:48:33,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b8d7ee78ae610cadd6c HTTP/1.1" 200 None 2026-03-07 12:48:33,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:48:33,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:48:33,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:48:33,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97b8d7ee78ae610cadd6c HTTP/1.1" 200 None 2026-03-07 12:48:33,337 - lava_callback - ERROR - Error processing callback for node 69a97b8d7ee78ae610cadd6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59390 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:49:13,179 - lava_callback - INFO - Received callback for node 69a97bbb7ee78ae610cadd94 INFO: 172.19.0.1:34194 - "POST /node/69a97bbb7ee78ae610cadd94 HTTP/1.0" 202 Accepted 2026-03-07 12:49:13,185 - lava_callback - INFO - Starting async job submit for node 69a97bbb7ee78ae610cadd94 2026-03-07 12:49:13,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:49:13,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97bbb7ee78ae610cadd94 HTTP/1.1" 200 None 2026-03-07 12:49:13,202 - lava_callback - DEBUG - Processing node 69a97bbb7ee78ae610cadd94: baseline-arm-baylibre 2026-03-07 12:49:13,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97bbb7ee78ae610cadd94 2026-03-07 12:49:13,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:49:13,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97bbb7ee78ae610cadd94 HTTP/1.1" 200 None 2026-03-07 12:49:13,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:49:13,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:49:13,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:49:13,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97bbb7ee78ae610cadd94 HTTP/1.1" 200 None 2026-03-07 12:49:13,261 - lava_callback - ERROR - Error processing callback for node 69a97bbb7ee78ae610cadd94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37354 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:50:13,307 - lava_callback - INFO - Received callback for node 69a97bf87ee78ae610cadddf INFO: 172.19.0.1:46158 - "POST /node/69a97bf87ee78ae610cadddf HTTP/1.0" 202 Accepted 2026-03-07 12:50:13,312 - lava_callback - INFO - Starting async job submit for node 69a97bf87ee78ae610cadddf 2026-03-07 12:50:13,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:13,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97bf87ee78ae610cadddf HTTP/1.1" 200 None 2026-03-07 12:50:13,328 - lava_callback - DEBUG - Processing node 69a97bf87ee78ae610cadddf: baseline-arm-baylibre 2026-03-07 12:50:13,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97bf87ee78ae610cadddf 2026-03-07 12:50:13,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:13,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97bf87ee78ae610cadddf HTTP/1.1" 200 None 2026-03-07 12:50:13,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:13,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:50:13,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:13,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97bf87ee78ae610cadddf HTTP/1.1" 200 None 2026-03-07 12:50:13,380 - lava_callback - ERROR - Error processing callback for node 69a97bf87ee78ae610cadddf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56770 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:50:53,276 - lava_callback - INFO - Received callback for node 69a97c227ee78ae610cade00 INFO: 172.19.0.1:39652 - "POST /node/69a97c227ee78ae610cade00 HTTP/1.0" 202 Accepted 2026-03-07 12:50:53,281 - lava_callback - INFO - Starting async job submit for node 69a97c227ee78ae610cade00 2026-03-07 12:50:53,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:53,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97c227ee78ae610cade00 HTTP/1.1" 200 None 2026-03-07 12:50:53,297 - lava_callback - DEBUG - Processing node 69a97c227ee78ae610cade00: baseline-arm-baylibre 2026-03-07 12:50:53,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97c227ee78ae610cade00 2026-03-07 12:50:53,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:53,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97c227ee78ae610cade00 HTTP/1.1" 200 None 2026-03-07 12:50:53,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:53,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:50:53,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:53,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97c227ee78ae610cade00 HTTP/1.1" 200 None 2026-03-07 12:50:53,374 - lava_callback - ERROR - Error processing callback for node 69a97c227ee78ae610cade00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48406 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:53:13,456 - lava_callback - INFO - Received callback for node 69a97cae7ee78ae610cade6a INFO: 172.19.0.1:56132 - "POST /node/69a97cae7ee78ae610cade6a HTTP/1.0" 202 Accepted 2026-03-07 12:53:13,462 - lava_callback - INFO - Starting async job submit for node 69a97cae7ee78ae610cade6a 2026-03-07 12:53:13,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:53:13,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97cae7ee78ae610cade6a HTTP/1.1" 200 None 2026-03-07 12:53:13,478 - lava_callback - DEBUG - Processing node 69a97cae7ee78ae610cade6a: baseline-arm-baylibre 2026-03-07 12:53:13,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97cae7ee78ae610cade6a 2026-03-07 12:53:13,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:53:13,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97cae7ee78ae610cade6a HTTP/1.1" 200 None 2026-03-07 12:53:13,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:53:13,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:53:13,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:53:13,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97cae7ee78ae610cade6a HTTP/1.1" 200 None 2026-03-07 12:53:13,531 - lava_callback - ERROR - Error processing callback for node 69a97cae7ee78ae610cade6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41076 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:55:13,574 - lava_callback - INFO - Received callback for node 69a97d1e7ee78ae610cadecb INFO: 172.19.0.1:52694 - "POST /node/69a97d1e7ee78ae610cadecb HTTP/1.0" 202 Accepted 2026-03-07 12:55:13,580 - lava_callback - INFO - Starting async job submit for node 69a97d1e7ee78ae610cadecb 2026-03-07 12:55:13,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:55:13,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97d1e7ee78ae610cadecb HTTP/1.1" 200 None 2026-03-07 12:55:13,597 - lava_callback - DEBUG - Processing node 69a97d1e7ee78ae610cadecb: baseline-arm-baylibre 2026-03-07 12:55:13,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97d1e7ee78ae610cadecb 2026-03-07 12:55:13,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:55:13,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97d1e7ee78ae610cadecb HTTP/1.1" 200 None 2026-03-07 12:55:13,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:55:13,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:55:13,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:55:13,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97d1e7ee78ae610cadecb HTTP/1.1" 200 None 2026-03-07 12:55:13,677 - lava_callback - ERROR - Error processing callback for node 69a97d1e7ee78ae610cadecb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41848 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:08:14,324 - lava_callback - INFO - Received callback for node 69a9803c7ee78ae610cae03e INFO: 172.19.0.1:43472 - "POST /node/69a9803c7ee78ae610cae03e HTTP/1.0" 202 Accepted 2026-03-07 13:08:14,330 - lava_callback - INFO - Starting async job submit for node 69a9803c7ee78ae610cae03e 2026-03-07 13:08:14,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:08:14,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9803c7ee78ae610cae03e HTTP/1.1" 200 None 2026-03-07 13:08:14,346 - lava_callback - DEBUG - Processing node 69a9803c7ee78ae610cae03e: baseline-arm64-baylibre 2026-03-07 13:08:14,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9803c7ee78ae610cae03e 2026-03-07 13:08:14,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:08:14,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9803c7ee78ae610cae03e HTTP/1.1" 200 None 2026-03-07 13:08:14,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:08:14,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-07 13:08:14,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:08:14,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9803c7ee78ae610cae03e HTTP/1.1" 200 None 2026-03-07 13:08:14,409 - lava_callback - ERROR - Error processing callback for node 69a9803c7ee78ae610cae03e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46914 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:09:54,348 - lava_callback - INFO - Received callback for node 69a9808d7ee78ae610cae079 INFO: 172.19.0.1:39986 - "POST /node/69a9808d7ee78ae610cae079 HTTP/1.0" 202 Accepted 2026-03-07 13:09:54,354 - lava_callback - INFO - Starting async job submit for node 69a9808d7ee78ae610cae079 2026-03-07 13:09:54,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:09:54,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9808d7ee78ae610cae079 HTTP/1.1" 200 None 2026-03-07 13:09:54,370 - lava_callback - DEBUG - Processing node 69a9808d7ee78ae610cae079: baseline-arm64-baylibre 2026-03-07 13:09:54,370 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9808d7ee78ae610cae079 2026-03-07 13:09:54,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:09:54,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9808d7ee78ae610cae079 HTTP/1.1" 200 None 2026-03-07 13:09:54,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:09:54,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:09:54,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:09:54,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9808d7ee78ae610cae079 HTTP/1.1" 200 None 2026-03-07 13:09:54,428 - lava_callback - ERROR - Error processing callback for node 69a9808d7ee78ae610cae079: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48618 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:11:14,428 - lava_callback - INFO - Received callback for node 69a980e37ee78ae610cae0ae INFO: 172.19.0.1:60166 - "POST /node/69a980e37ee78ae610cae0ae HTTP/1.0" 202 Accepted 2026-03-07 13:11:14,434 - lava_callback - INFO - Starting async job submit for node 69a980e37ee78ae610cae0ae 2026-03-07 13:11:14,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:11:14,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a980e37ee78ae610cae0ae HTTP/1.1" 200 None 2026-03-07 13:11:14,450 - lava_callback - DEBUG - Processing node 69a980e37ee78ae610cae0ae: baseline-arm64-baylibre 2026-03-07 13:11:14,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a980e37ee78ae610cae0ae 2026-03-07 13:11:14,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:11:14,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a980e37ee78ae610cae0ae HTTP/1.1" 200 None 2026-03-07 13:11:14,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:11:14,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:11:14,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:11:14,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a980e37ee78ae610cae0ae HTTP/1.1" 200 None 2026-03-07 13:11:14,521 - lava_callback - ERROR - Error processing callback for node 69a980e37ee78ae610cae0ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34872 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:12:34,661 - lava_callback - INFO - Received callback for node 69a981397ee78ae610cae0e1 INFO: 172.19.0.1:37668 - "POST /node/69a981397ee78ae610cae0e1 HTTP/1.0" 202 Accepted 2026-03-07 13:12:34,666 - lava_callback - INFO - Starting async job submit for node 69a981397ee78ae610cae0e1 2026-03-07 13:12:34,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:12:34,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a981397ee78ae610cae0e1 HTTP/1.1" 200 None 2026-03-07 13:12:34,683 - lava_callback - DEBUG - Processing node 69a981397ee78ae610cae0e1: baseline-arm64-baylibre 2026-03-07 13:12:34,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a981397ee78ae610cae0e1 2026-03-07 13:12:34,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:12:34,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a981397ee78ae610cae0e1 HTTP/1.1" 200 None 2026-03-07 13:12:34,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:12:34,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:12:34,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:12:34,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a981397ee78ae610cae0e1 HTTP/1.1" 200 None 2026-03-07 13:12:34,796 - lava_callback - ERROR - Error processing callback for node 69a981397ee78ae610cae0e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49786 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:13:54,634 - lava_callback - INFO - Received callback for node 69a9818f7ee78ae610cae114 INFO: 172.19.0.1:51292 - "POST /node/69a9818f7ee78ae610cae114 HTTP/1.0" 202 Accepted 2026-03-07 13:13:54,640 - lava_callback - INFO - Starting async job submit for node 69a9818f7ee78ae610cae114 2026-03-07 13:13:54,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:13:54,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9818f7ee78ae610cae114 HTTP/1.1" 200 None 2026-03-07 13:13:54,655 - lava_callback - DEBUG - Processing node 69a9818f7ee78ae610cae114: baseline-arm64-baylibre 2026-03-07 13:13:54,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9818f7ee78ae610cae114 2026-03-07 13:13:54,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:13:54,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9818f7ee78ae610cae114 HTTP/1.1" 200 None 2026-03-07 13:13:54,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:13:54,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:13:54,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:13:54,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9818f7ee78ae610cae114 HTTP/1.1" 200 None 2026-03-07 13:13:54,725 - lava_callback - ERROR - Error processing callback for node 69a9818f7ee78ae610cae114: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37056 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:15:34,676 - lava_callback - INFO - Received callback for node 69a981e57ee78ae610cae14c INFO: 172.19.0.1:56544 - "POST /node/69a981e57ee78ae610cae14c HTTP/1.0" 202 Accepted 2026-03-07 13:15:34,682 - lava_callback - INFO - Starting async job submit for node 69a981e57ee78ae610cae14c 2026-03-07 13:15:34,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:15:34,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a981e57ee78ae610cae14c HTTP/1.1" 200 None 2026-03-07 13:15:34,699 - lava_callback - DEBUG - Processing node 69a981e57ee78ae610cae14c: baseline-arm64-baylibre 2026-03-07 13:15:34,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a981e57ee78ae610cae14c 2026-03-07 13:15:34,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:15:34,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a981e57ee78ae610cae14c HTTP/1.1" 200 None 2026-03-07 13:15:34,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:15:34,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:15:34,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:15:34,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a981e57ee78ae610cae14c HTTP/1.1" 200 None 2026-03-07 13:15:34,778 - lava_callback - ERROR - Error processing callback for node 69a981e57ee78ae610cae14c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43284 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:16:54,756 - lava_callback - INFO - Received callback for node 69a9823b7ee78ae610cae180 INFO: 172.19.0.1:59722 - "POST /node/69a9823b7ee78ae610cae180 HTTP/1.0" 202 Accepted 2026-03-07 13:16:54,762 - lava_callback - INFO - Starting async job submit for node 69a9823b7ee78ae610cae180 2026-03-07 13:16:54,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:16:54,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9823b7ee78ae610cae180 HTTP/1.1" 200 None 2026-03-07 13:16:54,787 - lava_callback - DEBUG - Processing node 69a9823b7ee78ae610cae180: baseline-arm64-baylibre 2026-03-07 13:16:54,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9823b7ee78ae610cae180 2026-03-07 13:16:54,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:16:54,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9823b7ee78ae610cae180 HTTP/1.1" 200 None 2026-03-07 13:16:54,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:16:54,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:16:54,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:16:54,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9823b7ee78ae610cae180 HTTP/1.1" 200 None 2026-03-07 13:16:54,848 - lava_callback - ERROR - Error processing callback for node 69a9823b7ee78ae610cae180: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60182 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:18:24,635 - lava_callback - INFO - Received callback for node 69a982977ee78ae610cae1b4 INFO: 172.19.0.1:44182 - "POST /node/69a982977ee78ae610cae1b4 HTTP/1.0" 202 Accepted 2026-03-07 13:18:24,640 - lava_callback - INFO - Starting async job submit for node 69a982977ee78ae610cae1b4 2026-03-07 13:18:24,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:18:24,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a982977ee78ae610cae1b4 HTTP/1.1" 200 None 2026-03-07 13:18:24,656 - lava_callback - DEBUG - Processing node 69a982977ee78ae610cae1b4: baseline-arm64-clabbe 2026-03-07 13:18:24,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a982977ee78ae610cae1b4 2026-03-07 13:18:24,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:18:24,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a982977ee78ae610cae1b4 HTTP/1.1" 200 None 2026-03-07 13:18:24,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:18:24,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-07 13:18:24,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:18:24,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a982977ee78ae610cae1b4 HTTP/1.1" 200 None 2026-03-07 13:18:24,708 - lava_callback - ERROR - Error processing callback for node 69a982977ee78ae610cae1b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48124 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:22:24,761 - lava_callback - INFO - Received callback for node 69a9838b7ee78ae610cae2cf INFO: 172.19.0.1:55110 - "POST /node/69a9838b7ee78ae610cae2cf HTTP/1.0" 202 Accepted 2026-03-07 13:22:24,767 - lava_callback - INFO - Starting async job submit for node 69a9838b7ee78ae610cae2cf 2026-03-07 13:22:24,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:22:24,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9838b7ee78ae610cae2cf HTTP/1.1" 200 None 2026-03-07 13:22:24,783 - lava_callback - DEBUG - Processing node 69a9838b7ee78ae610cae2cf: baseline-arm-clabbe 2026-03-07 13:22:24,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9838b7ee78ae610cae2cf 2026-03-07 13:22:24,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:22:24,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9838b7ee78ae610cae2cf HTTP/1.1" 200 None 2026-03-07 13:22:24,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:22:24,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-07 13:22:24,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:22:24,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9838b7ee78ae610cae2cf HTTP/1.1" 200 None 2026-03-07 13:22:24,839 - lava_callback - ERROR - Error processing callback for node 69a9838b7ee78ae610cae2cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34228 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:23:24,842 - lava_callback - INFO - Received callback for node 69a983b97ee78ae610cae2f2 INFO: 172.19.0.1:42958 - "POST /node/69a983b97ee78ae610cae2f2 HTTP/1.0" 202 Accepted 2026-03-07 13:23:24,848 - lava_callback - INFO - Starting async job submit for node 69a983b97ee78ae610cae2f2 2026-03-07 13:23:24,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:23:24,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a983b97ee78ae610cae2f2 HTTP/1.1" 200 None 2026-03-07 13:23:24,863 - lava_callback - DEBUG - Processing node 69a983b97ee78ae610cae2f2: baseline-arm-clabbe 2026-03-07 13:23:24,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a983b97ee78ae610cae2f2 2026-03-07 13:23:24,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:23:24,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a983b97ee78ae610cae2f2 HTTP/1.1" 200 None 2026-03-07 13:23:24,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:23:24,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-07 13:23:24,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:23:24,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a983b97ee78ae610cae2f2 HTTP/1.1" 200 None 2026-03-07 13:23:24,926 - lava_callback - ERROR - Error processing callback for node 69a983b97ee78ae610cae2f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58326 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:24:15,222 - lava_callback - INFO - Received callback for node 69a983ec7ee78ae610cae347 INFO: 172.19.0.1:58340 - "POST /node/69a983ec7ee78ae610cae347 HTTP/1.0" 202 Accepted 2026-03-07 13:24:15,228 - lava_callback - INFO - Starting async job submit for node 69a983ec7ee78ae610cae347 2026-03-07 13:24:15,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:24:15,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a983ec7ee78ae610cae347 HTTP/1.1" 200 None 2026-03-07 13:24:15,261 - lava_callback - DEBUG - Processing node 69a983ec7ee78ae610cae347: baseline-arm64-baylibre 2026-03-07 13:24:15,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a983ec7ee78ae610cae347 2026-03-07 13:24:15,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:24:15,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a983ec7ee78ae610cae347 HTTP/1.1" 200 None 2026-03-07 13:24:15,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:24:15,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:24:15,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:24:15,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a983ec7ee78ae610cae347 HTTP/1.1" 200 None 2026-03-07 13:24:15,320 - lava_callback - ERROR - Error processing callback for node 69a983ec7ee78ae610cae347: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51812 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:25:35,264 - lava_callback - INFO - Received callback for node 69a984427ee78ae610cae37c INFO: 172.19.0.1:36672 - "POST /node/69a984427ee78ae610cae37c HTTP/1.0" 202 Accepted 2026-03-07 13:25:35,270 - lava_callback - INFO - Starting async job submit for node 69a984427ee78ae610cae37c 2026-03-07 13:25:35,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:25:35,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a984427ee78ae610cae37c HTTP/1.1" 200 None 2026-03-07 13:25:35,286 - lava_callback - DEBUG - Processing node 69a984427ee78ae610cae37c: baseline-arm64-baylibre 2026-03-07 13:25:35,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a984427ee78ae610cae37c 2026-03-07 13:25:35,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:25:35,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a984427ee78ae610cae37c HTTP/1.1" 200 None 2026-03-07 13:25:35,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:25:35,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:25:35,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:25:35,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a984427ee78ae610cae37c HTTP/1.1" 200 None 2026-03-07 13:25:35,346 - lava_callback - ERROR - Error processing callback for node 69a984427ee78ae610cae37c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58734 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:28:55,474 - lava_callback - INFO - Received callback for node 69a985027ee78ae610cae3b9 INFO: 172.19.0.1:54854 - "POST /node/69a985027ee78ae610cae3b9 HTTP/1.0" 202 Accepted 2026-03-07 13:28:55,479 - lava_callback - INFO - Starting async job submit for node 69a985027ee78ae610cae3b9 2026-03-07 13:28:55,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:28:55,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a985027ee78ae610cae3b9 HTTP/1.1" 200 None 2026-03-07 13:28:55,496 - lava_callback - DEBUG - Processing node 69a985027ee78ae610cae3b9: baseline-arm64-baylibre 2026-03-07 13:28:55,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a985027ee78ae610cae3b9 2026-03-07 13:28:55,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:28:55,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a985027ee78ae610cae3b9 HTTP/1.1" 200 None 2026-03-07 13:28:55,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:28:55,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:28:55,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:28:55,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a985027ee78ae610cae3b9 HTTP/1.1" 200 None 2026-03-07 13:28:55,569 - lava_callback - ERROR - Error processing callback for node 69a985027ee78ae610cae3b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46440 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:30:35,545 - lava_callback - INFO - Received callback for node 69a985687ee78ae610cae400 INFO: 172.19.0.1:56062 - "POST /node/69a985687ee78ae610cae400 HTTP/1.0" 202 Accepted 2026-03-07 13:30:35,551 - lava_callback - INFO - Starting async job submit for node 69a985687ee78ae610cae400 2026-03-07 13:30:35,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:30:35,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a985687ee78ae610cae400 HTTP/1.1" 200 None 2026-03-07 13:30:35,574 - lava_callback - DEBUG - Processing node 69a985687ee78ae610cae400: baseline-arm64-baylibre 2026-03-07 13:30:35,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a985687ee78ae610cae400 2026-03-07 13:30:35,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:30:35,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a985687ee78ae610cae400 HTTP/1.1" 200 None 2026-03-07 13:30:35,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:30:35,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:30:35,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:30:35,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a985687ee78ae610cae400 HTTP/1.1" 200 None 2026-03-07 13:30:35,633 - lava_callback - ERROR - Error processing callback for node 69a985687ee78ae610cae400: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45740 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:33:35,647 - lava_callback - INFO - Received callback for node 69a986227ee78ae610cae445 INFO: 172.19.0.1:44096 - "POST /node/69a986227ee78ae610cae445 HTTP/1.0" 202 Accepted 2026-03-07 13:33:35,653 - lava_callback - INFO - Starting async job submit for node 69a986227ee78ae610cae445 2026-03-07 13:33:35,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:33:35,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986227ee78ae610cae445 HTTP/1.1" 200 None 2026-03-07 13:33:35,672 - lava_callback - DEBUG - Processing node 69a986227ee78ae610cae445: baseline-arm-baylibre 2026-03-07 13:33:35,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a986227ee78ae610cae445 2026-03-07 13:33:35,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:33:35,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986227ee78ae610cae445 HTTP/1.1" 200 None 2026-03-07 13:33:35,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:33:35,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:33:35,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:33:35,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a986227ee78ae610cae445 HTTP/1.1" 200 None 2026-03-07 13:33:35,725 - lava_callback - ERROR - Error processing callback for node 69a986227ee78ae610cae445: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47636 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:34:15,690 - lava_callback - INFO - Received callback for node 69a986507ee78ae610cae46d INFO: 172.19.0.1:47640 - "POST /node/69a986507ee78ae610cae46d HTTP/1.0" 202 Accepted 2026-03-07 13:34:15,699 - lava_callback - INFO - Starting async job submit for node 69a986507ee78ae610cae46d 2026-03-07 13:34:15,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:15,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986507ee78ae610cae46d HTTP/1.1" 200 None 2026-03-07 13:34:15,714 - lava_callback - DEBUG - Processing node 69a986507ee78ae610cae46d: baseline-arm-baylibre 2026-03-07 13:34:15,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a986507ee78ae610cae46d 2026-03-07 13:34:15,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:15,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986507ee78ae610cae46d HTTP/1.1" 200 None 2026-03-07 13:34:15,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:15,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:34:15,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:15,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a986507ee78ae610cae46d HTTP/1.1" 200 None 2026-03-07 13:34:15,767 - lava_callback - ERROR - Error processing callback for node 69a986507ee78ae610cae46d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52260 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:34:55,768 - lava_callback - INFO - Received callback for node 69a9867d7ee78ae610cae4bc INFO: 172.19.0.1:52268 - "POST /node/69a9867d7ee78ae610cae4bc HTTP/1.0" 202 Accepted 2026-03-07 13:34:55,774 - lava_callback - INFO - Starting async job submit for node 69a9867d7ee78ae610cae4bc 2026-03-07 13:34:55,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:55,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9867d7ee78ae610cae4bc HTTP/1.1" 200 None 2026-03-07 13:34:55,791 - lava_callback - DEBUG - Processing node 69a9867d7ee78ae610cae4bc: baseline-arm-baylibre 2026-03-07 13:34:55,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9867d7ee78ae610cae4bc 2026-03-07 13:34:55,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:55,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9867d7ee78ae610cae4bc HTTP/1.1" 200 None 2026-03-07 13:34:55,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:55,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:34:55,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:55,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9867d7ee78ae610cae4bc HTTP/1.1" 200 None 2026-03-07 13:34:55,856 - lava_callback - ERROR - Error processing callback for node 69a9867d7ee78ae610cae4bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59504 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:35:55,927 - lava_callback - INFO - Received callback for node 69a986b87ee78ae610cae503 INFO: 172.19.0.1:56514 - "POST /node/69a986b87ee78ae610cae503 HTTP/1.0" 202 Accepted 2026-03-07 13:35:55,933 - lava_callback - INFO - Starting async job submit for node 69a986b87ee78ae610cae503 2026-03-07 13:35:55,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:35:55,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986b87ee78ae610cae503 HTTP/1.1" 200 None 2026-03-07 13:35:55,951 - lava_callback - DEBUG - Processing node 69a986b87ee78ae610cae503: baseline-arm64-baylibre 2026-03-07 13:35:55,951 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a986b87ee78ae610cae503 2026-03-07 13:35:55,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:35:55,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986b87ee78ae610cae503 HTTP/1.1" 200 None 2026-03-07 13:35:55,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:35:55,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:35:55,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:35:56,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a986b87ee78ae610cae503 HTTP/1.1" 200 None 2026-03-07 13:35:56,007 - lava_callback - ERROR - Error processing callback for node 69a986b87ee78ae610cae503: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38136 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:37:15,992 - lava_callback - INFO - Received callback for node 69a987047ee78ae610cae53d INFO: 172.19.0.1:38152 - "POST /node/69a987047ee78ae610cae53d HTTP/1.0" 202 Accepted 2026-03-07 13:37:16,002 - lava_callback - INFO - Starting async job submit for node 69a987047ee78ae610cae53d 2026-03-07 13:37:16,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:16,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987047ee78ae610cae53d HTTP/1.1" 200 None 2026-03-07 13:37:16,027 - lava_callback - DEBUG - Processing node 69a987047ee78ae610cae53d: baseline-arm-baylibre 2026-03-07 13:37:16,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a987047ee78ae610cae53d 2026-03-07 13:37:16,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:16,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987047ee78ae610cae53d HTTP/1.1" 200 None 2026-03-07 13:37:16,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:16,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:37:16,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:16,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a987047ee78ae610cae53d HTTP/1.1" 200 None 2026-03-07 13:37:16,136 - lava_callback - ERROR - Error processing callback for node 69a987047ee78ae610cae53d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42550 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:37:55,871 - lava_callback - INFO - Received callback for node 69a987317ee78ae610cae57b INFO: 172.19.0.1:38340 - "POST /node/69a987317ee78ae610cae57b HTTP/1.0" 202 Accepted 2026-03-07 13:37:55,877 - lava_callback - INFO - Starting async job submit for node 69a987317ee78ae610cae57b 2026-03-07 13:37:55,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:55,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987317ee78ae610cae57b HTTP/1.1" 200 None 2026-03-07 13:37:55,893 - lava_callback - DEBUG - Processing node 69a987317ee78ae610cae57b: baseline-arm-baylibre 2026-03-07 13:37:55,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a987317ee78ae610cae57b 2026-03-07 13:37:55,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:55,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987317ee78ae610cae57b HTTP/1.1" 200 None 2026-03-07 13:37:55,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:55,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:37:55,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:55,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a987317ee78ae610cae57b HTTP/1.1" 200 None 2026-03-07 13:37:55,984 - lava_callback - ERROR - Error processing callback for node 69a987317ee78ae610cae57b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57216 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:38:55,951 - lava_callback - INFO - Received callback for node 69a9875e7ee78ae610cae5a0 INFO: 172.19.0.1:53060 - "POST /node/69a9875e7ee78ae610cae5a0 HTTP/1.0" 202 Accepted 2026-03-07 13:38:55,957 - lava_callback - INFO - Starting async job submit for node 69a9875e7ee78ae610cae5a0 2026-03-07 13:38:55,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:38:55,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9875e7ee78ae610cae5a0 HTTP/1.1" 200 None 2026-03-07 13:38:55,974 - lava_callback - DEBUG - Processing node 69a9875e7ee78ae610cae5a0: baseline-arm-baylibre 2026-03-07 13:38:55,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9875e7ee78ae610cae5a0 2026-03-07 13:38:55,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:38:55,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9875e7ee78ae610cae5a0 HTTP/1.1" 200 None 2026-03-07 13:38:55,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:38:56,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:38:56,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:38:56,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9875e7ee78ae610cae5a0 HTTP/1.1" 200 None 2026-03-07 13:38:56,029 - lava_callback - ERROR - Error processing callback for node 69a9875e7ee78ae610cae5a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45296 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:39:35,971 - lava_callback - INFO - Received callback for node 69a987937ee78ae610cae5f9 INFO: 172.19.0.1:39074 - "POST /node/69a987937ee78ae610cae5f9 HTTP/1.0" 202 Accepted 2026-03-07 13:39:35,978 - lava_callback - INFO - Starting async job submit for node 69a987937ee78ae610cae5f9 2026-03-07 13:39:35,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:39:36,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987937ee78ae610cae5f9 HTTP/1.1" 200 None 2026-03-07 13:39:36,035 - lava_callback - DEBUG - Processing node 69a987937ee78ae610cae5f9: baseline-arm64-baylibre 2026-03-07 13:39:36,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a987937ee78ae610cae5f9 2026-03-07 13:39:36,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:39:36,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987937ee78ae610cae5f9 HTTP/1.1" 200 None 2026-03-07 13:39:36,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:39:36,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:39:36,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:39:36,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a987937ee78ae610cae5f9 HTTP/1.1" 200 None 2026-03-07 13:39:36,110 - lava_callback - ERROR - Error processing callback for node 69a987937ee78ae610cae5f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49204 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:41:16,114 - lava_callback - INFO - Received callback for node 69a987eb7ee78ae610cae636 INFO: 172.19.0.1:49206 - "POST /node/69a987eb7ee78ae610cae636 HTTP/1.0" 202 Accepted 2026-03-07 13:41:16,119 - lava_callback - INFO - Starting async job submit for node 69a987eb7ee78ae610cae636 2026-03-07 13:41:16,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:41:16,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987eb7ee78ae610cae636 HTTP/1.1" 200 None 2026-03-07 13:41:16,136 - lava_callback - DEBUG - Processing node 69a987eb7ee78ae610cae636: baseline-arm64-baylibre 2026-03-07 13:41:16,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a987eb7ee78ae610cae636 2026-03-07 13:41:16,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:41:16,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987eb7ee78ae610cae636 HTTP/1.1" 200 None 2026-03-07 13:41:16,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:41:16,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:41:16,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:41:16,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a987eb7ee78ae610cae636 HTTP/1.1" 200 None 2026-03-07 13:41:16,194 - lava_callback - ERROR - Error processing callback for node 69a987eb7ee78ae610cae636: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50280 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:42:36,220 - lava_callback - INFO - Received callback for node 69a9883d7ee78ae610cae676 INFO: 172.19.0.1:37306 - "POST /node/69a9883d7ee78ae610cae676 HTTP/1.0" 202 Accepted 2026-03-07 13:42:36,225 - lava_callback - INFO - Starting async job submit for node 69a9883d7ee78ae610cae676 2026-03-07 13:42:36,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:42:36,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9883d7ee78ae610cae676 HTTP/1.1" 200 None 2026-03-07 13:42:36,242 - lava_callback - DEBUG - Processing node 69a9883d7ee78ae610cae676: baseline-arm64-baylibre 2026-03-07 13:42:36,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9883d7ee78ae610cae676 2026-03-07 13:42:36,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:42:36,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9883d7ee78ae610cae676 HTTP/1.1" 200 None 2026-03-07 13:42:36,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:42:36,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:42:36,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:42:36,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9883d7ee78ae610cae676 HTTP/1.1" 200 None 2026-03-07 13:42:36,294 - lava_callback - ERROR - Error processing callback for node 69a9883d7ee78ae610cae676: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54712 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:43:56,248 - lava_callback - INFO - Received callback for node 69a988937ee78ae610cae6c3 INFO: 172.19.0.1:42580 - "POST /node/69a988937ee78ae610cae6c3 HTTP/1.0" 202 Accepted 2026-03-07 13:43:56,258 - lava_callback - INFO - Starting async job submit for node 69a988937ee78ae610cae6c3 2026-03-07 13:43:56,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:43:56,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a988937ee78ae610cae6c3 HTTP/1.1" 200 None 2026-03-07 13:43:56,291 - lava_callback - DEBUG - Processing node 69a988937ee78ae610cae6c3: baseline-arm64-baylibre 2026-03-07 13:43:56,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a988937ee78ae610cae6c3 2026-03-07 13:43:56,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:43:56,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a988937ee78ae610cae6c3 HTTP/1.1" 200 None 2026-03-07 13:43:56,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:43:56,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:43:56,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:43:56,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a988937ee78ae610cae6c3 HTTP/1.1" 200 None 2026-03-07 13:43:56,359 - lava_callback - ERROR - Error processing callback for node 69a988937ee78ae610cae6c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54068 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:45:16,273 - lava_callback - INFO - Received callback for node 69a988ea7ee78ae610cae703 INFO: 172.19.0.1:54070 - "POST /node/69a988ea7ee78ae610cae703 HTTP/1.0" 202 Accepted 2026-03-07 13:45:16,278 - lava_callback - INFO - Starting async job submit for node 69a988ea7ee78ae610cae703 2026-03-07 13:45:16,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:45:16,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a988ea7ee78ae610cae703 HTTP/1.1" 200 None 2026-03-07 13:45:16,295 - lava_callback - DEBUG - Processing node 69a988ea7ee78ae610cae703: baseline-arm64-baylibre 2026-03-07 13:45:16,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a988ea7ee78ae610cae703 2026-03-07 13:45:16,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:45:16,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a988ea7ee78ae610cae703 HTTP/1.1" 200 None 2026-03-07 13:45:16,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:45:16,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:45:16,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:45:16,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a988ea7ee78ae610cae703 HTTP/1.1" 200 None 2026-03-07 13:45:16,350 - lava_callback - ERROR - Error processing callback for node 69a988ea7ee78ae610cae703: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38088 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:46:56,401 - lava_callback - INFO - Received callback for node 69a9893e7ee78ae610cae746 INFO: 172.19.0.1:47536 - "POST /node/69a9893e7ee78ae610cae746 HTTP/1.0" 202 Accepted 2026-03-07 13:46:56,406 - lava_callback - INFO - Starting async job submit for node 69a9893e7ee78ae610cae746 2026-03-07 13:46:56,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:46:56,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9893e7ee78ae610cae746 HTTP/1.1" 200 None 2026-03-07 13:46:56,446 - lava_callback - DEBUG - Processing node 69a9893e7ee78ae610cae746: baseline-arm64-baylibre 2026-03-07 13:46:56,446 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9893e7ee78ae610cae746 2026-03-07 13:46:56,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:46:56,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9893e7ee78ae610cae746 HTTP/1.1" 200 None 2026-03-07 13:46:56,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:46:56,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:46:56,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:46:56,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9893e7ee78ae610cae746 HTTP/1.1" 200 None 2026-03-07 13:46:56,527 - lava_callback - ERROR - Error processing callback for node 69a9893e7ee78ae610cae746: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54672 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:48:16,475 - lava_callback - INFO - Received callback for node 69a989937ee78ae610cae77d INFO: 172.19.0.1:54676 - "POST /node/69a989937ee78ae610cae77d HTTP/1.0" 202 Accepted 2026-03-07 13:48:16,480 - lava_callback - INFO - Starting async job submit for node 69a989937ee78ae610cae77d 2026-03-07 13:48:16,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:54690 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:48:16,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a989937ee78ae610cae77d HTTP/1.1" 200 None 2026-03-07 13:48:16,522 - lava_callback - DEBUG - Processing node 69a989937ee78ae610cae77d: baseline-arm64-baylibre 2026-03-07 13:48:16,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a989937ee78ae610cae77d 2026-03-07 13:48:16,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:48:16,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a989937ee78ae610cae77d HTTP/1.1" 200 None 2026-03-07 13:48:16,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:48:16,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:48:16,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:48:16,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a989937ee78ae610cae77d HTTP/1.1" 200 None 2026-03-07 13:48:16,601 - lava_callback - ERROR - Error processing callback for node 69a989937ee78ae610cae77d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33414 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:54:56,799 - lava_callback - INFO - Received callback for node 69a98b287ee78ae610cae830 INFO: 172.19.0.1:33418 - "POST /node/69a98b287ee78ae610cae830 HTTP/1.0" 202 Accepted 2026-03-07 13:54:56,804 - lava_callback - INFO - Starting async job submit for node 69a98b287ee78ae610cae830 2026-03-07 13:54:56,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:54:56,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a98b287ee78ae610cae830 HTTP/1.1" 200 None 2026-03-07 13:54:56,826 - lava_callback - DEBUG - Processing node 69a98b287ee78ae610cae830: baseline-arm64-baylibre 2026-03-07 13:54:56,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a98b287ee78ae610cae830 2026-03-07 13:54:56,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:54:56,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a98b287ee78ae610cae830 HTTP/1.1" 200 None 2026-03-07 13:54:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:54:56,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:54:56,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:54:56,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a98b287ee78ae610cae830 HTTP/1.1" 200 None 2026-03-07 13:54:56,905 - lava_callback - ERROR - Error processing callback for node 69a98b287ee78ae610cae830: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32934 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:58:16,965 - lava_callback - INFO - Received callback for node 69a98bf57ee78ae610cae8ab INFO: 172.19.0.1:32946 - "POST /node/69a98bf57ee78ae610cae8ab HTTP/1.0" 202 Accepted 2026-03-07 13:58:16,971 - lava_callback - INFO - Starting async job submit for node 69a98bf57ee78ae610cae8ab 2026-03-07 13:58:16,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:58:16,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a98bf57ee78ae610cae8ab HTTP/1.1" 200 None 2026-03-07 13:58:16,990 - lava_callback - DEBUG - Processing node 69a98bf57ee78ae610cae8ab: baseline-arm64-baylibre 2026-03-07 13:58:16,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a98bf57ee78ae610cae8ab 2026-03-07 13:58:16,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:58:17,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a98bf57ee78ae610cae8ab HTTP/1.1" 200 None 2026-03-07 13:58:17,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:58:17,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:58:17,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:58:17,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a98bf57ee78ae610cae8ab HTTP/1.1" 200 None 2026-03-07 13:58:17,044 - lava_callback - ERROR - Error processing callback for node 69a98bf57ee78ae610cae8ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44408 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:42:39,469 - lava_callback - INFO - Received callback for node 69a996557ee78ae610caeb35 INFO: 172.19.0.1:44412 - "POST /node/69a996557ee78ae610caeb35 HTTP/1.0" 202 Accepted 2026-03-07 14:42:39,474 - lava_callback - INFO - Starting async job submit for node 69a996557ee78ae610caeb35 2026-03-07 14:42:39,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:42:39,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996557ee78ae610caeb35 HTTP/1.1" 200 None 2026-03-07 14:42:39,512 - lava_callback - DEBUG - Processing node 69a996557ee78ae610caeb35: baseline-arm-baylibre 2026-03-07 14:42:39,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a996557ee78ae610caeb35 2026-03-07 14:42:39,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:42:39,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996557ee78ae610caeb35 HTTP/1.1" 200 None 2026-03-07 14:42:39,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:42:39,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:42:39,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:42:39,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a996557ee78ae610caeb35 HTTP/1.1" 200 None 2026-03-07 14:42:39,594 - lava_callback - ERROR - Error processing callback for node 69a996557ee78ae610caeb35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53650 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:43:19,401 - lava_callback - INFO - Received callback for node 69a996807ee78ae610caeb44 INFO: 172.19.0.1:53658 - "POST /node/69a996807ee78ae610caeb44 HTTP/1.0" 202 Accepted 2026-03-07 14:43:19,407 - lava_callback - INFO - Starting async job submit for node 69a996807ee78ae610caeb44 2026-03-07 14:43:19,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:19,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996807ee78ae610caeb44 HTTP/1.1" 200 None 2026-03-07 14:43:19,423 - lava_callback - DEBUG - Processing node 69a996807ee78ae610caeb44: baseline-arm-baylibre 2026-03-07 14:43:19,423 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a996807ee78ae610caeb44 2026-03-07 14:43:19,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:19,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996807ee78ae610caeb44 HTTP/1.1" 200 None 2026-03-07 14:43:19,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:19,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:43:19,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:19,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a996807ee78ae610caeb44 HTTP/1.1" 200 None 2026-03-07 14:43:19,495 - lava_callback - ERROR - Error processing callback for node 69a996807ee78ae610caeb44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53636 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:43:59,517 - lava_callback - INFO - Received callback for node 69a996ad7ee78ae610caeb56 INFO: 172.19.0.1:53642 - "POST /node/69a996ad7ee78ae610caeb56 HTTP/1.0" 202 Accepted 2026-03-07 14:43:59,523 - lava_callback - INFO - Starting async job submit for node 69a996ad7ee78ae610caeb56 2026-03-07 14:43:59,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:59,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996ad7ee78ae610caeb56 HTTP/1.1" 200 None 2026-03-07 14:43:59,538 - lava_callback - DEBUG - Processing node 69a996ad7ee78ae610caeb56: baseline-arm-baylibre 2026-03-07 14:43:59,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a996ad7ee78ae610caeb56 2026-03-07 14:43:59,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:59,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996ad7ee78ae610caeb56 HTTP/1.1" 200 None 2026-03-07 14:43:59,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:59,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:43:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:59,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a996ad7ee78ae610caeb56 HTTP/1.1" 200 None 2026-03-07 14:43:59,594 - lava_callback - ERROR - Error processing callback for node 69a996ad7ee78ae610caeb56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60606 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:44:59,463 - lava_callback - INFO - Received callback for node 69a996da7ee78ae610caeb65 INFO: 172.19.0.1:60618 - "POST /node/69a996da7ee78ae610caeb65 HTTP/1.0" 202 Accepted 2026-03-07 14:44:59,468 - lava_callback - INFO - Starting async job submit for node 69a996da7ee78ae610caeb65 2026-03-07 14:44:59,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:44:59,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996da7ee78ae610caeb65 HTTP/1.1" 200 None 2026-03-07 14:44:59,493 - lava_callback - DEBUG - Processing node 69a996da7ee78ae610caeb65: baseline-arm-baylibre 2026-03-07 14:44:59,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a996da7ee78ae610caeb65 2026-03-07 14:44:59,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:44:59,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996da7ee78ae610caeb65 HTTP/1.1" 200 None 2026-03-07 14:44:59,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:44:59,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:44:59,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:44:59,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a996da7ee78ae610caeb65 HTTP/1.1" 200 None 2026-03-07 14:44:59,547 - lava_callback - ERROR - Error processing callback for node 69a996da7ee78ae610caeb65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54204 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:45:39,565 - lava_callback - INFO - Received callback for node 69a997067ee78ae610caeb7b INFO: 172.19.0.1:54218 - "POST /node/69a997067ee78ae610caeb7b HTTP/1.0" 202 Accepted 2026-03-07 14:45:39,570 - lava_callback - INFO - Starting async job submit for node 69a997067ee78ae610caeb7b 2026-03-07 14:45:39,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:45:39,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997067ee78ae610caeb7b HTTP/1.1" 200 None 2026-03-07 14:45:39,596 - lava_callback - DEBUG - Processing node 69a997067ee78ae610caeb7b: baseline-arm-baylibre 2026-03-07 14:45:39,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a997067ee78ae610caeb7b 2026-03-07 14:45:39,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:45:39,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997067ee78ae610caeb7b HTTP/1.1" 200 None 2026-03-07 14:45:39,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:45:39,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:45:39,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:45:39,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a997067ee78ae610caeb7b HTTP/1.1" 200 None 2026-03-07 14:45:39,647 - lava_callback - ERROR - Error processing callback for node 69a997067ee78ae610caeb7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40390 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:46:19,540 - lava_callback - INFO - Received callback for node 69a997337ee78ae610caeb8e INFO: 172.19.0.1:40402 - "POST /node/69a997337ee78ae610caeb8e HTTP/1.0" 202 Accepted 2026-03-07 14:46:19,546 - lava_callback - INFO - Starting async job submit for node 69a997337ee78ae610caeb8e 2026-03-07 14:46:19,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:19,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997337ee78ae610caeb8e HTTP/1.1" 200 None 2026-03-07 14:46:19,562 - lava_callback - DEBUG - Processing node 69a997337ee78ae610caeb8e: baseline-arm-baylibre 2026-03-07 14:46:19,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a997337ee78ae610caeb8e 2026-03-07 14:46:19,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:19,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997337ee78ae610caeb8e HTTP/1.1" 200 None 2026-03-07 14:46:19,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:19,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:46:19,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:19,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a997337ee78ae610caeb8e HTTP/1.1" 200 None 2026-03-07 14:46:19,647 - lava_callback - ERROR - Error processing callback for node 69a997337ee78ae610caeb8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40792 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:46:59,704 - lava_callback - INFO - Received callback for node 69a9975b7ee78ae610caebb1 INFO: 172.19.0.1:58830 - "POST /node/69a9975b7ee78ae610caebb1 HTTP/1.0" 202 Accepted 2026-03-07 14:46:59,713 - lava_callback - INFO - Starting async job submit for node 69a9975b7ee78ae610caebb1 2026-03-07 14:46:59,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:59,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9975b7ee78ae610caebb1 HTTP/1.1" 200 None 2026-03-07 14:46:59,755 - lava_callback - DEBUG - Processing node 69a9975b7ee78ae610caebb1: baseline-arm-baylibre 2026-03-07 14:46:59,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9975b7ee78ae610caebb1 2026-03-07 14:46:59,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:59,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9975b7ee78ae610caebb1 HTTP/1.1" 200 None 2026-03-07 14:46:59,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:59,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:46:59,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:59,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9975b7ee78ae610caebb1 HTTP/1.1" 200 None 2026-03-07 14:46:59,820 - lava_callback - ERROR - Error processing callback for node 69a9975b7ee78ae610caebb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51030 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:47:39,663 - lava_callback - INFO - Received callback for node 69a997867ee78ae610caebbf INFO: 172.19.0.1:51034 - "POST /node/69a997867ee78ae610caebbf HTTP/1.0" 202 Accepted 2026-03-07 14:47:39,669 - lava_callback - INFO - Starting async job submit for node 69a997867ee78ae610caebbf 2026-03-07 14:47:39,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:47:39,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997867ee78ae610caebbf HTTP/1.1" 200 None 2026-03-07 14:47:39,690 - lava_callback - DEBUG - Processing node 69a997867ee78ae610caebbf: baseline-arm-baylibre 2026-03-07 14:47:39,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a997867ee78ae610caebbf 2026-03-07 14:47:39,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:47:39,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997867ee78ae610caebbf HTTP/1.1" 200 None 2026-03-07 14:47:39,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:47:39,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:47:39,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:47:39,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a997867ee78ae610caebbf HTTP/1.1" 200 None 2026-03-07 14:47:39,747 - lava_callback - ERROR - Error processing callback for node 69a997867ee78ae610caebbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39116 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:48:39,672 - lava_callback - INFO - Received callback for node 69a997b27ee78ae610caebd4 INFO: 172.19.0.1:39126 - "POST /node/69a997b27ee78ae610caebd4 HTTP/1.0" 202 Accepted 2026-03-07 14:48:39,677 - lava_callback - INFO - Starting async job submit for node 69a997b27ee78ae610caebd4 2026-03-07 14:48:39,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:48:39,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997b27ee78ae610caebd4 HTTP/1.1" 200 None 2026-03-07 14:48:39,697 - lava_callback - DEBUG - Processing node 69a997b27ee78ae610caebd4: baseline-arm-baylibre 2026-03-07 14:48:39,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a997b27ee78ae610caebd4 2026-03-07 14:48:39,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:48:39,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997b27ee78ae610caebd4 HTTP/1.1" 200 None 2026-03-07 14:48:39,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:48:39,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:48:39,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:48:39,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a997b27ee78ae610caebd4 HTTP/1.1" 200 None 2026-03-07 14:48:39,752 - lava_callback - ERROR - Error processing callback for node 69a997b27ee78ae610caebd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46250 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:49:19,709 - lava_callback - INFO - Received callback for node 69a997e07ee78ae610caebfe INFO: 172.19.0.1:37572 - "POST /node/69a997e07ee78ae610caebfe HTTP/1.0" 202 Accepted 2026-03-07 14:49:19,715 - lava_callback - INFO - Starting async job submit for node 69a997e07ee78ae610caebfe 2026-03-07 14:49:19,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:49:19,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997e07ee78ae610caebfe HTTP/1.1" 200 None 2026-03-07 14:49:19,730 - lava_callback - DEBUG - Processing node 69a997e07ee78ae610caebfe: baseline-arm-baylibre 2026-03-07 14:49:19,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a997e07ee78ae610caebfe 2026-03-07 14:49:19,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:49:19,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997e07ee78ae610caebfe HTTP/1.1" 200 None 2026-03-07 14:49:19,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:49:19,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:49:19,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:49:19,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a997e07ee78ae610caebfe HTTP/1.1" 200 None 2026-03-07 14:49:19,795 - lava_callback - ERROR - Error processing callback for node 69a997e07ee78ae610caebfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47018 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:52:19,924 - lava_callback - INFO - Received callback for node 69a998937ee78ae610caec50 INFO: 172.19.0.1:55732 - "POST /node/69a998937ee78ae610caec50 HTTP/1.0" 202 Accepted 2026-03-07 14:52:19,929 - lava_callback - INFO - Starting async job submit for node 69a998937ee78ae610caec50 2026-03-07 14:52:19,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:52:19,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a998937ee78ae610caec50 HTTP/1.1" 200 None 2026-03-07 14:52:19,945 - lava_callback - DEBUG - Processing node 69a998937ee78ae610caec50: baseline-arm-baylibre 2026-03-07 14:52:19,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a998937ee78ae610caec50 2026-03-07 14:52:19,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:52:19,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a998937ee78ae610caec50 HTTP/1.1" 200 None 2026-03-07 14:52:19,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:52:19,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:52:19,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:52:19,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a998937ee78ae610caec50 HTTP/1.1" 200 None 2026-03-07 14:52:19,997 - lava_callback - ERROR - Error processing callback for node 69a998937ee78ae610caec50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57554 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:52:59,972 - lava_callback - INFO - Received callback for node 69a998c17ee78ae610caec6f INFO: 172.19.0.1:43492 - "POST /node/69a998c17ee78ae610caec6f HTTP/1.0" 202 Accepted 2026-03-07 14:52:59,977 - lava_callback - INFO - Starting async job submit for node 69a998c17ee78ae610caec6f 2026-03-07 14:52:59,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:52:59,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a998c17ee78ae610caec6f HTTP/1.1" 200 None 2026-03-07 14:52:59,993 - lava_callback - DEBUG - Processing node 69a998c17ee78ae610caec6f: baseline-arm-baylibre 2026-03-07 14:52:59,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a998c17ee78ae610caec6f 2026-03-07 14:52:59,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:53:00,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a998c17ee78ae610caec6f HTTP/1.1" 200 None 2026-03-07 14:53:00,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:53:00,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:53:00,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:53:00,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a998c17ee78ae610caec6f HTTP/1.1" 200 None 2026-03-07 14:53:00,058 - lava_callback - ERROR - Error processing callback for node 69a998c17ee78ae610caec6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35934 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:55:00,196 - lava_callback - INFO - Received callback for node 69a9993f7ee78ae610caecca INFO: 172.19.0.1:41032 - "POST /node/69a9993f7ee78ae610caecca HTTP/1.0" 202 Accepted 2026-03-07 14:55:00,201 - lava_callback - INFO - Starting async job submit for node 69a9993f7ee78ae610caecca 2026-03-07 14:55:00,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:55:00,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9993f7ee78ae610caecca HTTP/1.1" 200 None 2026-03-07 14:55:00,217 - lava_callback - DEBUG - Processing node 69a9993f7ee78ae610caecca: baseline-arm-baylibre 2026-03-07 14:55:00,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9993f7ee78ae610caecca 2026-03-07 14:55:00,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:55:00,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9993f7ee78ae610caecca HTTP/1.1" 200 None 2026-03-07 14:55:00,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:55:00,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:55:00,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:55:00,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9993f7ee78ae610caecca HTTP/1.1" 200 None 2026-03-07 14:55:00,279 - lava_callback - ERROR - Error processing callback for node 69a9993f7ee78ae610caecca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47234 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:56:00,032 - lava_callback - INFO - Received callback for node 69a9996b7ee78ae610caece7 INFO: 172.19.0.1:39694 - "POST /node/69a9996b7ee78ae610caece7 HTTP/1.0" 202 Accepted 2026-03-07 14:56:00,038 - lava_callback - INFO - Starting async job submit for node 69a9996b7ee78ae610caece7 2026-03-07 14:56:00,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:00,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9996b7ee78ae610caece7 HTTP/1.1" 200 None 2026-03-07 14:56:00,064 - lava_callback - DEBUG - Processing node 69a9996b7ee78ae610caece7: baseline-arm-baylibre 2026-03-07 14:56:00,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9996b7ee78ae610caece7 2026-03-07 14:56:00,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:00,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9996b7ee78ae610caece7 HTTP/1.1" 200 None 2026-03-07 14:56:00,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:00,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:56:00,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:00,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9996b7ee78ae610caece7 HTTP/1.1" 200 None 2026-03-07 14:56:00,126 - lava_callback - ERROR - Error processing callback for node 69a9996b7ee78ae610caece7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41754 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:56:40,150 - lava_callback - INFO - Received callback for node 69a999977ee78ae610caed04 INFO: 172.19.0.1:39888 - "POST /node/69a999977ee78ae610caed04 HTTP/1.0" 202 Accepted 2026-03-07 14:56:40,156 - lava_callback - INFO - Starting async job submit for node 69a999977ee78ae610caed04 2026-03-07 14:56:40,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:40,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999977ee78ae610caed04 HTTP/1.1" 200 None 2026-03-07 14:56:40,172 - lava_callback - DEBUG - Processing node 69a999977ee78ae610caed04: baseline-arm-baylibre 2026-03-07 14:56:40,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a999977ee78ae610caed04 2026-03-07 14:56:40,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:40,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999977ee78ae610caed04 HTTP/1.1" 200 None 2026-03-07 14:56:40,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:40,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:56:40,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:40,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a999977ee78ae610caed04 HTTP/1.1" 200 None 2026-03-07 14:56:40,225 - lava_callback - ERROR - Error processing callback for node 69a999977ee78ae610caed04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37668 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:57:20,132 - lava_callback - INFO - Received callback for node 69a999c37ee78ae610caed1c INFO: 172.19.0.1:57850 - "POST /node/69a999c37ee78ae610caed1c HTTP/1.0" 202 Accepted 2026-03-07 14:57:20,137 - lava_callback - INFO - Starting async job submit for node 69a999c37ee78ae610caed1c 2026-03-07 14:57:20,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:57:20,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999c37ee78ae610caed1c HTTP/1.1" 200 None 2026-03-07 14:57:20,153 - lava_callback - DEBUG - Processing node 69a999c37ee78ae610caed1c: baseline-arm-baylibre 2026-03-07 14:57:20,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a999c37ee78ae610caed1c 2026-03-07 14:57:20,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:57:20,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999c37ee78ae610caed1c HTTP/1.1" 200 None 2026-03-07 14:57:20,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:57:20,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:57:20,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:57:20,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a999c37ee78ae610caed1c HTTP/1.1" 200 None 2026-03-07 14:57:20,209 - lava_callback - ERROR - Error processing callback for node 69a999c37ee78ae610caed1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59804 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:58:00,238 - lava_callback - INFO - Received callback for node 69a999f07ee78ae610caed36 INFO: 172.19.0.1:43994 - "POST /node/69a999f07ee78ae610caed36 HTTP/1.0" 202 Accepted 2026-03-07 14:58:00,244 - lava_callback - INFO - Starting async job submit for node 69a999f07ee78ae610caed36 2026-03-07 14:58:00,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:00,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999f07ee78ae610caed36 HTTP/1.1" 200 None 2026-03-07 14:58:00,259 - lava_callback - DEBUG - Processing node 69a999f07ee78ae610caed36: baseline-arm-baylibre 2026-03-07 14:58:00,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a999f07ee78ae610caed36 2026-03-07 14:58:00,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:00,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999f07ee78ae610caed36 HTTP/1.1" 200 None 2026-03-07 14:58:00,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:00,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:58:00,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:00,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a999f07ee78ae610caed36 HTTP/1.1" 200 None 2026-03-07 14:58:00,319 - lava_callback - ERROR - Error processing callback for node 69a999f07ee78ae610caed36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39812 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:58:40,395 - lava_callback - INFO - Received callback for node 69a99a1c7ee78ae610caed4e INFO: 172.19.0.1:59968 - "POST /node/69a99a1c7ee78ae610caed4e HTTP/1.0" 202 Accepted 2026-03-07 14:58:40,400 - lava_callback - INFO - Starting async job submit for node 69a99a1c7ee78ae610caed4e 2026-03-07 14:58:40,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:40,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99a1c7ee78ae610caed4e HTTP/1.1" 200 None 2026-03-07 14:58:40,421 - lava_callback - DEBUG - Processing node 69a99a1c7ee78ae610caed4e: baseline-arm-baylibre 2026-03-07 14:58:40,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99a1c7ee78ae610caed4e 2026-03-07 14:58:40,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:40,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99a1c7ee78ae610caed4e HTTP/1.1" 200 None 2026-03-07 14:58:40,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:40,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:58:40,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:40,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99a1c7ee78ae610caed4e HTTP/1.1" 200 None 2026-03-07 14:58:40,482 - lava_callback - ERROR - Error processing callback for node 69a99a1c7ee78ae610caed4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60108 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:01:09,161 - lava_callback - INFO - Received callback for node 69a99aa17ee78ae610caedac INFO: 172.19.0.1:60120 - "POST /node/69a99aa17ee78ae610caedac HTTP/1.0" 202 Accepted 2026-03-07 15:01:09,170 - lava_callback - INFO - Starting async job submit for node 69a99aa17ee78ae610caedac 2026-03-07 15:01:09,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:09,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99aa17ee78ae610caedac HTTP/1.1" 200 None 2026-03-07 15:01:09,194 - lava_callback - DEBUG - Processing node 69a99aa17ee78ae610caedac: baseline-arm-clabbe 2026-03-07 15:01:09,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99aa17ee78ae610caedac 2026-03-07 15:01:09,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:09,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99aa17ee78ae610caedac HTTP/1.1" 200 None 2026-03-07 15:01:09,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:09,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 15:01:09,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:09,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99aa17ee78ae610caedac HTTP/1.1" 200 None 2026-03-07 15:01:09,284 - lava_callback - ERROR - Error processing callback for node 69a99aa17ee78ae610caedac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60178 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:01:49,231 - lava_callback - INFO - Received callback for node 69a99ace7ee78ae610caedc9 INFO: 172.19.0.1:60184 - "POST /node/69a99ace7ee78ae610caedc9 HTTP/1.0" 202 Accepted 2026-03-07 15:01:49,236 - lava_callback - INFO - Starting async job submit for node 69a99ace7ee78ae610caedc9 2026-03-07 15:01:49,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:49,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99ace7ee78ae610caedc9 HTTP/1.1" 200 None 2026-03-07 15:01:49,253 - lava_callback - DEBUG - Processing node 69a99ace7ee78ae610caedc9: baseline-arm-clabbe 2026-03-07 15:01:49,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99ace7ee78ae610caedc9 2026-03-07 15:01:49,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:49,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99ace7ee78ae610caedc9 HTTP/1.1" 200 None 2026-03-07 15:01:49,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:49,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 15:01:49,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:49,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99ace7ee78ae610caedc9 HTTP/1.1" 200 None 2026-03-07 15:01:49,309 - lava_callback - ERROR - Error processing callback for node 69a99ace7ee78ae610caedc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48440 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:09:00,862 - lava_callback - INFO - Received callback for node 69a99c7a7ee78ae610caeee0 INFO: 172.19.0.1:57378 - "POST /node/69a99c7a7ee78ae610caeee0 HTTP/1.0" 202 Accepted 2026-03-07 15:09:00,871 - lava_callback - INFO - Starting async job submit for node 69a99c7a7ee78ae610caeee0 2026-03-07 15:09:00,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:09:00,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99c7a7ee78ae610caeee0 HTTP/1.1" 200 None 2026-03-07 15:09:00,897 - lava_callback - DEBUG - Processing node 69a99c7a7ee78ae610caeee0: baseline-arm64-baylibre 2026-03-07 15:09:00,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99c7a7ee78ae610caeee0 2026-03-07 15:09:00,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:09:00,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99c7a7ee78ae610caeee0 HTTP/1.1" 200 None 2026-03-07 15:09:00,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:09:00,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 15:09:00,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:09:00,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99c7a7ee78ae610caeee0 HTTP/1.1" 200 None 2026-03-07 15:09:00,978 - lava_callback - ERROR - Error processing callback for node 69a99c7a7ee78ae610caeee0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45110 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:10:20,889 - lava_callback - INFO - Received callback for node 69a99cce7ee78ae610caef0a INFO: 172.19.0.1:33256 - "POST /node/69a99cce7ee78ae610caef0a HTTP/1.0" 202 Accepted 2026-03-07 15:10:20,895 - lava_callback - INFO - Starting async job submit for node 69a99cce7ee78ae610caef0a 2026-03-07 15:10:20,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:10:20,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99cce7ee78ae610caef0a HTTP/1.1" 200 None 2026-03-07 15:10:20,911 - lava_callback - DEBUG - Processing node 69a99cce7ee78ae610caef0a: baseline-arm64-baylibre 2026-03-07 15:10:20,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99cce7ee78ae610caef0a 2026-03-07 15:10:20,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:10:20,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99cce7ee78ae610caef0a HTTP/1.1" 200 None 2026-03-07 15:10:20,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:10:20,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 15:10:20,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:10:20,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99cce7ee78ae610caef0a HTTP/1.1" 200 None 2026-03-07 15:10:20,983 - lava_callback - ERROR - Error processing callback for node 69a99cce7ee78ae610caef0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50084 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:11:40,990 - lava_callback - INFO - Received callback for node 69a99d267ee78ae610caef35 INFO: 172.19.0.1:37858 - "POST /node/69a99d267ee78ae610caef35 HTTP/1.0" 202 Accepted 2026-03-07 15:11:40,995 - lava_callback - INFO - Starting async job submit for node 69a99d267ee78ae610caef35 2026-03-07 15:11:40,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:11:41,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99d267ee78ae610caef35 HTTP/1.1" 200 None 2026-03-07 15:11:41,010 - lava_callback - DEBUG - Processing node 69a99d267ee78ae610caef35: baseline-arm64-baylibre 2026-03-07 15:11:41,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99d267ee78ae610caef35 2026-03-07 15:11:41,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:11:41,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99d267ee78ae610caef35 HTTP/1.1" 200 None 2026-03-07 15:11:41,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:11:41,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 15:11:41,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:11:41,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99d267ee78ae610caef35 HTTP/1.1" 200 None 2026-03-07 15:11:41,073 - lava_callback - ERROR - Error processing callback for node 69a99d267ee78ae610caef35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51194 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:13:01,045 - lava_callback - INFO - Received callback for node 69a99d7a7ee78ae610caef65 INFO: 172.19.0.1:34006 - "POST /node/69a99d7a7ee78ae610caef65 HTTP/1.0" 202 Accepted 2026-03-07 15:13:01,051 - lava_callback - INFO - Starting async job submit for node 69a99d7a7ee78ae610caef65 2026-03-07 15:13:01,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:13:01,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99d7a7ee78ae610caef65 HTTP/1.1" 200 None 2026-03-07 15:13:01,067 - lava_callback - DEBUG - Processing node 69a99d7a7ee78ae610caef65: baseline-arm64-baylibre 2026-03-07 15:13:01,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99d7a7ee78ae610caef65 2026-03-07 15:13:01,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:13:01,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99d7a7ee78ae610caef65 HTTP/1.1" 200 None 2026-03-07 15:13:01,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:13:01,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 15:13:01,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:13:01,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99d7a7ee78ae610caef65 HTTP/1.1" 200 None 2026-03-07 15:13:01,126 - lava_callback - ERROR - Error processing callback for node 69a99d7a7ee78ae610caef65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35356 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:14:49,781 - lava_callback - INFO - Received callback for node 69a99dd57ee78ae610caef8e INFO: 172.19.0.1:50326 - "POST /node/69a99dd57ee78ae610caef8e HTTP/1.0" 202 Accepted 2026-03-07 15:14:49,786 - lava_callback - INFO - Starting async job submit for node 69a99dd57ee78ae610caef8e 2026-03-07 15:14:49,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:14:49,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99dd57ee78ae610caef8e HTTP/1.1" 200 None 2026-03-07 15:14:49,824 - lava_callback - DEBUG - Processing node 69a99dd57ee78ae610caef8e: baseline-arm64-clabbe 2026-03-07 15:14:49,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99dd57ee78ae610caef8e 2026-03-07 15:14:49,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:14:49,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99dd57ee78ae610caef8e HTTP/1.1" 200 None 2026-03-07 15:14:49,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:14:49,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 15:14:49,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:14:49,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99dd57ee78ae610caef8e HTTP/1.1" 200 None 2026-03-07 15:14:49,882 - lava_callback - ERROR - Error processing callback for node 69a99dd57ee78ae610caef8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56008 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:19:01,434 - lava_callback - INFO - Received callback for node 69a99ed57ee78ae610caeff5 INFO: 172.19.0.1:35346 - "POST /node/69a99ed57ee78ae610caeff5 HTTP/1.0" 202 Accepted 2026-03-07 15:19:01,442 - lava_callback - INFO - Starting async job submit for node 69a99ed57ee78ae610caeff5 2026-03-07 15:19:01,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:19:01,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99ed57ee78ae610caeff5 HTTP/1.1" 200 None 2026-03-07 15:19:01,458 - lava_callback - DEBUG - Processing node 69a99ed57ee78ae610caeff5: baseline-arm64-baylibre 2026-03-07 15:19:01,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99ed57ee78ae610caeff5 2026-03-07 15:19:01,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:19:01,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99ed57ee78ae610caeff5 HTTP/1.1" 200 None 2026-03-07 15:19:01,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:19:01,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6edb32da7ccec10683eaa HTTP/1.1" 200 None 2026-03-07 15:19:01,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:19:01,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99ed57ee78ae610caeff5 HTTP/1.1" 200 None 2026-03-07 15:19:01,516 - lava_callback - ERROR - Error processing callback for node 69a99ed57ee78ae610caeff5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37112 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41956 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:20:21,481 - lava_callback - INFO - Received callback for node 69a99f2a7ee78ae610caf027 INFO: 172.19.0.1:58092 - "POST /node/69a99f2a7ee78ae610caf027 HTTP/1.0" 202 Accepted 2026-03-07 15:20:21,486 - lava_callback - INFO - Starting async job submit for node 69a99f2a7ee78ae610caf027 2026-03-07 15:20:21,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:20:21,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99f2a7ee78ae610caf027 HTTP/1.1" 200 None 2026-03-07 15:20:21,507 - lava_callback - DEBUG - Processing node 69a99f2a7ee78ae610caf027: baseline-arm64-baylibre 2026-03-07 15:20:21,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99f2a7ee78ae610caf027 2026-03-07 15:20:21,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:20:21,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99f2a7ee78ae610caf027 HTTP/1.1" 200 None 2026-03-07 15:20:21,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:20:21,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6edb32da7ccec10683eaa HTTP/1.1" 200 None 2026-03-07 15:20:21,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:20:21,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99f2a7ee78ae610caf027 HTTP/1.1" 200 None 2026-03-07 15:20:21,566 - lava_callback - ERROR - Error processing callback for node 69a99f2a7ee78ae610caf027: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51624 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:23:21,573 - lava_callback - INFO - Received callback for node 69a99fd47ee78ae610caf078 INFO: 172.19.0.1:36464 - "POST /node/69a99fd47ee78ae610caf078 HTTP/1.0" 202 Accepted 2026-03-07 15:23:21,578 - lava_callback - INFO - Starting async job submit for node 69a99fd47ee78ae610caf078 2026-03-07 15:23:21,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:23:21,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99fd47ee78ae610caf078 HTTP/1.1" 200 None 2026-03-07 15:23:21,594 - lava_callback - DEBUG - Processing node 69a99fd47ee78ae610caf078: baseline-arm64-baylibre 2026-03-07 15:23:21,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99fd47ee78ae610caf078 2026-03-07 15:23:21,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:23:21,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99fd47ee78ae610caf078 HTTP/1.1" 200 None 2026-03-07 15:23:21,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:23:21,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6edb32da7ccec10683eaa HTTP/1.1" 200 None 2026-03-07 15:23:21,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:23:21,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99fd47ee78ae610caf078 HTTP/1.1" 200 None 2026-03-07 15:23:21,664 - lava_callback - ERROR - Error processing callback for node 69a99fd47ee78ae610caf078: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37178 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:24:21,623 - lava_callback - INFO - Received callback for node 69a9a01b7ee78ae610caf099 INFO: 172.19.0.1:45464 - "POST /node/69a9a01b7ee78ae610caf099 HTTP/1.0" 202 Accepted 2026-03-07 15:24:21,629 - lava_callback - INFO - Starting async job submit for node 69a9a01b7ee78ae610caf099 2026-03-07 15:24:21,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:24:21,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a01b7ee78ae610caf099 HTTP/1.1" 200 None 2026-03-07 15:24:21,644 - lava_callback - DEBUG - Processing node 69a9a01b7ee78ae610caf099: baseline-arm-baylibre 2026-03-07 15:24:21,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a01b7ee78ae610caf099 2026-03-07 15:24:21,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:24:21,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a01b7ee78ae610caf099 HTTP/1.1" 200 None 2026-03-07 15:24:21,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:24:21,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:24:21,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:24:21,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a01b7ee78ae610caf099 HTTP/1.1" 200 None 2026-03-07 15:24:21,711 - lava_callback - ERROR - Error processing callback for node 69a9a01b7ee78ae610caf099: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57682 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:25:01,662 - lava_callback - INFO - Received callback for node 69a9a0467ee78ae610caf0bb INFO: 172.19.0.1:39720 - "POST /node/69a9a0467ee78ae610caf0bb HTTP/1.0" 202 Accepted 2026-03-07 15:25:01,668 - lava_callback - INFO - Starting async job submit for node 69a9a0467ee78ae610caf0bb 2026-03-07 15:25:01,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:01,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0467ee78ae610caf0bb HTTP/1.1" 200 None 2026-03-07 15:25:01,693 - lava_callback - DEBUG - Processing node 69a9a0467ee78ae610caf0bb: baseline-arm-baylibre 2026-03-07 15:25:01,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a0467ee78ae610caf0bb 2026-03-07 15:25:01,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:01,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0467ee78ae610caf0bb HTTP/1.1" 200 None 2026-03-07 15:25:01,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:01,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:25:01,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:01,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a0467ee78ae610caf0bb HTTP/1.1" 200 None 2026-03-07 15:25:01,752 - lava_callback - ERROR - Error processing callback for node 69a9a0467ee78ae610caf0bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39552 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:25:41,685 - lava_callback - INFO - Received callback for node 69a9a0727ee78ae610caf0c7 INFO: 172.19.0.1:58670 - "POST /node/69a9a0727ee78ae610caf0c7 HTTP/1.0" 202 Accepted 2026-03-07 15:25:41,690 - lava_callback - INFO - Starting async job submit for node 69a9a0727ee78ae610caf0c7 2026-03-07 15:25:41,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:41,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0727ee78ae610caf0c7 HTTP/1.1" 200 None 2026-03-07 15:25:41,706 - lava_callback - DEBUG - Processing node 69a9a0727ee78ae610caf0c7: baseline-arm-baylibre 2026-03-07 15:25:41,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a0727ee78ae610caf0c7 2026-03-07 15:25:41,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:41,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0727ee78ae610caf0c7 HTTP/1.1" 200 None 2026-03-07 15:25:41,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:41,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:25:41,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:41,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a0727ee78ae610caf0c7 HTTP/1.1" 200 None 2026-03-07 15:25:41,795 - lava_callback - ERROR - Error processing callback for node 69a9a0727ee78ae610caf0c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34282 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:26:41,773 - lava_callback - INFO - Received callback for node 69a9a09f7ee78ae610caf0d9 INFO: 172.19.0.1:39540 - "POST /node/69a9a09f7ee78ae610caf0d9 HTTP/1.0" 202 Accepted 2026-03-07 15:26:41,779 - lava_callback - INFO - Starting async job submit for node 69a9a09f7ee78ae610caf0d9 2026-03-07 15:26:41,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:26:41,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a09f7ee78ae610caf0d9 HTTP/1.1" 200 None 2026-03-07 15:26:41,800 - lava_callback - DEBUG - Processing node 69a9a09f7ee78ae610caf0d9: baseline-arm-baylibre 2026-03-07 15:26:41,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a09f7ee78ae610caf0d9 2026-03-07 15:26:41,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:26:41,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a09f7ee78ae610caf0d9 HTTP/1.1" 200 None 2026-03-07 15:26:41,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:26:41,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:26:41,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:26:41,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a09f7ee78ae610caf0d9 HTTP/1.1" 200 None 2026-03-07 15:26:41,874 - lava_callback - ERROR - Error processing callback for node 69a9a09f7ee78ae610caf0d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53288 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:27:21,758 - lava_callback - INFO - Received callback for node 69a9a0c97ee78ae610caf0ed INFO: 172.19.0.1:43204 - "POST /node/69a9a0c97ee78ae610caf0ed HTTP/1.0" 202 Accepted 2026-03-07 15:27:21,764 - lava_callback - INFO - Starting async job submit for node 69a9a0c97ee78ae610caf0ed 2026-03-07 15:27:21,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:27:21,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0c97ee78ae610caf0ed HTTP/1.1" 200 None 2026-03-07 15:27:21,785 - lava_callback - DEBUG - Processing node 69a9a0c97ee78ae610caf0ed: baseline-arm-baylibre 2026-03-07 15:27:21,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a0c97ee78ae610caf0ed 2026-03-07 15:27:21,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:27:21,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0c97ee78ae610caf0ed HTTP/1.1" 200 None 2026-03-07 15:27:21,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:27:21,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:27:21,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:27:21,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a0c97ee78ae610caf0ed HTTP/1.1" 200 None 2026-03-07 15:27:21,840 - lava_callback - ERROR - Error processing callback for node 69a9a0c97ee78ae610caf0ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52316 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:28:01,861 - lava_callback - INFO - Received callback for node 69a9a0f57ee78ae610caf116 INFO: 172.19.0.1:52322 - "POST /node/69a9a0f57ee78ae610caf116 HTTP/1.0" 202 Accepted 2026-03-07 15:28:01,867 - lava_callback - INFO - Starting async job submit for node 69a9a0f57ee78ae610caf116 2026-03-07 15:28:01,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:28:01,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0f57ee78ae610caf116 HTTP/1.1" 200 None 2026-03-07 15:28:01,883 - lava_callback - DEBUG - Processing node 69a9a0f57ee78ae610caf116: baseline-arm-baylibre 2026-03-07 15:28:01,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a0f57ee78ae610caf116 2026-03-07 15:28:01,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:28:01,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0f57ee78ae610caf116 HTTP/1.1" 200 None 2026-03-07 15:28:01,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:28:01,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:28:01,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:28:01,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a0f57ee78ae610caf116 HTTP/1.1" 200 None 2026-03-07 15:28:01,935 - lava_callback - ERROR - Error processing callback for node 69a9a0f57ee78ae610caf116: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57166 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:35:22,220 - lava_callback - INFO - Received callback for node 69a9a2b67ee78ae610caf1c9 INFO: 172.19.0.1:42198 - "POST /node/69a9a2b67ee78ae610caf1c9 HTTP/1.0" 202 Accepted 2026-03-07 15:35:22,227 - lava_callback - INFO - Starting async job submit for node 69a9a2b67ee78ae610caf1c9 2026-03-07 15:35:22,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:35:22,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a2b67ee78ae610caf1c9 HTTP/1.1" 200 None 2026-03-07 15:35:22,243 - lava_callback - DEBUG - Processing node 69a9a2b67ee78ae610caf1c9: baseline-arm64-baylibre 2026-03-07 15:35:22,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a2b67ee78ae610caf1c9 2026-03-07 15:35:22,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:35:22,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a2b67ee78ae610caf1c9 HTTP/1.1" 200 None 2026-03-07 15:35:22,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:35:22,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 15:35:22,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:35:22,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a2b67ee78ae610caf1c9 HTTP/1.1" 200 None 2026-03-07 15:35:22,297 - lava_callback - ERROR - Error processing callback for node 69a9a2b67ee78ae610caf1c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50886 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:38:22,382 - lava_callback - INFO - Received callback for node 69a9a3627ee78ae610caf208 INFO: 172.19.0.1:42906 - "POST /node/69a9a3627ee78ae610caf208 HTTP/1.0" 202 Accepted 2026-03-07 15:38:22,387 - lava_callback - INFO - Starting async job submit for node 69a9a3627ee78ae610caf208 2026-03-07 15:38:22,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:38:22,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a3627ee78ae610caf208 HTTP/1.1" 200 None 2026-03-07 15:38:22,403 - lava_callback - DEBUG - Processing node 69a9a3627ee78ae610caf208: baseline-arm64-baylibre 2026-03-07 15:38:22,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a3627ee78ae610caf208 2026-03-07 15:38:22,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:38:22,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a3627ee78ae610caf208 HTTP/1.1" 200 None 2026-03-07 15:38:22,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:38:22,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 15:38:22,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:38:22,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a3627ee78ae610caf208 HTTP/1.1" 200 None 2026-03-07 15:38:22,498 - lava_callback - ERROR - Error processing callback for node 69a9a3627ee78ae610caf208: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39850 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:50:23,072 - lava_callback - INFO - Received callback for node 69a9a6297ee78ae610caf2f0 INFO: 172.19.0.1:56604 - "POST /node/69a9a6297ee78ae610caf2f0 HTTP/1.0" 202 Accepted 2026-03-07 15:50:23,077 - lava_callback - INFO - Starting async job submit for node 69a9a6297ee78ae610caf2f0 2026-03-07 15:50:23,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:50:23,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a6297ee78ae610caf2f0 HTTP/1.1" 200 None 2026-03-07 15:50:23,093 - lava_callback - DEBUG - Processing node 69a9a6297ee78ae610caf2f0: baseline-arm64-baylibre 2026-03-07 15:50:23,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a6297ee78ae610caf2f0 2026-03-07 15:50:23,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:50:23,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a6297ee78ae610caf2f0 HTTP/1.1" 200 None 2026-03-07 15:50:23,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:50:23,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 15:50:23,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:50:23,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a6297ee78ae610caf2f0 HTTP/1.1" 200 None 2026-03-07 15:50:23,150 - lava_callback - ERROR - Error processing callback for node 69a9a6297ee78ae610caf2f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48868 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:02:40,398 - lava_callback - INFO - Received callback for node 69abe9d040deb775998f445c INFO: 172.19.0.1:32878 - "POST /node/69abe9d040deb775998f445c HTTP/1.0" 202 Accepted 2026-03-07 16:02:40,404 - lava_callback - INFO - Starting async job submit for node 69abe9d040deb775998f445c 2026-03-07 16:02:40,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:40,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9d040deb775998f445c HTTP/1.1" 200 None 2026-03-07 16:02:40,424 - lava_callback - DEBUG - Processing node 69abe9d040deb775998f445c: baseline-arm64-foundriesio 2026-03-07 16:02:40,432 - lava_callback - WARNING - Failed to upload log 2026-03-07 16:02:40,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:02:40,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:02:40,642 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69abe9d040deb775998f445c/lava-logs.yaml 2026-03-07 16:02:40,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:02:40,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:02:40,796 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69abe9d040deb775998f445c/lava_callback.json.gz 2026-03-07 16:02:40,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:40,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9d040deb775998f445c HTTP/1.1" 200 None 2026-03-07 16:02:40,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:40,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 16:02:40,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:40,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9d040deb775998f445c HTTP/1.1" 200 None 2026-03-07 16:02:40,859 - lava_callback - INFO - Completed processing callback for node 69abe9d040deb775998f445c INFO: 172.19.0.1:32888 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:02:52,087 - lava_callback - INFO - Received callback for node 69abe9cf40deb775998f4455 INFO: 172.19.0.1:45158 - "POST /node/69abe9cf40deb775998f4455 HTTP/1.0" 202 Accepted 2026-03-07 16:02:52,092 - lava_callback - INFO - Starting async job submit for node 69abe9cf40deb775998f4455 2026-03-07 16:02:52,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:52,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cf40deb775998f4455 HTTP/1.1" 200 None 2026-03-07 16:02:52,111 - lava_callback - DEBUG - Processing node 69abe9cf40deb775998f4455: baseline-arm64-foundriesio 2026-03-07 16:02:52,118 - lava_callback - WARNING - Failed to upload log 2026-03-07 16:02:52,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:02:52,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:02:52,292 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69abe9cf40deb775998f4455/lava-logs.yaml 2026-03-07 16:02:52,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:02:52,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:02:52,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69abe9cf40deb775998f4455/lava_callback.json.gz 2026-03-07 16:02:52,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:52,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cf40deb775998f4455 HTTP/1.1" 200 None 2026-03-07 16:02:52,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:52,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 16:02:52,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:52,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9cf40deb775998f4455 HTTP/1.1" 200 None 2026-03-07 16:02:52,565 - lava_callback - INFO - Completed processing callback for node 69abe9cf40deb775998f4455 INFO: 172.19.0.1:45160 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:03:01,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:03:01,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55170 - "GET /node/698c536b755d7811a4141690%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:55172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33510 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:11:32,907 - lava_callback - INFO - Received callback for node 69ac432140deb775998f5ed9 INFO: 172.19.0.1:35768 - "POST /node/69ac432140deb775998f5ed9 HTTP/1.0" 202 Accepted 2026-03-07 16:11:32,917 - lava_callback - INFO - Starting async job submit for node 69ac432140deb775998f5ed9 2026-03-07 16:11:32,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:32,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac432140deb775998f5ed9 HTTP/1.1" 200 None 2026-03-07 16:11:32,945 - lava_callback - DEBUG - Processing node 69ac432140deb775998f5ed9: baseline-arm64-foundriesio 2026-03-07 16:11:32,957 - lava_callback - WARNING - Failed to upload log 2026-03-07 16:11:32,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:11:33,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:11:33,159 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ac432140deb775998f5ed9/lava-logs.yaml 2026-03-07 16:11:33,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:11:33,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:11:33,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ac432140deb775998f5ed9/lava_callback.json.gz 2026-03-07 16:11:33,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:33,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac432140deb775998f5ed9 HTTP/1.1" 200 None 2026-03-07 16:11:33,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:33,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 16:11:33,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:33,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac432140deb775998f5ed9 HTTP/1.1" 200 None 2026-03-07 16:11:33,481 - lava_callback - INFO - Completed processing callback for node 69ac432140deb775998f5ed9 INFO: 172.19.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41094 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:11:48,315 - lava_callback - INFO - Received callback for node 69ac42da40deb775998f5ebd INFO: 172.19.0.1:41106 - "POST /node/69ac42da40deb775998f5ebd HTTP/1.0" 202 Accepted 2026-03-07 16:11:48,323 - lava_callback - INFO - Starting async job submit for node 69ac42da40deb775998f5ebd 2026-03-07 16:11:48,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:48,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac42da40deb775998f5ebd HTTP/1.1" 200 None 2026-03-07 16:11:48,348 - lava_callback - DEBUG - Processing node 69ac42da40deb775998f5ebd: baseline-arm64-foundriesio 2026-03-07 16:11:48,362 - lava_callback - WARNING - Failed to upload log 2026-03-07 16:11:48,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:11:48,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:11:48,540 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ac42da40deb775998f5ebd/lava-logs.yaml 2026-03-07 16:11:48,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:11:48,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:11:48,714 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ac42da40deb775998f5ebd/lava_callback.json.gz 2026-03-07 16:11:48,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:48,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac42da40deb775998f5ebd HTTP/1.1" 200 None 2026-03-07 16:11:48,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:48,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 16:11:48,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:48,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac42da40deb775998f5ebd HTTP/1.1" 200 None 2026-03-07 16:11:48,809 - lava_callback - INFO - Completed processing callback for node 69ac42da40deb775998f5ebd INFO: 172.19.0.1:51966 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:12:01,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:12:01,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1] INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.19.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36360 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:38:59,910 - lava_callback - INFO - Received callback for node 69a941227ee78ae610caa9b5 2026-03-07 08:38:59,921 - lava_callback - INFO - Starting async job submit for node 69a941227ee78ae610caa9b5 INFO: 172.19.0.1:37164 - "POST /node/69a941227ee78ae610caa9b5 HTTP/1.0" 202 Accepted 2026-03-07 08:38:59,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:38:59,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941227ee78ae610caa9b5 HTTP/1.1" 200 None 2026-03-07 08:38:59,956 - lava_callback - DEBUG - Processing node 69a941227ee78ae610caa9b5: baseline-arm64-baylibre 2026-03-07 08:38:59,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a941227ee78ae610caa9b5 2026-03-07 08:38:59,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:38:59,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941227ee78ae610caa9b5 HTTP/1.1" 200 None 2026-03-07 08:38:59,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:38:59,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 08:38:59,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:39:00,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a941227ee78ae610caa9b5 HTTP/1.1" 200 None 2026-03-07 08:39:00,046 - lava_callback - ERROR - Error processing callback for node 69a941227ee78ae610caa9b5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37346 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:40:40,002 - lava_callback - INFO - Received callback for node 69a941867ee78ae610caaa0c INFO: 172.19.0.1:38654 - "POST /node/69a941867ee78ae610caaa0c HTTP/1.0" 202 Accepted 2026-03-07 08:40:40,008 - lava_callback - INFO - Starting async job submit for node 69a941867ee78ae610caaa0c 2026-03-07 08:40:40,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:40:40,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941867ee78ae610caaa0c HTTP/1.1" 200 None 2026-03-07 08:40:40,024 - lava_callback - DEBUG - Processing node 69a941867ee78ae610caaa0c: baseline-arm64-baylibre 2026-03-07 08:40:40,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a941867ee78ae610caaa0c 2026-03-07 08:40:40,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:40:40,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941867ee78ae610caaa0c HTTP/1.1" 200 None 2026-03-07 08:40:40,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:40:40,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 08:40:40,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:40:40,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a941867ee78ae610caaa0c HTTP/1.1" 200 None 2026-03-07 08:40:40,078 - lava_callback - ERROR - Error processing callback for node 69a941867ee78ae610caaa0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45356 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:42:00,040 - lava_callback - INFO - Received callback for node 69a941cf7ee78ae610caaa51 INFO: 172.19.0.1:36394 - "POST /node/69a941cf7ee78ae610caaa51 HTTP/1.0" 202 Accepted 2026-03-07 08:42:00,048 - lava_callback - INFO - Starting async job submit for node 69a941cf7ee78ae610caaa51 2026-03-07 08:42:00,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:00,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941cf7ee78ae610caaa51 HTTP/1.1" 200 None 2026-03-07 08:42:00,075 - lava_callback - DEBUG - Processing node 69a941cf7ee78ae610caaa51: baseline-arm-baylibre 2026-03-07 08:42:00,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a941cf7ee78ae610caaa51 2026-03-07 08:42:00,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:00,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941cf7ee78ae610caaa51 HTTP/1.1" 200 None 2026-03-07 08:42:00,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:00,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:42:00,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:00,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a941cf7ee78ae610caaa51 HTTP/1.1" 200 None 2026-03-07 08:42:00,201 - lava_callback - ERROR - Error processing callback for node 69a941cf7ee78ae610caaa51: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54036 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:42:40,026 - lava_callback - INFO - Received callback for node 69a941fd7ee78ae610caaa9b INFO: 172.19.0.1:44328 - "POST /node/69a941fd7ee78ae610caaa9b HTTP/1.0" 202 Accepted 2026-03-07 08:42:40,035 - lava_callback - INFO - Starting async job submit for node 69a941fd7ee78ae610caaa9b 2026-03-07 08:42:40,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:40,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941fd7ee78ae610caaa9b HTTP/1.1" 200 None 2026-03-07 08:42:40,068 - lava_callback - DEBUG - Processing node 69a941fd7ee78ae610caaa9b: baseline-arm-baylibre 2026-03-07 08:42:40,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a941fd7ee78ae610caaa9b 2026-03-07 08:42:40,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:40,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a941fd7ee78ae610caaa9b HTTP/1.1" 200 None 2026-03-07 08:42:40,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:40,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:42:40,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:42:40,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a941fd7ee78ae610caaa9b HTTP/1.1" 200 None 2026-03-07 08:42:40,173 - lava_callback - ERROR - Error processing callback for node 69a941fd7ee78ae610caaa9b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58436 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:43:40,281 - lava_callback - INFO - Received callback for node 69a9422c7ee78ae610caaac1 INFO: 172.19.0.1:49778 - "POST /node/69a9422c7ee78ae610caaac1 HTTP/1.0" 202 Accepted 2026-03-07 08:43:40,287 - lava_callback - INFO - Starting async job submit for node 69a9422c7ee78ae610caaac1 2026-03-07 08:43:40,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:43:40,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9422c7ee78ae610caaac1 HTTP/1.1" 200 None 2026-03-07 08:43:40,303 - lava_callback - DEBUG - Processing node 69a9422c7ee78ae610caaac1: baseline-arm-baylibre 2026-03-07 08:43:40,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9422c7ee78ae610caaac1 2026-03-07 08:43:40,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:43:40,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9422c7ee78ae610caaac1 HTTP/1.1" 200 None 2026-03-07 08:43:40,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:43:40,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:43:40,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:43:40,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9422c7ee78ae610caaac1 HTTP/1.1" 200 None 2026-03-07 08:43:40,373 - lava_callback - ERROR - Error processing callback for node 69a9422c7ee78ae610caaac1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53296 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:44:20,201 - lava_callback - INFO - Received callback for node 69a9425c7ee78ae610caab19 INFO: 172.19.0.1:57292 - "POST /node/69a9425c7ee78ae610caab19 HTTP/1.0" 202 Accepted 2026-03-07 08:44:20,207 - lava_callback - INFO - Starting async job submit for node 69a9425c7ee78ae610caab19 2026-03-07 08:44:20,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:20,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9425c7ee78ae610caab19 HTTP/1.1" 200 None 2026-03-07 08:44:20,228 - lava_callback - DEBUG - Processing node 69a9425c7ee78ae610caab19: baseline-arm-baylibre 2026-03-07 08:44:20,228 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9425c7ee78ae610caab19 2026-03-07 08:44:20,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:20,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9425c7ee78ae610caab19 HTTP/1.1" 200 None 2026-03-07 08:44:20,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:20,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:44:20,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:20,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9425c7ee78ae610caab19 HTTP/1.1" 200 None 2026-03-07 08:44:20,291 - lava_callback - ERROR - Error processing callback for node 69a9425c7ee78ae610caab19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50446 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:44:41,509 - lava_callback - INFO - Received callback for node 69abe55540deb775998f3f0d INFO: 172.19.0.1:43294 - "POST /node/69abe55540deb775998f3f0d HTTP/1.0" 202 Accepted 2026-03-07 08:44:41,515 - lava_callback - INFO - Starting async job submit for node 69abe55540deb775998f3f0d 2026-03-07 08:44:41,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:41,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55540deb775998f3f0d HTTP/1.1" 200 None 2026-03-07 08:44:41,566 - lava_callback - DEBUG - Processing node 69abe55540deb775998f3f0d: baseline-x86 2026-03-07 08:44:41,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:41,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:41,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55540deb775998f3f0d/log.txt.gz 2026-03-07 08:44:42,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:42,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:42,226 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55540deb775998f3f0d/lava-logs.yaml 2026-03-07 08:44:42,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:42,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:42,413 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55540deb775998f3f0d/lava_callback.json.gz 2026-03-07 08:44:42,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:42,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55540deb775998f3f0d HTTP/1.1" 200 None 2026-03-07 08:44:42,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:42,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf4740deb775998f3bd2 HTTP/1.1" 200 None 2026-03-07 08:44:42,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:42,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe55540deb775998f3f0d HTTP/1.1" 200 None 2026-03-07 08:44:42,502 - lava_callback - INFO - Completed processing callback for node 69abe55540deb775998f3f0d INFO: 172.19.0.1:43300 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:44:52,156 - lava_callback - INFO - Received callback for node 69abe55740deb775998f3f16 INFO: 172.19.0.1:40324 - "POST /node/69abe55740deb775998f3f16 HTTP/1.0" 202 Accepted 2026-03-07 08:44:52,167 - lava_callback - INFO - Starting async job submit for node 69abe55740deb775998f3f16 2026-03-07 08:44:52,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:52,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55740deb775998f3f16 HTTP/1.1" 200 None 2026-03-07 08:44:52,244 - lava_callback - DEBUG - Processing node 69abe55740deb775998f3f16: baseline-x86 2026-03-07 08:44:52,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:52,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:52,775 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f16/log.txt.gz 2026-03-07 08:44:52,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:53,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:53,292 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f16/lava-logs.yaml 2026-03-07 08:44:53,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:44:53,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:44:53,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f16/lava_callback.json.gz 2026-03-07 08:44:53,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:53,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55740deb775998f3f16 HTTP/1.1" 200 None 2026-03-07 08:44:53,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:53,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf4740deb775998f3bd2 HTTP/1.1" 200 None 2026-03-07 08:44:53,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:44:53,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe55740deb775998f3f16 HTTP/1.1" 200 None 2026-03-07 08:44:53,750 - lava_callback - INFO - Completed processing callback for node 69abe55740deb775998f3f16 INFO: 172.19.0.1:40334 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:45:00,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:45:00,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43356 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:46:16,593 - lava_callback - INFO - Received callback for node 69abe55f40deb775998f3f21 INFO: 172.19.0.1:43368 - "POST /node/69abe55f40deb775998f3f21 HTTP/1.0" 202 Accepted 2026-03-07 08:46:16,600 - lava_callback - INFO - Starting async job submit for node 69abe55f40deb775998f3f21 2026-03-07 08:46:16,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:16,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55f40deb775998f3f21 HTTP/1.1" 200 None 2026-03-07 08:46:16,641 - lava_callback - DEBUG - Processing node 69abe55f40deb775998f3f21: baseline-arm 2026-03-07 08:46:16,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:46:17,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:46:17,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe55f40deb775998f3f21/log.txt.gz 2026-03-07 08:46:17,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:46:17,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:46:17,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe55f40deb775998f3f21/lava-logs.yaml 2026-03-07 08:46:17,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:46:17,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:46:17,968 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe55f40deb775998f3f21/lava_callback.json.gz 2026-03-07 08:46:17,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:18,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55f40deb775998f3f21 HTTP/1.1" 200 None 2026-03-07 08:46:18,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:18,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2b40deb775998f3bab HTTP/1.1" 200 None 2026-03-07 08:46:18,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:18,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe55f40deb775998f3f21 HTTP/1.1" 200 None 2026-03-07 08:46:18,077 - lava_callback - INFO - Completed processing callback for node 69abe55f40deb775998f3f21 INFO: 172.19.0.1:51780 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:46:30,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:30,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33318 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:46:40,279 - lava_callback - INFO - Received callback for node 69a942e47ee78ae610caabff INFO: 172.19.0.1:40124 - "POST /node/69a942e47ee78ae610caabff HTTP/1.0" 202 Accepted 2026-03-07 08:46:40,284 - lava_callback - INFO - Starting async job submit for node 69a942e47ee78ae610caabff 2026-03-07 08:46:40,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:40,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a942e47ee78ae610caabff HTTP/1.1" 200 None 2026-03-07 08:46:40,300 - lava_callback - DEBUG - Processing node 69a942e47ee78ae610caabff: baseline-arm-baylibre 2026-03-07 08:46:40,300 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a942e47ee78ae610caabff 2026-03-07 08:46:40,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:40,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a942e47ee78ae610caabff HTTP/1.1" 200 None 2026-03-07 08:46:40,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:40,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:46:40,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:46:40,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a942e47ee78ae610caabff HTTP/1.1" 200 None 2026-03-07 08:46:40,365 - lava_callback - ERROR - Error processing callback for node 69a942e47ee78ae610caabff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50684 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:47:20,288 - lava_callback - INFO - Received callback for node 69a943117ee78ae610caac7c INFO: 172.19.0.1:54464 - "POST /node/69a943117ee78ae610caac7c HTTP/1.0" 202 Accepted 2026-03-07 08:47:20,293 - lava_callback - INFO - Starting async job submit for node 69a943117ee78ae610caac7c 2026-03-07 08:47:20,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:20,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943117ee78ae610caac7c HTTP/1.1" 200 None 2026-03-07 08:47:20,311 - lava_callback - DEBUG - Processing node 69a943117ee78ae610caac7c: baseline-arm-baylibre 2026-03-07 08:47:20,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943117ee78ae610caac7c 2026-03-07 08:47:20,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:20,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943117ee78ae610caac7c HTTP/1.1" 200 None 2026-03-07 08:47:20,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:20,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 08:47:20,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:20,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943117ee78ae610caac7c HTTP/1.1" 200 None 2026-03-07 08:47:20,387 - lava_callback - ERROR - Error processing callback for node 69a943117ee78ae610caac7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54468 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:47:34,449 - lava_callback - INFO - Received callback for node 69abe61a40deb775998f3f90 INFO: 172.19.0.1:56510 - "POST /node/69abe61a40deb775998f3f90 HTTP/1.0" 202 Accepted 2026-03-07 08:47:34,461 - lava_callback - INFO - Starting async job submit for node 69abe61a40deb775998f3f90 2026-03-07 08:47:34,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:34,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61a40deb775998f3f90 HTTP/1.1" 200 None 2026-03-07 08:47:34,501 - lava_callback - DEBUG - Processing node 69abe61a40deb775998f3f90: baseline-arm 2026-03-07 08:47:34,510 - lava_callback - WARNING - Failed to upload log 2026-03-07 08:47:34,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:47:34,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:47:34,652 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61a40deb775998f3f90/lava-logs.yaml 2026-03-07 08:47:34,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:47:35,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:47:35,070 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61a40deb775998f3f90/lava_callback.json.gz 2026-03-07 08:47:35,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:35,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61a40deb775998f3f90 HTTP/1.1" 200 None 2026-03-07 08:47:35,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:35,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:47:35,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:47:35,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61a40deb775998f3f90 HTTP/1.1" 200 None 2026-03-07 08:47:35,186 - lava_callback - INFO - Completed processing callback for node 69abe61a40deb775998f3f90 INFO: 172.19.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48232 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:00,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:00,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:51748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51754 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:11,609 - lava_callback - INFO - Received callback for node 69abe61b40deb775998f3f93 INFO: 172.19.0.1:60638 - "POST /node/69abe61b40deb775998f3f93 HTTP/1.0" 202 Accepted 2026-03-07 08:48:11,666 - lava_callback - INFO - Starting async job submit for node 69abe61b40deb775998f3f93 2026-03-07 08:48:11,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:11,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61b40deb775998f3f93 HTTP/1.1" 200 None 2026-03-07 08:48:11,731 - lava_callback - DEBUG - Processing node 69abe61b40deb775998f3f93: baseline-arm 2026-03-07 08:48:12,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:12,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:12,211 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f93/log.txt.gz 2026-03-07 08:48:12,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:12,674 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:12,676 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f93/lava-logs.yaml 2026-03-07 08:48:12,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:12,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:12,852 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f93/lava_callback.json.gz 2026-03-07 08:48:12,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:12,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61b40deb775998f3f93 HTTP/1.1" 200 None 2026-03-07 08:48:12,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:12,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:48:12,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:12,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61b40deb775998f3f93 HTTP/1.1" 200 None 2026-03-07 08:48:12,944 - lava_callback - INFO - Completed processing callback for node 69abe61b40deb775998f3f93 2026-03-07 08:48:15,106 - lava_callback - INFO - Received callback for node 69abe61e40deb775998f3f9d INFO: 172.19.0.1:60654 - "POST /node/69abe61e40deb775998f3f9d HTTP/1.0" 202 Accepted 2026-03-07 08:48:15,155 - lava_callback - INFO - Starting async job submit for node 69abe61e40deb775998f3f9d INFO: 172.19.0.1:60670 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 08:48:15,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:15,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61e40deb775998f3f9d HTTP/1.1" 200 None 2026-03-07 08:48:15,191 - lava_callback - DEBUG - Processing node 69abe61e40deb775998f3f9d: baseline-arm 2026-03-07 08:48:15,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:15,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:15,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61e40deb775998f3f9d/log.txt.gz 2026-03-07 08:48:15,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:16,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:16,031 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61e40deb775998f3f9d/lava-logs.yaml 2026-03-07 08:48:16,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:16,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:16,189 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61e40deb775998f3f9d/lava_callback.json.gz 2026-03-07 08:48:16,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:16,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61e40deb775998f3f9d HTTP/1.1" 200 None 2026-03-07 08:48:16,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:16,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:48:16,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:16,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61e40deb775998f3f9d HTTP/1.1" 200 None 2026-03-07 08:48:16,285 - lava_callback - INFO - Completed processing callback for node 69abe61e40deb775998f3f9d INFO: 172.19.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47740 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:30,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:30,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:43940 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:38,858 - lava_callback - INFO - Received callback for node 69abe63340deb775998f3fe8 INFO: 172.19.0.1:43946 - "POST /node/69abe63340deb775998f3fe8 HTTP/1.0" 202 Accepted 2026-03-07 08:48:38,870 - lava_callback - INFO - Starting async job submit for node 69abe63340deb775998f3fe8 2026-03-07 08:48:38,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:38,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63340deb775998f3fe8 HTTP/1.1" 200 None 2026-03-07 08:48:38,945 - lava_callback - DEBUG - Processing node 69abe63340deb775998f3fe8: baseline-arm-clabbe 2026-03-07 08:48:39,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:39,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:39,324 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63340deb775998f3fe8/log.txt.gz 2026-03-07 08:48:39,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:39,679 - lava_callback - INFO - Received callback for node 69abe61940deb775998f3f8d 2026-03-07 08:48:39,689 - lava_callback - INFO - Starting async job submit for node 69abe61940deb775998f3f8d INFO: 172.19.0.1:43948 - "POST /node/69abe61940deb775998f3f8d HTTP/1.0" 202 Accepted 2026-03-07 08:48:39,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:39,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61940deb775998f3f8d HTTP/1.1" 200 None 2026-03-07 08:48:39,772 - lava_callback - DEBUG - Processing node 69abe61940deb775998f3f8d: baseline-arm 2026-03-07 08:48:40,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:40,070 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63340deb775998f3fe8/lava-logs.yaml 2026-03-07 08:48:40,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:40,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:40,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:40,231 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61940deb775998f3f8d/log.txt.gz 2026-03-07 08:48:40,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:40,265 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63340deb775998f3fe8/lava_callback.json.gz 2026-03-07 08:48:40,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63340deb775998f3fe8 HTTP/1.1" 200 None 2026-03-07 08:48:40,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,507 - lava_callback - INFO - Received callback for node 69a9435b7ee78ae610caacd7 2026-03-07 08:48:40,541 - lava_callback - INFO - Starting async job submit for node 69a9435b7ee78ae610caacd7 2026-03-07 08:48:40,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:41374 - "POST /node/69a9435b7ee78ae610caacd7 HTTP/1.0" 202 Accepted 2026-03-07 08:48:40,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:48:40,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:40,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435b7ee78ae610caacd7 HTTP/1.1" 200 None 2026-03-07 08:48:40,616 - lava_callback - DEBUG - Processing node 69a9435b7ee78ae610caacd7: baseline-arm-baylibre 2026-03-07 08:48:40,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9435b7ee78ae610caacd7 2026-03-07 08:48:40,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435b7ee78ae610caacd7 HTTP/1.1" 200 None 2026-03-07 08:48:40,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63340deb775998f3fe8 HTTP/1.1" 200 None 2026-03-07 08:48:40,662 - lava_callback - INFO - Completed processing callback for node 69abe63340deb775998f3fe8 2026-03-07 08:48:40,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:40,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:40,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9435b7ee78ae610caacd7 HTTP/1.1" 200 None 2026-03-07 08:48:40,770 - lava_callback - ERROR - Error processing callback for node 69a9435b7ee78ae610caacd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:48:41,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:41,224 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61940deb775998f3f8d/lava-logs.yaml 2026-03-07 08:48:41,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:41,235 - lava_callback - INFO - Received callback for node 69a9435d7ee78ae610caacda INFO: 172.19.0.1:41390 - "POST /node/69a9435d7ee78ae610caacda HTTP/1.0" 202 Accepted 2026-03-07 08:48:41,246 - lava_callback - INFO - Starting async job submit for node 69a9435d7ee78ae610caacda 2026-03-07 08:48:41,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435d7ee78ae610caacda HTTP/1.1" 200 None 2026-03-07 08:48:41,278 - lava_callback - DEBUG - Processing node 69a9435d7ee78ae610caacda: baseline-arm-baylibre 2026-03-07 08:48:41,278 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9435d7ee78ae610caacda 2026-03-07 08:48:41,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435d7ee78ae610caacda HTTP/1.1" 200 None 2026-03-07 08:48:41,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:41,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9435d7ee78ae610caacda HTTP/1.1" 200 None 2026-03-07 08:48:41,357 - lava_callback - ERROR - Error processing callback for node 69a9435d7ee78ae610caacda: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:48:41,493 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:41,495 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61940deb775998f3f8d/lava_callback.json.gz 2026-03-07 08:48:41,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61940deb775998f3f8d HTTP/1.1" 200 None 2026-03-07 08:48:41,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:48:41,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:41,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61940deb775998f3f8d HTTP/1.1" 200 None 2026-03-07 08:48:41,691 - lava_callback - INFO - Completed processing callback for node 69abe61940deb775998f3f8d 2026-03-07 08:48:41,961 - lava_callback - INFO - Received callback for node 69a9435e7ee78ae610caacdd INFO: 172.19.0.1:41406 - "POST /node/69a9435e7ee78ae610caacdd HTTP/1.0" 202 Accepted 2026-03-07 08:48:41,970 - lava_callback - INFO - Starting async job submit for node 69a9435e7ee78ae610caacdd 2026-03-07 08:48:41,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435e7ee78ae610caacdd HTTP/1.1" 200 None 2026-03-07 08:48:42,040 - lava_callback - DEBUG - Processing node 69a9435e7ee78ae610caacdd: baseline-arm-baylibre 2026-03-07 08:48:42,040 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9435e7ee78ae610caacdd 2026-03-07 08:48:42,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435e7ee78ae610caacdd HTTP/1.1" 200 None 2026-03-07 08:48:42,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:42,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9435e7ee78ae610caacdd HTTP/1.1" 200 None 2026-03-07 08:48:42,158 - lava_callback - ERROR - Error processing callback for node 69a9435e7ee78ae610caacdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:48:42,673 - lava_callback - INFO - Received callback for node 69a9435f7ee78ae610caace2 INFO: 172.19.0.1:41412 - "POST /node/69a9435f7ee78ae610caace2 HTTP/1.0" 202 Accepted 2026-03-07 08:48:42,682 - lava_callback - INFO - Starting async job submit for node 69a9435f7ee78ae610caace2 2026-03-07 08:48:42,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435f7ee78ae610caace2 HTTP/1.1" 200 None 2026-03-07 08:48:42,709 - lava_callback - DEBUG - Processing node 69a9435f7ee78ae610caace2: baseline-arm-baylibre 2026-03-07 08:48:42,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9435f7ee78ae610caace2 2026-03-07 08:48:42,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9435f7ee78ae610caace2 HTTP/1.1" 200 None 2026-03-07 08:48:42,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:42,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:42,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9435f7ee78ae610caace2 HTTP/1.1" 200 None 2026-03-07 08:48:42,796 - lava_callback - ERROR - Error processing callback for node 69a9435f7ee78ae610caace2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:48:43,374 - lava_callback - INFO - Received callback for node 69a943627ee78ae610caacfd INFO: 172.19.0.1:41414 - "POST /node/69a943627ee78ae610caacfd HTTP/1.0" 202 Accepted 2026-03-07 08:48:43,379 - lava_callback - INFO - Starting async job submit for node 69a943627ee78ae610caacfd 2026-03-07 08:48:43,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:43,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943627ee78ae610caacfd HTTP/1.1" 200 None 2026-03-07 08:48:43,398 - lava_callback - DEBUG - Processing node 69a943627ee78ae610caacfd: baseline-arm-baylibre 2026-03-07 08:48:43,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943627ee78ae610caacfd 2026-03-07 08:48:43,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:43,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943627ee78ae610caacfd HTTP/1.1" 200 None 2026-03-07 08:48:43,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:43,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:43,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:43,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943627ee78ae610caacfd HTTP/1.1" 200 None 2026-03-07 08:48:43,502 - lava_callback - ERROR - Error processing callback for node 69a943627ee78ae610caacfd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:48:44,069 - lava_callback - INFO - Received callback for node 69a943647ee78ae610caad00 INFO: 172.19.0.1:41430 - "POST /node/69a943647ee78ae610caad00 HTTP/1.0" 202 Accepted 2026-03-07 08:48:44,075 - lava_callback - INFO - Starting async job submit for node 69a943647ee78ae610caad00 2026-03-07 08:48:44,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:44,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943647ee78ae610caad00 HTTP/1.1" 200 None 2026-03-07 08:48:44,118 - lava_callback - DEBUG - Processing node 69a943647ee78ae610caad00: baseline-arm-baylibre 2026-03-07 08:48:44,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943647ee78ae610caad00 2026-03-07 08:48:44,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:44,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943647ee78ae610caad00 HTTP/1.1" 200 None 2026-03-07 08:48:44,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:44,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:44,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:44,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943647ee78ae610caad00 HTTP/1.1" 200 None 2026-03-07 08:48:44,219 - lava_callback - ERROR - Error processing callback for node 69a943647ee78ae610caad00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41446 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:52,987 - lava_callback - INFO - Received callback for node 69a9436f7ee78ae610caad1f INFO: 172.19.0.1:36010 - "POST /node/69a9436f7ee78ae610caad1f HTTP/1.0" 202 Accepted 2026-03-07 08:48:52,993 - lava_callback - INFO - Starting async job submit for node 69a9436f7ee78ae610caad1f 2026-03-07 08:48:52,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:53,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9436f7ee78ae610caad1f HTTP/1.1" 200 None 2026-03-07 08:48:53,009 - lava_callback - DEBUG - Processing node 69a9436f7ee78ae610caad1f: baseline-arm-clabbe 2026-03-07 08:48:53,009 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9436f7ee78ae610caad1f 2026-03-07 08:48:53,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:53,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9436f7ee78ae610caad1f HTTP/1.1" 200 None 2026-03-07 08:48:53,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:53,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:48:53,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:53,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9436f7ee78ae610caad1f HTTP/1.1" 200 None 2026-03-07 08:48:53,086 - lava_callback - ERROR - Error processing callback for node 69a9436f7ee78ae610caad1f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36022 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:48:56,983 - lava_callback - INFO - Received callback for node 69abe62d40deb775998f3fd9 INFO: 172.19.0.1:36034 - "POST /node/69abe62d40deb775998f3fd9 HTTP/1.0" 202 Accepted 2026-03-07 08:48:56,989 - lava_callback - INFO - Starting async job submit for node 69abe62d40deb775998f3fd9 2026-03-07 08:48:57,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:57,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62d40deb775998f3fd9 HTTP/1.1" 200 None 2026-03-07 08:48:57,045 - lava_callback - DEBUG - Processing node 69abe62d40deb775998f3fd9: baseline-arm-broonie 2026-03-07 08:48:57,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:57,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:57,388 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62d40deb775998f3fd9/log.txt.gz 2026-03-07 08:48:57,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:57,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:57,681 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62d40deb775998f3fd9/lava-logs.yaml 2026-03-07 08:48:57,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:48:57,837 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:48:57,839 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62d40deb775998f3fd9/lava_callback.json.gz 2026-03-07 08:48:57,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:57,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62d40deb775998f3fd9 HTTP/1.1" 200 None 2026-03-07 08:48:57,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:57,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:48:57,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:48:57,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe62d40deb775998f3fd9 HTTP/1.1" 200 None 2026-03-07 08:48:57,933 - lava_callback - INFO - Completed processing callback for node 69abe62d40deb775998f3fd9 2026-03-07 08:49:00,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:00,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42166 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:49:12,933 - lava_callback - INFO - Received callback for node 69a943747ee78ae610caad2e INFO: 172.19.0.1:37310 - "POST /node/69a943747ee78ae610caad2e HTTP/1.0" 202 Accepted 2026-03-07 08:49:12,940 - lava_callback - INFO - Starting async job submit for node 69a943747ee78ae610caad2e 2026-03-07 08:49:12,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:12,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943747ee78ae610caad2e HTTP/1.1" 200 None 2026-03-07 08:49:12,964 - lava_callback - DEBUG - Processing node 69a943747ee78ae610caad2e: baseline-arm-clabbe 2026-03-07 08:49:12,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943747ee78ae610caad2e 2026-03-07 08:49:12,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:12,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943747ee78ae610caad2e HTTP/1.1" 200 None 2026-03-07 08:49:12,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:13,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 08:49:13,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:13,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943747ee78ae610caad2e HTTP/1.1" 200 None 2026-03-07 08:49:13,049 - lava_callback - ERROR - Error processing callback for node 69a943747ee78ae610caad2e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37314 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 08:49:15,176 - lava_callback - INFO - Received callback for node 69abe64440deb775998f4037 INFO: 172.19.0.1:37316 - "POST /node/69abe64440deb775998f4037 HTTP/1.0" 202 Accepted 2026-03-07 08:49:15,185 - lava_callback - INFO - Starting async job submit for node 69abe64440deb775998f4037 2026-03-07 08:49:15,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:15,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64440deb775998f4037 HTTP/1.1" 200 None 2026-03-07 08:49:15,258 - lava_callback - DEBUG - Processing node 69abe64440deb775998f4037: baseline-arm-pengutronix 2026-03-07 08:49:15,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:15,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:15,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64440deb775998f4037/log.txt.gz 2026-03-07 08:49:15,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:16,133 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:16,135 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64440deb775998f4037/lava-logs.yaml 2026-03-07 08:49:16,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:16,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:16,352 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64440deb775998f4037/lava_callback.json.gz 2026-03-07 08:49:16,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:16,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64440deb775998f4037 HTTP/1.1" 200 None 2026-03-07 08:49:16,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:16,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:16,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:16,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe64440deb775998f4037 HTTP/1.1" 200 None 2026-03-07 08:49:16,499 - lava_callback - INFO - Completed processing callback for node 69abe64440deb775998f4037 INFO: 172.19.0.1:37326 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:49:16,713 - lava_callback - INFO - Received callback for node 69abe62f40deb775998f3fdc INFO: 172.19.0.1:37334 - "POST /node/69abe62f40deb775998f3fdc HTTP/1.0" 202 Accepted 2026-03-07 08:49:16,724 - lava_callback - INFO - Starting async job submit for node 69abe62f40deb775998f3fdc 2026-03-07 08:49:16,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:16,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62f40deb775998f3fdc HTTP/1.1" 200 None 2026-03-07 08:49:16,827 - lava_callback - DEBUG - Processing node 69abe62f40deb775998f3fdc: baseline-arm-broonie 2026-03-07 08:49:17,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:17,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:17,485 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62f40deb775998f3fdc/log.txt.gz 2026-03-07 08:49:17,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:18,028 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:18,031 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62f40deb775998f3fdc/lava-logs.yaml 2026-03-07 08:49:18,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:18,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:18,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62f40deb775998f3fdc/lava_callback.json.gz 2026-03-07 08:49:18,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:18,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62f40deb775998f3fdc HTTP/1.1" 200 None 2026-03-07 08:49:18,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:18,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:18,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:18,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe62f40deb775998f3fdc HTTP/1.1" 200 None 2026-03-07 08:49:18,359 - lava_callback - INFO - Completed processing callback for node 69abe62f40deb775998f3fdc 2026-03-07 08:49:18,407 - lava_callback - INFO - Received callback for node 69abe64740deb775998f403f INFO: 172.19.0.1:37342 - "POST /node/69abe64740deb775998f403f HTTP/1.0" 202 Accepted 2026-03-07 08:49:18,464 - lava_callback - INFO - Starting async job submit for node 69abe64740deb775998f403f 2026-03-07 08:49:18,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:18,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64740deb775998f403f HTTP/1.1" 200 None 2026-03-07 08:49:18,549 - lava_callback - DEBUG - Processing node 69abe64740deb775998f403f: baseline-arm-pengutronix 2026-03-07 08:49:18,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:18,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:18,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64740deb775998f403f/log.txt.gz 2026-03-07 08:49:19,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:19,511 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:19,513 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64740deb775998f403f/lava-logs.yaml 2026-03-07 08:49:19,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:19,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:19,654 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64740deb775998f403f/lava_callback.json.gz 2026-03-07 08:49:19,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:19,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64740deb775998f403f HTTP/1.1" 200 None 2026-03-07 08:49:19,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:19,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:19,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:19,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe64740deb775998f403f HTTP/1.1" 200 None 2026-03-07 08:49:19,735 - lava_callback - INFO - Completed processing callback for node 69abe64740deb775998f403f 2026-03-07 08:49:22,745 - lava_callback - INFO - Received callback for node 69abe63640deb775998f3ff0 INFO: 172.19.0.1:33314 - "POST /node/69abe63640deb775998f3ff0 HTTP/1.0" 202 Accepted 2026-03-07 08:49:22,752 - lava_callback - INFO - Starting async job submit for node 69abe63640deb775998f3ff0 2026-03-07 08:49:22,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:22,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63640deb775998f3ff0 HTTP/1.1" 200 None 2026-03-07 08:49:22,792 - lava_callback - DEBUG - Processing node 69abe63640deb775998f3ff0: baseline-arm-clabbe 2026-03-07 08:49:23,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:23,346 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:23,348 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63640deb775998f3ff0/log.txt.gz 2026-03-07 08:49:23,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:23,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:23,923 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63640deb775998f3ff0/lava-logs.yaml 2026-03-07 08:49:23,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:24,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:24,079 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63640deb775998f3ff0/lava_callback.json.gz 2026-03-07 08:49:24,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:24,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63640deb775998f3ff0 HTTP/1.1" 200 None 2026-03-07 08:49:24,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:24,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:24,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:24,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63640deb775998f3ff0 HTTP/1.1" 200 None 2026-03-07 08:49:24,167 - lava_callback - INFO - Completed processing callback for node 69abe63640deb775998f3ff0 INFO: 172.19.0.1:33320 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:49:26,669 - lava_callback - INFO - Received callback for node 69abe63040deb775998f3fdf INFO: 172.19.0.1:33332 - "POST /node/69abe63040deb775998f3fdf HTTP/1.0" 202 Accepted 2026-03-07 08:49:26,675 - lava_callback - INFO - Starting async job submit for node 69abe63040deb775998f3fdf 2026-03-07 08:49:26,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:26,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63040deb775998f3fdf HTTP/1.1" 200 None 2026-03-07 08:49:26,716 - lava_callback - DEBUG - Processing node 69abe63040deb775998f3fdf: baseline-arm-broonie 2026-03-07 08:49:27,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:27,301 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:27,303 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe63040deb775998f3fdf/log.txt.gz 2026-03-07 08:49:27,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:27,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:27,899 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe63040deb775998f3fdf/lava-logs.yaml 2026-03-07 08:49:27,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:28,090 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:28,092 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe63040deb775998f3fdf/lava_callback.json.gz 2026-03-07 08:49:28,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:28,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63040deb775998f3fdf HTTP/1.1" 200 None 2026-03-07 08:49:28,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:28,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:28,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:28,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63040deb775998f3fdf HTTP/1.1" 200 None 2026-03-07 08:49:28,200 - lava_callback - INFO - Completed processing callback for node 69abe63040deb775998f3fdf 2026-03-07 08:49:29,170 - lava_callback - INFO - Received callback for node 69abe63a40deb775998f3ffd INFO: 172.19.0.1:33344 - "POST /node/69abe63a40deb775998f3ffd HTTP/1.0" 202 Accepted 2026-03-07 08:49:29,179 - lava_callback - INFO - Starting async job submit for node 69abe63a40deb775998f3ffd 2026-03-07 08:49:29,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:29,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63a40deb775998f3ffd HTTP/1.1" 200 None 2026-03-07 08:49:29,248 - lava_callback - DEBUG - Processing node 69abe63a40deb775998f3ffd: baseline-arm-clabbe 2026-03-07 08:49:29,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:29,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:29,668 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63a40deb775998f3ffd/log.txt.gz 2026-03-07 08:49:29,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:30,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:30,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:30,212 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63a40deb775998f3ffd/lava-logs.yaml 2026-03-07 08:49:30,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:30,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-07 08:49:30,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:30,357 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63a40deb775998f3ffd/lava_callback.json.gz 2026-03-07 08:49:30,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:30,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63a40deb775998f3ffd HTTP/1.1" 200 None 2026-03-07 08:49:30,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:30,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:30,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:30,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63a40deb775998f3ffd HTTP/1.1" 200 None 2026-03-07 08:49:30,480 - lava_callback - INFO - Completed processing callback for node 69abe63a40deb775998f3ffd INFO: 172.19.0.1:41540 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:49:40,486 - lava_callback - INFO - Received callback for node 69a943947ee78ae610caadb5 INFO: 172.19.0.1:57678 - "POST /node/69a943947ee78ae610caadb5 HTTP/1.0" 202 Accepted 2026-03-07 08:49:40,495 - lava_callback - INFO - Starting async job submit for node 69a943947ee78ae610caadb5 2026-03-07 08:49:40,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:40,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943947ee78ae610caadb5 HTTP/1.1" 200 None 2026-03-07 08:49:40,524 - lava_callback - DEBUG - Processing node 69a943947ee78ae610caadb5: baseline-arm64-baylibre 2026-03-07 08:49:40,524 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943947ee78ae610caadb5 2026-03-07 08:49:40,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:40,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943947ee78ae610caadb5 HTTP/1.1" 200 None 2026-03-07 08:49:40,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:40,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 08:49:40,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:40,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943947ee78ae610caadb5 HTTP/1.1" 200 None 2026-03-07 08:49:40,649 - lava_callback - ERROR - Error processing callback for node 69a943947ee78ae610caadb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:49:40,753 - lava_callback - INFO - Received callback for node 69abe64040deb775998f4027 INFO: 172.19.0.1:57688 - "POST /node/69abe64040deb775998f4027 HTTP/1.0" 202 Accepted 2026-03-07 08:49:40,763 - lava_callback - INFO - Starting async job submit for node 69abe64040deb775998f4027 2026-03-07 08:49:40,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:40,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64040deb775998f4027 HTTP/1.1" 200 None 2026-03-07 08:49:40,807 - lava_callback - DEBUG - Processing node 69abe64040deb775998f4027: baseline-arm-kontron 2026-03-07 08:49:41,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:41,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:41,414 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69abe64040deb775998f4027/log.txt.gz 2026-03-07 08:49:41,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:42,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:42,092 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69abe64040deb775998f4027/lava-logs.yaml 2026-03-07 08:49:42,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:42,223 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:42,225 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-kontron-69abe64040deb775998f4027/lava_callback.json.gz 2026-03-07 08:49:42,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:42,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64040deb775998f4027 HTTP/1.1" 200 None 2026-03-07 08:49:42,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:42,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:42,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:42,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe64040deb775998f4027 HTTP/1.1" 200 None 2026-03-07 08:49:42,320 - lava_callback - INFO - Completed processing callback for node 69abe64040deb775998f4027 INFO: 172.19.0.1:57692 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:49:53,773 - lava_callback - INFO - Received callback for node 69abe69d40deb775998f4108 INFO: 172.19.0.1:38148 - "POST /node/69abe69d40deb775998f4108 HTTP/1.0" 202 Accepted 2026-03-07 08:49:53,783 - lava_callback - INFO - Starting async job submit for node 69abe69d40deb775998f4108 2026-03-07 08:49:53,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:53,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe69d40deb775998f4108 HTTP/1.1" 200 None 2026-03-07 08:49:53,810 - lava_callback - DEBUG - Processing node 69abe69d40deb775998f4108: baseline-arm 2026-03-07 08:49:53,818 - lava_callback - WARNING - Failed to upload log 2026-03-07 08:49:53,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:54,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:54,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe69d40deb775998f4108/lava-logs.yaml 2026-03-07 08:49:54,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:49:54,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:49:54,381 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe69d40deb775998f4108/lava_callback.json.gz 2026-03-07 08:49:54,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:54,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe69d40deb775998f4108 HTTP/1.1" 200 None 2026-03-07 08:49:54,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:54,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:49:54,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:49:54,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe69d40deb775998f4108 HTTP/1.1" 200 None 2026-03-07 08:49:54,459 - lava_callback - INFO - Completed processing callback for node 69abe69d40deb775998f4108 INFO: 172.19.0.1:38152 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:50:00,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:00,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 08:50:03,625 - lava_callback - INFO - Received callback for node 69abe61d40deb775998f3f99 INFO: 172.19.0.1:51600 - "POST /node/69abe61d40deb775998f3f99 HTTP/1.0" 202 Accepted 2026-03-07 08:50:03,642 - lava_callback - INFO - Starting async job submit for node 69abe61d40deb775998f3f99 2026-03-07 08:50:03,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:03,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61d40deb775998f3f99 HTTP/1.1" 200 None 2026-03-07 08:50:03,713 - lava_callback - DEBUG - Processing node 69abe61d40deb775998f3f99: baseline-arm 2026-03-07 08:50:04,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:04,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:04,301 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61d40deb775998f3f99/log.txt.gz 2026-03-07 08:50:04,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:04,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:04,927 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61d40deb775998f3f99/lava-logs.yaml 2026-03-07 08:50:04,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:05,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:05,274 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61d40deb775998f3f99/lava_callback.json.gz 2026-03-07 08:50:05,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:05,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61d40deb775998f3f99 HTTP/1.1" 200 None 2026-03-07 08:50:05,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:05,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:50:05,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:05,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61d40deb775998f3f99 HTTP/1.1" 200 None 2026-03-07 08:50:05,385 - lava_callback - INFO - Completed processing callback for node 69abe61d40deb775998f3f99 INFO: 172.19.0.1:51602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51612 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:50:06,941 - lava_callback - INFO - Received callback for node 69abe62c40deb775998f3fd6 INFO: 172.19.0.1:51626 - "POST /node/69abe62c40deb775998f3fd6 HTTP/1.0" 202 Accepted 2026-03-07 08:50:06,948 - lava_callback - INFO - Starting async job submit for node 69abe62c40deb775998f3fd6 2026-03-07 08:50:06,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:06,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62c40deb775998f3fd6 HTTP/1.1" 200 None 2026-03-07 08:50:06,991 - lava_callback - DEBUG - Processing node 69abe62c40deb775998f3fd6: baseline-arm-broonie 2026-03-07 08:50:07,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:07,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:07,514 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62c40deb775998f3fd6/log.txt.gz 2026-03-07 08:50:07,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:08,119 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:08,121 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62c40deb775998f3fd6/lava-logs.yaml 2026-03-07 08:50:08,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:08,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:08,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69abe62c40deb775998f3fd6/lava_callback.json.gz 2026-03-07 08:50:08,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:08,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe62c40deb775998f3fd6 HTTP/1.1" 200 None 2026-03-07 08:50:08,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:08,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:50:08,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:08,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe62c40deb775998f3fd6 HTTP/1.1" 200 None 2026-03-07 08:50:08,375 - lava_callback - INFO - Completed processing callback for node 69abe62c40deb775998f3fd6 2026-03-07 08:50:13,566 - lava_callback - INFO - Received callback for node 69abe64340deb775998f4032 INFO: 172.19.0.1:58852 - "POST /node/69abe64340deb775998f4032 HTTP/1.0" 202 Accepted 2026-03-07 08:50:13,575 - lava_callback - INFO - Starting async job submit for node 69abe64340deb775998f4032 2026-03-07 08:50:13,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:13,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64340deb775998f4032 HTTP/1.1" 200 None 2026-03-07 08:50:13,663 - lava_callback - DEBUG - Processing node 69abe64340deb775998f4032: baseline-arm-pengutronix 2026-03-07 08:50:13,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:14,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:14,041 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64340deb775998f4032/log.txt.gz 2026-03-07 08:50:14,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:14,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:14,377 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64340deb775998f4032/lava-logs.yaml 2026-03-07 08:50:14,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:50:14,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:50:14,797 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64340deb775998f4032/lava_callback.json.gz 2026-03-07 08:50:14,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:14,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64340deb775998f4032 HTTP/1.1" 200 None 2026-03-07 08:50:14,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:14,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:50:14,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:14,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe64340deb775998f4032 HTTP/1.1" 200 None 2026-03-07 08:50:15,007 - lava_callback - INFO - Completed processing callback for node 69abe64340deb775998f4032 INFO: 172.19.0.1:58866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48852 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:50:30,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:50:30,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44990 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:51:00,544 - lava_callback - INFO - Received callback for node 69a943ee7ee78ae610caaeb2 INFO: 172.19.0.1:33552 - "POST /node/69a943ee7ee78ae610caaeb2 HTTP/1.0" 202 Accepted 2026-03-07 08:51:00,549 - lava_callback - INFO - Starting async job submit for node 69a943ee7ee78ae610caaeb2 2026-03-07 08:51:00,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:00,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943ee7ee78ae610caaeb2 HTTP/1.1" 200 None 2026-03-07 08:51:00,572 - lava_callback - DEBUG - Processing node 69a943ee7ee78ae610caaeb2: baseline-arm64-baylibre 2026-03-07 08:51:00,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a943ee7ee78ae610caaeb2 2026-03-07 08:51:00,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:00,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a943ee7ee78ae610caaeb2 HTTP/1.1" 200 None 2026-03-07 08:51:00,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:00,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 08:51:00,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:00,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a943ee7ee78ae610caaeb2 HTTP/1.1" 200 None 2026-03-07 08:51:00,623 - lava_callback - ERROR - Error processing callback for node 69a943ee7ee78ae610caaeb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33578 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:51:10,117 - lava_callback - INFO - Received callback for node 69abe63740deb775998f3ff4 INFO: 172.19.0.1:56490 - "POST /node/69abe63740deb775998f3ff4 HTTP/1.0" 202 Accepted 2026-03-07 08:51:10,123 - lava_callback - INFO - Starting async job submit for node 69abe63740deb775998f3ff4 2026-03-07 08:51:10,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:10,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63740deb775998f3ff4 HTTP/1.1" 200 None 2026-03-07 08:51:10,169 - lava_callback - DEBUG - Processing node 69abe63740deb775998f3ff4: baseline-arm-clabbe 2026-03-07 08:51:10,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:10,508 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:10,510 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63740deb775998f3ff4/log.txt.gz 2026-03-07 08:51:10,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:10,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:10,859 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63740deb775998f3ff4/lava-logs.yaml 2026-03-07 08:51:10,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:11,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:11,027 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63740deb775998f3ff4/lava_callback.json.gz 2026-03-07 08:51:11,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:11,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63740deb775998f3ff4 HTTP/1.1" 200 None 2026-03-07 08:51:11,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:11,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:51:11,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:11,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63740deb775998f3ff4 HTTP/1.1" 200 None 2026-03-07 08:51:11,112 - lava_callback - INFO - Completed processing callback for node 69abe63740deb775998f3ff4 INFO: 172.19.0.1:56492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50766 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:51:30,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:30,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 08:51:33,750 - lava_callback - INFO - Received callback for node 69abe65f40deb775998f4075 INFO: 172.19.0.1:40082 - "POST /node/69abe65f40deb775998f4075 HTTP/1.0" 202 Accepted 2026-03-07 08:51:33,757 - lava_callback - INFO - Starting async job submit for node 69abe65f40deb775998f4075 2026-03-07 08:51:33,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:33,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65f40deb775998f4075 HTTP/1.1" 200 None 2026-03-07 08:51:33,801 - lava_callback - DEBUG - Processing node 69abe65f40deb775998f4075: ltp-dio 2026-03-07 08:51:34,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:34,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:34,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69abe65f40deb775998f4075/log.txt.gz 2026-03-07 08:51:34,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:34,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:34,942 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69abe65f40deb775998f4075/lava-logs.yaml 2026-03-07 08:51:34,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:51:35,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:51:35,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69abe65f40deb775998f4075/lava_callback.json.gz 2026-03-07 08:51:35,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:35,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65f40deb775998f4075 HTTP/1.1" 200 None 2026-03-07 08:51:35,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:35,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:51:35,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:51:35,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe65f40deb775998f4075 HTTP/1.1" 200 None 2026-03-07 08:51:35,198 - lava_callback - INFO - Completed processing callback for node 69abe65f40deb775998f4075 INFO: 172.19.0.1:40084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58370 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:52:00,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:00,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:46730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33910 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:52:20,559 - lava_callback - INFO - Received callback for node 69a944427ee78ae610caaf10 INFO: 172.19.0.1:49268 - "POST /node/69a944427ee78ae610caaf10 HTTP/1.0" 202 Accepted 2026-03-07 08:52:20,565 - lava_callback - INFO - Starting async job submit for node 69a944427ee78ae610caaf10 2026-03-07 08:52:20,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:20,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944427ee78ae610caaf10 HTTP/1.1" 200 None 2026-03-07 08:52:20,581 - lava_callback - DEBUG - Processing node 69a944427ee78ae610caaf10: baseline-arm64-baylibre 2026-03-07 08:52:20,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a944427ee78ae610caaf10 2026-03-07 08:52:20,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:20,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944427ee78ae610caaf10 HTTP/1.1" 200 None 2026-03-07 08:52:20,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:20,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 08:52:20,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:20,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a944427ee78ae610caaf10 HTTP/1.1" 200 None 2026-03-07 08:52:20,633 - lava_callback - ERROR - Error processing callback for node 69a944427ee78ae610caaf10: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49272 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:52:26,926 - lava_callback - INFO - Received callback for node 69abe65940deb775998f4053 INFO: 172.19.0.1:49278 - "POST /node/69abe65940deb775998f4053 HTTP/1.0" 202 Accepted 2026-03-07 08:52:26,932 - lava_callback - INFO - Starting async job submit for node 69abe65940deb775998f4053 2026-03-07 08:52:26,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:26,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65940deb775998f4053 HTTP/1.1" 200 None 2026-03-07 08:52:26,973 - lava_callback - DEBUG - Processing node 69abe65940deb775998f4053: ltp-containers 2026-03-07 08:52:27,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:27,497 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:27,498 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69abe65940deb775998f4053/log.txt.gz 2026-03-07 08:52:27,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:27,949 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:27,951 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69abe65940deb775998f4053/lava-logs.yaml 2026-03-07 08:52:27,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:28,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:28,138 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69abe65940deb775998f4053/lava_callback.json.gz 2026-03-07 08:52:28,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:28,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65940deb775998f4053 HTTP/1.1" 200 None 2026-03-07 08:52:28,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:28,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:52:28,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:28,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe65940deb775998f4053 HTTP/1.1" 200 None 2026-03-07 08:52:28,221 - lava_callback - INFO - Completed processing callback for node 69abe65940deb775998f4053 2026-03-07 08:52:28,531 - lava_callback - INFO - Received callback for node 69abe65a40deb775998f4056 INFO: 172.19.0.1:49286 - "POST /node/69abe65a40deb775998f4056 HTTP/1.0" 202 Accepted 2026-03-07 08:52:28,539 - lava_callback - INFO - Starting async job submit for node 69abe65a40deb775998f4056 2026-03-07 08:52:28,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:28,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65a40deb775998f4056 HTTP/1.1" 200 None 2026-03-07 08:52:28,596 - lava_callback - DEBUG - Processing node 69abe65a40deb775998f4056: ltp-controllers 2026-03-07 08:52:29,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:29,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:29,176 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69abe65a40deb775998f4056/log.txt.gz 2026-03-07 08:52:29,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:29,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:29,666 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69abe65a40deb775998f4056/lava-logs.yaml 2026-03-07 08:52:29,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:29,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:29,840 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69abe65a40deb775998f4056/lava_callback.json.gz 2026-03-07 08:52:29,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:29,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65a40deb775998f4056 HTTP/1.1" 200 None 2026-03-07 08:52:29,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:29,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:52:29,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:29,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe65a40deb775998f4056 HTTP/1.1" 200 None 2026-03-07 08:52:29,930 - lava_callback - INFO - Completed processing callback for node 69abe65a40deb775998f4056 2026-03-07 08:52:30,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:30,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37820 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:52:36,932 - lava_callback - INFO - Received callback for node 69abe65d40deb775998f406b INFO: 172.19.0.1:37836 - "POST /node/69abe65d40deb775998f406b HTTP/1.0" 202 Accepted 2026-03-07 08:52:36,938 - lava_callback - INFO - Starting async job submit for node 69abe65d40deb775998f406b 2026-03-07 08:52:36,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:37,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65d40deb775998f406b HTTP/1.1" 200 None 2026-03-07 08:52:37,017 - lava_callback - DEBUG - Processing node 69abe65d40deb775998f406b: ltp-cve 2026-03-07 08:52:37,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:37,531 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:37,533 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69abe65d40deb775998f406b/log.txt.gz 2026-03-07 08:52:37,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:37,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:37,979 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69abe65d40deb775998f406b/lava-logs.yaml 2026-03-07 08:52:37,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:38,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:38,179 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69abe65d40deb775998f406b/lava_callback.json.gz 2026-03-07 08:52:38,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:38,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65d40deb775998f406b HTTP/1.1" 200 None 2026-03-07 08:52:38,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:38,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:52:38,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:38,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe65d40deb775998f406b HTTP/1.1" 200 None 2026-03-07 08:52:38,271 - lava_callback - INFO - Completed processing callback for node 69abe65d40deb775998f406b INFO: 172.19.0.1:46308 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:52:47,395 - lava_callback - INFO - Received callback for node 69abe66e40deb775998f40a1 INFO: 172.19.0.1:46320 - "POST /node/69abe66e40deb775998f40a1 HTTP/1.0" 202 Accepted 2026-03-07 08:52:47,402 - lava_callback - INFO - Starting async job submit for node 69abe66e40deb775998f40a1 2026-03-07 08:52:47,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:47,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66e40deb775998f40a1 HTTP/1.1" 200 None 2026-03-07 08:52:47,443 - lava_callback - DEBUG - Processing node 69abe66e40deb775998f40a1: ltp-syscalls 2026-03-07 08:52:48,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:48,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:48,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69abe66e40deb775998f40a1/log.txt.gz 2026-03-07 08:52:48,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:48,910 - lava_callback - INFO - Received callback for node 69abe63b40deb775998f4000 INFO: 172.19.0.1:46334 - "POST /node/69abe63b40deb775998f4000 HTTP/1.0" 202 Accepted 2026-03-07 08:52:48,916 - lava_callback - INFO - Starting async job submit for node 69abe63b40deb775998f4000 2026-03-07 08:52:48,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:48,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63b40deb775998f4000 HTTP/1.1" 200 None 2026-03-07 08:52:48,961 - lava_callback - DEBUG - Processing node 69abe63b40deb775998f4000: baseline-arm-clabbe 2026-03-07 08:52:49,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:49,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69abe66e40deb775998f40a1/lava-logs.yaml 2026-03-07 08:52:49,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:49,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:49,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:49,362 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63b40deb775998f4000/log.txt.gz 2026-03-07 08:52:49,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:49,430 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69abe66e40deb775998f40a1/lava_callback.json.gz 2026-03-07 08:52:49,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:49,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:49,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66e40deb775998f40a1 HTTP/1.1" 200 None 2026-03-07 08:52:49,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:49,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:52:49,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:49,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66e40deb775998f40a1 HTTP/1.1" 200 None 2026-03-07 08:52:49,593 - lava_callback - INFO - Completed processing callback for node 69abe66e40deb775998f40a1 2026-03-07 08:52:49,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:49,817 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63b40deb775998f4000/lava-logs.yaml 2026-03-07 08:52:49,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:52:49,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:52:49,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63b40deb775998f4000/lava_callback.json.gz 2026-03-07 08:52:49,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:50,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63b40deb775998f4000 HTTP/1.1" 200 None 2026-03-07 08:52:50,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:50,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:52:50,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:52:50,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63b40deb775998f4000 HTTP/1.1" 200 None 2026-03-07 08:52:50,060 - lava_callback - INFO - Completed processing callback for node 69abe63b40deb775998f4000 INFO: 172.19.0.1:47602 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:53:00,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:00,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37170 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:53:19,643 - lava_callback - INFO - Received callback for node 69abe55640deb775998f3f10 INFO: 172.19.0.1:37172 - "POST /node/69abe55640deb775998f3f10 HTTP/1.0" 202 Accepted 2026-03-07 08:53:19,649 - lava_callback - INFO - Starting async job submit for node 69abe55640deb775998f3f10 2026-03-07 08:53:19,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:19,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55640deb775998f3f10 HTTP/1.1" 200 None 2026-03-07 08:53:19,688 - lava_callback - DEBUG - Processing node 69abe55640deb775998f3f10: baseline-x86 2026-03-07 08:53:20,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:53:20,166 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:53:20,168 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55640deb775998f3f10/log.txt.gz 2026-03-07 08:53:20,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:53:20,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:53:20,591 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55640deb775998f3f10/lava-logs.yaml 2026-03-07 08:53:20,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:53:20,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:53:20,764 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55640deb775998f3f10/lava_callback.json.gz 2026-03-07 08:53:20,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:20,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55640deb775998f3f10 HTTP/1.1" 200 None 2026-03-07 08:53:20,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:20,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf4740deb775998f3bd2 HTTP/1.1" 200 None 2026-03-07 08:53:20,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:20,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe55640deb775998f3f10 HTTP/1.1" 200 None 2026-03-07 08:53:20,868 - lava_callback - INFO - Completed processing callback for node 69abe55640deb775998f3f10 INFO: 172.19.0.1:54964 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:53:30,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:53:30,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60036 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:54:26,987 - lava_callback - INFO - Received callback for node 69abe66140deb775998f4078 INFO: 172.19.0.1:60052 - "POST /node/69abe66140deb775998f4078 HTTP/1.0" 202 Accepted 2026-03-07 08:54:26,993 - lava_callback - INFO - Starting async job submit for node 69abe66140deb775998f4078 2026-03-07 08:54:27,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:27,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66140deb775998f4078 HTTP/1.1" 200 None 2026-03-07 08:54:27,034 - lava_callback - DEBUG - Processing node 69abe66140deb775998f4078: ltp-fs_bind 2026-03-07 08:54:27,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:27,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:27,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69abe66140deb775998f4078/log.txt.gz 2026-03-07 08:54:27,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:28,081 - lava_callback - INFO - Received callback for node 69abe63d40deb775998f4003 INFO: 172.19.0.1:60066 - "POST /node/69abe63d40deb775998f4003 HTTP/1.0" 202 Accepted 2026-03-07 08:54:28,095 - lava_callback - INFO - Starting async job submit for node 69abe63d40deb775998f4003 2026-03-07 08:54:28,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:28,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63d40deb775998f4003 HTTP/1.1" 200 None 2026-03-07 08:54:28,188 - lava_callback - DEBUG - Processing node 69abe63d40deb775998f4003: baseline-arm-clabbe 2026-03-07 08:54:28,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:28,391 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69abe66140deb775998f4078/lava-logs.yaml 2026-03-07 08:54:28,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:28,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:28,804 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:28,806 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69abe66140deb775998f4078/lava_callback.json.gz 2026-03-07 08:54:28,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:28,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:28,854 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63d40deb775998f4003/log.txt.gz 2026-03-07 08:54:28,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66140deb775998f4078 HTTP/1.1" 200 None 2026-03-07 08:54:28,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:28,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:54:28,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:29,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:29,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66140deb775998f4078 HTTP/1.1" 200 None 2026-03-07 08:54:29,029 - lava_callback - INFO - Completed processing callback for node 69abe66140deb775998f4078 2026-03-07 08:54:29,456 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:29,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63d40deb775998f4003/lava-logs.yaml 2026-03-07 08:54:29,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:54:29,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:54:29,616 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69abe63d40deb775998f4003/lava_callback.json.gz 2026-03-07 08:54:29,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:29,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe63d40deb775998f4003 HTTP/1.1" 200 None 2026-03-07 08:54:29,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:29,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:54:29,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:29,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe63d40deb775998f4003 HTTP/1.1" 200 None 2026-03-07 08:54:29,698 - lava_callback - INFO - Completed processing callback for node 69abe63d40deb775998f4003 2026-03-07 08:54:30,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:54:30,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56912 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36854 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:55:40,766 - lava_callback - INFO - Received callback for node 69a944f77ee78ae610cab093 INFO: 172.19.0.1:54074 - "POST /node/69a944f77ee78ae610cab093 HTTP/1.0" 202 Accepted 2026-03-07 08:55:40,772 - lava_callback - INFO - Starting async job submit for node 69a944f77ee78ae610cab093 2026-03-07 08:55:40,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:40,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944f77ee78ae610cab093 HTTP/1.1" 200 None 2026-03-07 08:55:40,788 - lava_callback - DEBUG - Processing node 69a944f77ee78ae610cab093: baseline-arm64-baylibre 2026-03-07 08:55:40,788 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a944f77ee78ae610cab093 2026-03-07 08:55:40,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:40,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944f77ee78ae610cab093 HTTP/1.1" 200 None 2026-03-07 08:55:40,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:40,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 08:55:40,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:40,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a944f77ee78ae610cab093 HTTP/1.1" 200 None 2026-03-07 08:55:40,848 - lava_callback - ERROR - Error processing callback for node 69a944f77ee78ae610cab093: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:55:41,449 - lava_callback - INFO - Received callback for node 69a944f97ee78ae610cab096 INFO: 172.19.0.1:54086 - "POST /node/69a944f97ee78ae610cab096 HTTP/1.0" 202 Accepted 2026-03-07 08:55:41,457 - lava_callback - INFO - Starting async job submit for node 69a944f97ee78ae610cab096 2026-03-07 08:55:41,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:41,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944f97ee78ae610cab096 HTTP/1.1" 200 None 2026-03-07 08:55:41,480 - lava_callback - DEBUG - Processing node 69a944f97ee78ae610cab096: baseline-arm64-baylibre 2026-03-07 08:55:41,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a944f97ee78ae610cab096 2026-03-07 08:55:41,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:41,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944f97ee78ae610cab096 HTTP/1.1" 200 None 2026-03-07 08:55:41,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:41,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 08:55:41,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:41,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a944f97ee78ae610cab096 HTTP/1.1" 200 None 2026-03-07 08:55:41,542 - lava_callback - ERROR - Error processing callback for node 69a944f97ee78ae610cab096: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:55:42,137 - lava_callback - INFO - Received callback for node 69a944fd7ee78ae610cab0a5 INFO: 172.19.0.1:54102 - "POST /node/69a944fd7ee78ae610cab0a5 HTTP/1.0" 202 Accepted 2026-03-07 08:55:42,145 - lava_callback - INFO - Starting async job submit for node 69a944fd7ee78ae610cab0a5 2026-03-07 08:55:42,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944fd7ee78ae610cab0a5 HTTP/1.1" 200 None 2026-03-07 08:55:42,170 - lava_callback - DEBUG - Processing node 69a944fd7ee78ae610cab0a5: baseline-arm64-baylibre 2026-03-07 08:55:42,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a944fd7ee78ae610cab0a5 2026-03-07 08:55:42,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944fd7ee78ae610cab0a5 HTTP/1.1" 200 None 2026-03-07 08:55:42,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 08:55:42,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a944fd7ee78ae610cab0a5 HTTP/1.1" 200 None 2026-03-07 08:55:42,244 - lava_callback - ERROR - Error processing callback for node 69a944fd7ee78ae610cab0a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 08:55:42,802 - lava_callback - INFO - Received callback for node 69a944ff7ee78ae610cab0a8 INFO: 172.19.0.1:54108 - "POST /node/69a944ff7ee78ae610cab0a8 HTTP/1.0" 202 Accepted 2026-03-07 08:55:42,808 - lava_callback - INFO - Starting async job submit for node 69a944ff7ee78ae610cab0a8 2026-03-07 08:55:42,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944ff7ee78ae610cab0a8 HTTP/1.1" 200 None 2026-03-07 08:55:42,826 - lava_callback - DEBUG - Processing node 69a944ff7ee78ae610cab0a8: baseline-arm64-baylibre 2026-03-07 08:55:42,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a944ff7ee78ae610cab0a8 2026-03-07 08:55:42,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a944ff7ee78ae610cab0a8 HTTP/1.1" 200 None 2026-03-07 08:55:42,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 08:55:42,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:55:42,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a944ff7ee78ae610cab0a8 HTTP/1.1" 200 None 2026-03-07 08:55:42,895 - lava_callback - ERROR - Error processing callback for node 69a944ff7ee78ae610cab0a8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55942 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:56:13,397 - lava_callback - INFO - Received callback for node 69a945207ee78ae610cab125 INFO: 172.19.0.1:37958 - "POST /node/69a945207ee78ae610cab125 HTTP/1.0" 202 Accepted 2026-03-07 08:56:13,403 - lava_callback - INFO - Starting async job submit for node 69a945207ee78ae610cab125 2026-03-07 08:56:13,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:13,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a945207ee78ae610cab125 HTTP/1.1" 200 None 2026-03-07 08:56:13,426 - lava_callback - DEBUG - Processing node 69a945207ee78ae610cab125: baseline-arm64-clabbe 2026-03-07 08:56:13,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a945207ee78ae610cab125 2026-03-07 08:56:13,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:13,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a945207ee78ae610cab125 HTTP/1.1" 200 None 2026-03-07 08:56:13,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:13,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 08:56:13,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:13,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a945207ee78ae610cab125 HTTP/1.1" 200 None 2026-03-07 08:56:13,520 - lava_callback - ERROR - Error processing callback for node 69a945207ee78ae610cab125: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39172 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:56:27,118 - lava_callback - INFO - Received callback for node 69abe66240deb775998f407b INFO: 172.19.0.1:39184 - "POST /node/69abe66240deb775998f407b HTTP/1.0" 202 Accepted 2026-03-07 08:56:27,129 - lava_callback - INFO - Starting async job submit for node 69abe66240deb775998f407b 2026-03-07 08:56:27,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:27,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66240deb775998f407b HTTP/1.1" 200 None 2026-03-07 08:56:27,197 - lava_callback - DEBUG - Processing node 69abe66240deb775998f407b: ltp-fsx 2026-03-07 08:56:27,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:27,785 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:27,787 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69abe66240deb775998f407b/log.txt.gz 2026-03-07 08:56:28,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:28,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:28,706 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69abe66240deb775998f407b/lava-logs.yaml 2026-03-07 08:56:28,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:28,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:28,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69abe66240deb775998f407b/lava_callback.json.gz 2026-03-07 08:56:28,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:28,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66240deb775998f407b HTTP/1.1" 200 None 2026-03-07 08:56:28,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:28,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:56:28,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:28,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66240deb775998f407b HTTP/1.1" 200 None 2026-03-07 08:56:29,000 - lava_callback - INFO - Completed processing callback for node 69abe66240deb775998f407b 2026-03-07 08:56:29,087 - lava_callback - INFO - Received callback for node 69abe66440deb775998f407e INFO: 172.19.0.1:39194 - "POST /node/69abe66440deb775998f407e HTTP/1.0" 202 Accepted 2026-03-07 08:56:29,094 - lava_callback - INFO - Starting async job submit for node 69abe66440deb775998f407e 2026-03-07 08:56:29,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:29,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66440deb775998f407e HTTP/1.1" 200 None 2026-03-07 08:56:29,163 - lava_callback - DEBUG - Processing node 69abe66440deb775998f407e: ltp-input 2026-03-07 08:56:29,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:29,982 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:29,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69abe66440deb775998f407e/log.txt.gz 2026-03-07 08:56:30,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:30,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:30,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 08:56:30,504 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:30,506 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69abe66440deb775998f407e/lava-logs.yaml 2026-03-07 08:56:30,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:30,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:30,660 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69abe66440deb775998f407e/lava_callback.json.gz 2026-03-07 08:56:30,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:30,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66440deb775998f407e HTTP/1.1" 200 None 2026-03-07 08:56:30,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:30,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:56:30,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:30,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66440deb775998f407e HTTP/1.1" 200 None 2026-03-07 08:56:30,783 - lava_callback - INFO - Completed processing callback for node 69abe66440deb775998f407e INFO: 172.19.0.1:34882 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:56:37,142 - lava_callback - INFO - Received callback for node 69abe66640deb775998f4081 INFO: 172.19.0.1:34898 - "POST /node/69abe66640deb775998f4081 HTTP/1.0" 202 Accepted 2026-03-07 08:56:37,149 - lava_callback - INFO - Starting async job submit for node 69abe66640deb775998f4081 2026-03-07 08:56:37,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:37,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66640deb775998f4081 HTTP/1.1" 200 None 2026-03-07 08:56:37,192 - lava_callback - DEBUG - Processing node 69abe66640deb775998f4081: ltp-ipc 2026-03-07 08:56:37,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:37,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:37,936 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69abe66640deb775998f4081/log.txt.gz 2026-03-07 08:56:38,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:38,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:38,398 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69abe66640deb775998f4081/lava-logs.yaml 2026-03-07 08:56:38,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:56:38,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:56:38,638 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69abe66640deb775998f4081/lava_callback.json.gz 2026-03-07 08:56:38,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:38,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66640deb775998f4081 HTTP/1.1" 200 None 2026-03-07 08:56:38,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:38,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:56:38,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:56:38,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66640deb775998f4081 HTTP/1.1" 200 None 2026-03-07 08:56:38,752 - lava_callback - INFO - Completed processing callback for node 69abe66640deb775998f4081 INFO: 172.19.0.1:56992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59826 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:57:00,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:57:00,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42518 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:57:47,102 - lava_callback - INFO - Received callback for node 69abe65740deb775998f4050 INFO: 172.19.0.1:42526 - "POST /node/69abe65740deb775998f4050 HTTP/1.0" 202 Accepted 2026-03-07 08:57:47,109 - lava_callback - INFO - Starting async job submit for node 69abe65740deb775998f4050 2026-03-07 08:57:47,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:57:47,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65740deb775998f4050 HTTP/1.1" 200 None 2026-03-07 08:57:47,148 - lava_callback - DEBUG - Processing node 69abe65740deb775998f4050: ltp-cap_bounds 2026-03-07 08:57:47,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:57:47,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:57:47,669 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69abe65740deb775998f4050/log.txt.gz 2026-03-07 08:57:47,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:57:48,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:57:48,088 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69abe65740deb775998f4050/lava-logs.yaml 2026-03-07 08:57:48,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:57:48,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:57:48,269 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69abe65740deb775998f4050/lava_callback.json.gz 2026-03-07 08:57:48,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:57:48,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe65740deb775998f4050 HTTP/1.1" 200 None 2026-03-07 08:57:48,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:57:48,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:57:48,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:57:48,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe65740deb775998f4050 HTTP/1.1" 200 None 2026-03-07 08:57:48,351 - lava_callback - INFO - Completed processing callback for node 69abe65740deb775998f4050 INFO: 172.19.0.1:38992 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:58:00,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:58:00,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39880 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:58:47,183 - lava_callback - INFO - Received callback for node 69abe66840deb775998f4084 INFO: 172.19.0.1:39894 - "POST /node/69abe66840deb775998f4084 HTTP/1.0" 202 Accepted 2026-03-07 08:58:47,192 - lava_callback - INFO - Starting async job submit for node 69abe66840deb775998f4084 2026-03-07 08:58:47,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:58:47,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66840deb775998f4084 HTTP/1.1" 200 None 2026-03-07 08:58:47,237 - lava_callback - DEBUG - Processing node 69abe66840deb775998f4084: ltp-pty 2026-03-07 08:58:47,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:58:47,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:58:47,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69abe66840deb775998f4084/log.txt.gz 2026-03-07 08:58:48,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:58:48,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:58:48,349 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69abe66840deb775998f4084/lava-logs.yaml 2026-03-07 08:58:48,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:58:48,594 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:58:48,596 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69abe66840deb775998f4084/lava_callback.json.gz 2026-03-07 08:58:48,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:58:48,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66840deb775998f4084 HTTP/1.1" 200 None 2026-03-07 08:58:48,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:58:48,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:58:48,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:58:48,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66840deb775998f4084 HTTP/1.1" 200 None 2026-03-07 08:58:48,760 - lava_callback - INFO - Completed processing callback for node 69abe66840deb775998f4084 INFO: 172.19.0.1:56578 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:59:00,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:00,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57840 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:59:07,768 - lava_callback - INFO - Received callback for node 69abe8ca40deb775998f4298 INFO: 172.19.0.1:57856 - "POST /node/69abe8ca40deb775998f4298 HTTP/1.0" 202 Accepted 2026-03-07 08:59:07,778 - lava_callback - INFO - Starting async job submit for node 69abe8ca40deb775998f4298 2026-03-07 08:59:07,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:07,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe8ca40deb775998f4298 HTTP/1.1" 200 None 2026-03-07 08:59:07,816 - lava_callback - DEBUG - Processing node 69abe8ca40deb775998f4298: baseline-arm 2026-03-07 08:59:07,825 - lava_callback - WARNING - Failed to upload log 2026-03-07 08:59:07,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:59:08,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:59:08,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe8ca40deb775998f4298/lava-logs.yaml 2026-03-07 08:59:08,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:59:08,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:59:08,242 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe8ca40deb775998f4298/lava_callback.json.gz 2026-03-07 08:59:08,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:08,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe8ca40deb775998f4298 HTTP/1.1" 200 None 2026-03-07 08:59:08,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:08,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 08:59:08,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:08,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe8ca40deb775998f4298 HTTP/1.1" 200 None 2026-03-07 08:59:08,340 - lava_callback - INFO - Completed processing callback for node 69abe8ca40deb775998f4298 INFO: 172.19.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60364 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:59:30,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:30,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59876 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:59:44,500 - lava_callback - INFO - Received callback for node 69abe55740deb775998f3f13 INFO: 172.19.0.1:42952 - "POST /node/69abe55740deb775998f3f13 HTTP/1.0" 202 Accepted 2026-03-07 08:59:44,508 - lava_callback - INFO - Starting async job submit for node 69abe55740deb775998f3f13 2026-03-07 08:59:44,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:44,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55740deb775998f3f13 HTTP/1.1" 200 None 2026-03-07 08:59:44,571 - lava_callback - DEBUG - Processing node 69abe55740deb775998f3f13: baseline-x86 2026-03-07 08:59:45,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:59:46,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:59:46,072 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f13/log.txt.gz INFO: 172.19.0.1:42964 - "GET / HTTP/1.0" 200 OK 2026-03-07 08:59:46,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:59:47,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:59:47,441 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f13/lava-logs.yaml 2026-03-07 08:59:47,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 08:59:47,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 08:59:47,674 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69abe55740deb775998f3f13/lava_callback.json.gz DEBUG: Setup failed for 69abe55740deb775998f3f13. Transitting job node result: incomplete -> fail 2026-03-07 08:59:47,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:47,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe55740deb775998f3f13 HTTP/1.1" 200 None 2026-03-07 08:59:47,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:47,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf4740deb775998f3bd2 HTTP/1.1" 200 None 2026-03-07 08:59:47,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 08:59:47,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe55740deb775998f3f13 HTTP/1.1" 200 None 2026-03-07 08:59:48,012 - lava_callback - INFO - Completed processing callback for node 69abe55740deb775998f3f13 INFO: 172.19.0.1:52958 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:00:00,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:00,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58310 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:00:27,830 - lava_callback - INFO - Received callback for node 69abe66a40deb775998f4095 INFO: 172.19.0.1:58322 - "POST /node/69abe66a40deb775998f4095 HTTP/1.0" 202 Accepted 2026-03-07 09:00:27,838 - lava_callback - INFO - Starting async job submit for node 69abe66a40deb775998f4095 2026-03-07 09:00:27,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:27,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66a40deb775998f4095 HTTP/1.1" 200 None 2026-03-07 09:00:27,882 - lava_callback - DEBUG - Processing node 69abe66a40deb775998f4095: ltp-sched 2026-03-07 09:00:28,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:28,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:28,432 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69abe66a40deb775998f4095/log.txt.gz 2026-03-07 09:00:28,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:29,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:29,356 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69abe66a40deb775998f4095/lava-logs.yaml 2026-03-07 09:00:29,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:29,483 - lava_callback - INFO - Received callback for node 69abe66f40deb775998f40a4 INFO: 172.19.0.1:58332 - "POST /node/69abe66f40deb775998f40a4 HTTP/1.0" 202 Accepted 2026-03-07 09:00:29,497 - lava_callback - INFO - Starting async job submit for node 69abe66f40deb775998f40a4 2026-03-07 09:00:29,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:29,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66f40deb775998f40a4 HTTP/1.1" 200 None 2026-03-07 09:00:29,558 - lava_callback - DEBUG - Processing node 69abe66f40deb775998f40a4: ltp-syscalls-ipc 2026-03-07 09:00:29,595 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:29,642 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69abe66a40deb775998f4095/lava_callback.json.gz 2026-03-07 09:00:29,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:29,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66a40deb775998f4095 HTTP/1.1" 200 None 2026-03-07 09:00:29,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:29,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:00:29,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:30,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66a40deb775998f4095 HTTP/1.1" 200 None 2026-03-07 09:00:30,092 - lava_callback - INFO - Completed processing callback for node 69abe66a40deb775998f4095 2026-03-07 09:00:30,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:30,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:30,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 09:00:30,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:30,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69abe66f40deb775998f40a4/log.txt.gz 2026-03-07 09:00:31,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:31,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:31,403 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69abe66f40deb775998f40a4/lava-logs.yaml 2026-03-07 09:00:31,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:31,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:31,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69abe66f40deb775998f40a4/lava_callback.json.gz 2026-03-07 09:00:31,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:31,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66f40deb775998f40a4 HTTP/1.1" 200 None 2026-03-07 09:00:31,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:31,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:00:31,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:31,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66f40deb775998f40a4 HTTP/1.1" 200 None 2026-03-07 09:00:31,818 - lava_callback - INFO - Completed processing callback for node 69abe66f40deb775998f40a4 INFO: 172.19.0.1:55742 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:00:37,246 - lava_callback - INFO - Received callback for node 69abe66c40deb775998f409e INFO: 172.19.0.1:55746 - "POST /node/69abe66c40deb775998f409e HTTP/1.0" 202 Accepted 2026-03-07 09:00:37,253 - lava_callback - INFO - Starting async job submit for node 69abe66c40deb775998f409e 2026-03-07 09:00:37,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:37,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66c40deb775998f409e HTTP/1.1" 200 None 2026-03-07 09:00:37,302 - lava_callback - DEBUG - Processing node 69abe66c40deb775998f409e: ltp-smoke 2026-03-07 09:00:37,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:38,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:38,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe66c40deb775998f409e/log.txt.gz 2026-03-07 09:00:38,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:38,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:38,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe66c40deb775998f409e/lava-logs.yaml 2026-03-07 09:00:38,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:00:38,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:00:38,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe66c40deb775998f409e/lava_callback.json.gz 2026-03-07 09:00:38,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:38,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe66c40deb775998f409e HTTP/1.1" 200 None 2026-03-07 09:00:38,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:38,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:00:38,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:39,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe66c40deb775998f409e HTTP/1.1" 200 None 2026-03-07 09:00:39,053 - lava_callback - INFO - Completed processing callback for node 69abe66c40deb775998f409e 2026-03-07 09:00:41,082 - lava_callback - INFO - Received callback for node 69a9462a7ee78ae610cab476 INFO: 172.19.0.1:33782 - "POST /node/69a9462a7ee78ae610cab476 HTTP/1.0" 202 Accepted 2026-03-07 09:00:41,091 - lava_callback - INFO - Starting async job submit for node 69a9462a7ee78ae610cab476 2026-03-07 09:00:41,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:41,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9462a7ee78ae610cab476 HTTP/1.1" 200 None 2026-03-07 09:00:41,122 - lava_callback - DEBUG - Processing node 69a9462a7ee78ae610cab476: baseline-arm64-baylibre 2026-03-07 09:00:41,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9462a7ee78ae610cab476 2026-03-07 09:00:41,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:41,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9462a7ee78ae610cab476 HTTP/1.1" 200 None 2026-03-07 09:00:41,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:41,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 09:00:41,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:00:41,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9462a7ee78ae610cab476 HTTP/1.1" 200 None 2026-03-07 09:00:41,221 - lava_callback - ERROR - Error processing callback for node 69a9462a7ee78ae610cab476: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40082 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:01:00,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:00,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43306 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:01:41,002 - lava_callback - INFO - Received callback for node 69a946717ee78ae610cab4e5 INFO: 172.19.0.1:34744 - "POST /node/69a946717ee78ae610cab4e5 HTTP/1.0" 202 Accepted 2026-03-07 09:01:41,010 - lava_callback - INFO - Starting async job submit for node 69a946717ee78ae610cab4e5 2026-03-07 09:01:41,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:41,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946717ee78ae610cab4e5 HTTP/1.1" 200 None 2026-03-07 09:01:41,028 - lava_callback - DEBUG - Processing node 69a946717ee78ae610cab4e5: baseline-arm-baylibre 2026-03-07 09:01:41,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a946717ee78ae610cab4e5 2026-03-07 09:01:41,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:41,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946717ee78ae610cab4e5 HTTP/1.1" 200 None 2026-03-07 09:01:41,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:41,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:01:41,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:41,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a946717ee78ae610cab4e5 HTTP/1.1" 200 None 2026-03-07 09:01:41,090 - lava_callback - ERROR - Error processing callback for node 69a946717ee78ae610cab4e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 09:01:49,721 - lava_callback - INFO - Received callback for node 69abe94340deb775998f42f1 INFO: 172.19.0.1:39292 - "POST /node/69abe94340deb775998f42f1 HTTP/1.0" 202 Accepted 2026-03-07 09:01:49,727 - lava_callback - INFO - Starting async job submit for node 69abe94340deb775998f42f1 2026-03-07 09:01:49,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:49,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe94340deb775998f42f1 HTTP/1.1" 200 None 2026-03-07 09:01:49,764 - lava_callback - DEBUG - Processing node 69abe94340deb775998f42f1: baseline-arm-pengutronix 2026-03-07 09:01:49,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:01:50,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:01:50,069 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe94340deb775998f42f1/log.txt.gz 2026-03-07 09:01:50,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:01:50,343 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:01:50,345 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe94340deb775998f42f1/lava-logs.yaml 2026-03-07 09:01:50,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:01:50,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:01:50,492 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe94340deb775998f42f1/lava_callback.json.gz 2026-03-07 09:01:50,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:50,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe94340deb775998f42f1 HTTP/1.1" 200 None INFO: 172.19.0.1:39308 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:01:50,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:50,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:01:50,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:01:50,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe94340deb775998f42f1 HTTP/1.1" 200 None 2026-03-07 09:01:50,575 - lava_callback - INFO - Completed processing callback for node 69abe94340deb775998f42f1 INFO: 172.19.0.1:39316 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:02:00,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:00,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:34454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47640 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:02:37,136 - lava_callback - INFO - Received callback for node 69abe98d40deb775998f4366 INFO: 172.19.0.1:47644 - "POST /node/69abe98d40deb775998f4366 HTTP/1.0" 202 Accepted 2026-03-07 09:02:37,143 - lava_callback - INFO - Starting async job submit for node 69abe98d40deb775998f4366 2026-03-07 09:02:37,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:37,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98d40deb775998f4366 HTTP/1.1" 200 None 2026-03-07 09:02:37,179 - lava_callback - DEBUG - Processing node 69abe98d40deb775998f4366: baseline-arm64 2026-03-07 09:02:37,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:37,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:37,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98d40deb775998f4366/log.txt.gz 2026-03-07 09:02:37,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:38,012 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:38,014 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98d40deb775998f4366/lava-logs.yaml 2026-03-07 09:02:38,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:38,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:38,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98d40deb775998f4366/lava_callback.json.gz 2026-03-07 09:02:38,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:38,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98d40deb775998f4366 HTTP/1.1" 200 None 2026-03-07 09:02:38,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:38,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:02:38,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:38,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98d40deb775998f4366 HTTP/1.1" 200 None 2026-03-07 09:02:38,334 - lava_callback - INFO - Completed processing callback for node 69abe98d40deb775998f4366 2026-03-07 09:02:39,406 - lava_callback - INFO - Received callback for node 69abe99c40deb775998f4391 INFO: 172.19.0.1:47660 - "POST /node/69abe99c40deb775998f4391 HTTP/1.0" 202 Accepted 2026-03-07 09:02:39,413 - lava_callback - INFO - Starting async job submit for node 69abe99c40deb775998f4391 2026-03-07 09:02:39,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:39,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99c40deb775998f4391 HTTP/1.1" 200 None 2026-03-07 09:02:39,434 - lava_callback - DEBUG - Processing node 69abe99c40deb775998f4391: baseline-nfs-arm64 2026-03-07 09:02:39,436 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:02:39,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:39,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:39,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99c40deb775998f4391/lava-logs.yaml 2026-03-07 09:02:39,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:39,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:39,707 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99c40deb775998f4391/lava_callback.json.gz 2026-03-07 09:02:39,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:39,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99c40deb775998f4391 HTTP/1.1" 200 None 2026-03-07 09:02:39,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:39,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:02:39,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:39,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99c40deb775998f4391 HTTP/1.1" 200 None 2026-03-07 09:02:39,779 - lava_callback - INFO - Completed processing callback for node 69abe99c40deb775998f4391 2026-03-07 09:02:41,124 - lava_callback - INFO - Received callback for node 69a9469f7ee78ae610cab52a INFO: 172.19.0.1:55034 - "POST /node/69a9469f7ee78ae610cab52a HTTP/1.0" 202 Accepted 2026-03-07 09:02:41,133 - lava_callback - INFO - Starting async job submit for node 69a9469f7ee78ae610cab52a 2026-03-07 09:02:41,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:41,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9469f7ee78ae610cab52a HTTP/1.1" 200 None 2026-03-07 09:02:41,192 - lava_callback - DEBUG - Processing node 69a9469f7ee78ae610cab52a: baseline-arm-baylibre 2026-03-07 09:02:41,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9469f7ee78ae610cab52a 2026-03-07 09:02:41,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:41,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9469f7ee78ae610cab52a HTTP/1.1" 200 None 2026-03-07 09:02:41,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:41,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:02:41,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:41,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9469f7ee78ae610cab52a HTTP/1.1" 200 None 2026-03-07 09:02:41,318 - lava_callback - ERROR - Error processing callback for node 69a9469f7ee78ae610cab52a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55042 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:02:46,852 - lava_callback - INFO - Received callback for node 69abe98140deb775998f432d INFO: 172.19.0.1:55052 - "POST /node/69abe98140deb775998f432d HTTP/1.0" 202 Accepted 2026-03-07 09:02:46,859 - lava_callback - INFO - Starting async job submit for node 69abe98140deb775998f432d 2026-03-07 09:02:46,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:46,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98140deb775998f432d HTTP/1.1" 200 None 2026-03-07 09:02:46,893 - lava_callback - DEBUG - Processing node 69abe98140deb775998f432d: baseline-arm64 2026-03-07 09:02:47,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:47,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:47,171 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f432d/log.txt.gz 2026-03-07 09:02:47,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:47,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:47,572 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f432d/lava-logs.yaml 2026-03-07 09:02:47,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:02:47,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:02:47,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f432d/lava_callback.json.gz 2026-03-07 09:02:47,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:47,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98140deb775998f432d HTTP/1.1" 200 None 2026-03-07 09:02:47,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:47,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:02:47,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:02:47,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98140deb775998f432d HTTP/1.1" 200 None 2026-03-07 09:02:47,832 - lava_callback - INFO - Completed processing callback for node 69abe98140deb775998f432d INFO: 172.19.0.1:55110 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:00,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:00,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 09:03:03,892 - lava_callback - INFO - Received callback for node 69abe98640deb775998f4341 INFO: 172.19.0.1:44512 - "POST /node/69abe98640deb775998f4341 HTTP/1.0" 202 Accepted 2026-03-07 09:03:03,899 - lava_callback - INFO - Starting async job submit for node 69abe98640deb775998f4341 2026-03-07 09:03:03,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:03,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98640deb775998f4341 HTTP/1.1" 200 None 2026-03-07 09:03:03,948 - lava_callback - DEBUG - Processing node 69abe98640deb775998f4341: baseline-arm64 2026-03-07 09:03:04,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:04,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:04,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98640deb775998f4341/log.txt.gz 2026-03-07 09:03:04,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:04,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:04,689 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98640deb775998f4341/lava-logs.yaml 2026-03-07 09:03:04,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:05,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:05,207 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98640deb775998f4341/lava_callback.json.gz 2026-03-07 09:03:05,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:05,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98640deb775998f4341 HTTP/1.1" 200 None 2026-03-07 09:03:05,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:05,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:05,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:05,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98640deb775998f4341 HTTP/1.1" 200 None 2026-03-07 09:03:05,434 - lava_callback - INFO - Completed processing callback for node 69abe98640deb775998f4341 INFO: 172.19.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44532 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:08,135 - lava_callback - INFO - Received callback for node 69abe67440deb775998f40aa INFO: 172.19.0.1:44546 - "POST /node/69abe67440deb775998f40aa HTTP/1.0" 202 Accepted 2026-03-07 09:03:08,145 - lava_callback - INFO - Starting async job submit for node 69abe67440deb775998f40aa 2026-03-07 09:03:08,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:08,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe67440deb775998f40aa HTTP/1.1" 200 None 2026-03-07 09:03:08,227 - lava_callback - DEBUG - Processing node 69abe67440deb775998f40aa: ltp-watchqueue 2026-03-07 09:03:08,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:09,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:09,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69abe67440deb775998f40aa/log.txt.gz 2026-03-07 09:03:09,661 - lava_callback - INFO - Received callback for node 69abe98240deb775998f4333 INFO: 172.19.0.1:44560 - "POST /node/69abe98240deb775998f4333 HTTP/1.0" 202 Accepted 2026-03-07 09:03:09,681 - lava_callback - INFO - Starting async job submit for node 69abe98240deb775998f4333 2026-03-07 09:03:09,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:09,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98240deb775998f4333 HTTP/1.1" 200 None 2026-03-07 09:03:09,788 - lava_callback - DEBUG - Processing node 69abe98240deb775998f4333: baseline-arm64 2026-03-07 09:03:09,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:10,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:10,321 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69abe67440deb775998f40aa/lava-logs.yaml 2026-03-07 09:03:10,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:10,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:10,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:10,459 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98240deb775998f4333/log.txt.gz 2026-03-07 09:03:10,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:10,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:10,894 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69abe67440deb775998f40aa/lava_callback.json.gz 2026-03-07 09:03:10,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:10,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe67440deb775998f40aa HTTP/1.1" 200 None 2026-03-07 09:03:10,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:11,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:03:11,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:11,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe67440deb775998f40aa HTTP/1.1" 200 None 2026-03-07 09:03:11,078 - lava_callback - INFO - Completed processing callback for node 69abe67440deb775998f40aa 2026-03-07 09:03:11,285 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:11,288 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98240deb775998f4333/lava-logs.yaml 2026-03-07 09:03:11,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:11,885 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:11,887 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98240deb775998f4333/lava_callback.json.gz 2026-03-07 09:03:11,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:11,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98240deb775998f4333 HTTP/1.1" 200 None 2026-03-07 09:03:11,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:11,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:11,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:12,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98240deb775998f4333 HTTP/1.1" 200 None 2026-03-07 09:03:12,007 - lava_callback - INFO - Completed processing callback for node 69abe98240deb775998f4333 2026-03-07 09:03:14,356 - lava_callback - INFO - Received callback for node 69abe98440deb775998f4339 INFO: 172.19.0.1:37692 - "POST /node/69abe98440deb775998f4339 HTTP/1.0" 202 Accepted 2026-03-07 09:03:14,364 - lava_callback - INFO - Starting async job submit for node 69abe98440deb775998f4339 2026-03-07 09:03:14,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:14,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98440deb775998f4339 HTTP/1.1" 200 None 2026-03-07 09:03:14,410 - lava_callback - DEBUG - Processing node 69abe98440deb775998f4339: baseline-arm64 2026-03-07 09:03:14,627 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:03:14,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:14,968 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:14,970 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98440deb775998f4339/lava-logs.yaml 2026-03-07 09:03:14,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:15,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:15,126 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98440deb775998f4339/lava_callback.json.gz INFO: 172.19.0.1:37706 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 09:03:15,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:15,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98440deb775998f4339 HTTP/1.1" 200 None 2026-03-07 09:03:15,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:15,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:15,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:15,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98440deb775998f4339 HTTP/1.1" 200 None 2026-03-07 09:03:15,310 - lava_callback - INFO - Completed processing callback for node 69abe98440deb775998f4339 INFO: 172.19.0.1:37708 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:16,797 - lava_callback - INFO - Received callback for node 69abe98940deb775998f435c INFO: 172.19.0.1:37718 - "POST /node/69abe98940deb775998f435c HTTP/1.0" 202 Accepted 2026-03-07 09:03:16,807 - lava_callback - INFO - Starting async job submit for node 69abe98940deb775998f435c 2026-03-07 09:03:16,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:16,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98940deb775998f435c HTTP/1.1" 200 None 2026-03-07 09:03:16,863 - lava_callback - DEBUG - Processing node 69abe98940deb775998f435c: baseline-arm64 2026-03-07 09:03:17,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:17,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:17,514 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98940deb775998f435c/log.txt.gz 2026-03-07 09:03:17,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:17,985 - lava_callback - INFO - Received callback for node 69abe98b40deb775998f435f INFO: 172.19.0.1:37728 - "POST /node/69abe98b40deb775998f435f HTTP/1.0" 202 Accepted 2026-03-07 09:03:17,994 - lava_callback - INFO - Starting async job submit for node 69abe98b40deb775998f435f 2026-03-07 09:03:18,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:18,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98b40deb775998f435f HTTP/1.1" 200 None 2026-03-07 09:03:18,103 - lava_callback - DEBUG - Processing node 69abe98b40deb775998f435f: baseline-arm64 2026-03-07 09:03:18,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:18,381 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98940deb775998f435c/lava-logs.yaml 2026-03-07 09:03:18,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:18,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:18,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:18,997 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98b40deb775998f435f/log.txt.gz 2026-03-07 09:03:19,013 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:19,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98940deb775998f435c/lava_callback.json.gz 2026-03-07 09:03:19,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:19,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98940deb775998f435c HTTP/1.1" 200 None 2026-03-07 09:03:19,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:19,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:19,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:19,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:19,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98940deb775998f435c HTTP/1.1" 200 None 2026-03-07 09:03:19,305 - lava_callback - INFO - Completed processing callback for node 69abe98940deb775998f435c 2026-03-07 09:03:19,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:19,885 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98b40deb775998f435f/lava-logs.yaml 2026-03-07 09:03:19,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:20,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:20,063 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98b40deb775998f435f/lava_callback.json.gz 2026-03-07 09:03:20,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:20,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98b40deb775998f435f HTTP/1.1" 200 None 2026-03-07 09:03:20,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:20,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:20,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:20,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98b40deb775998f435f HTTP/1.1" 200 None 2026-03-07 09:03:20,217 - lava_callback - INFO - Completed processing callback for node 69abe98b40deb775998f435f 2026-03-07 09:03:21,084 - lava_callback - INFO - Received callback for node 69a946cd7ee78ae610cab582 INFO: 172.19.0.1:40966 - "POST /node/69a946cd7ee78ae610cab582 HTTP/1.0" 202 Accepted 2026-03-07 09:03:21,093 - lava_callback - INFO - Starting async job submit for node 69a946cd7ee78ae610cab582 2026-03-07 09:03:21,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:21,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946cd7ee78ae610cab582 HTTP/1.1" 200 None 2026-03-07 09:03:21,117 - lava_callback - DEBUG - Processing node 69a946cd7ee78ae610cab582: baseline-arm-baylibre 2026-03-07 09:03:21,117 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a946cd7ee78ae610cab582 2026-03-07 09:03:21,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:21,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946cd7ee78ae610cab582 HTTP/1.1" 200 None 2026-03-07 09:03:21,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:21,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:03:21,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:21,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a946cd7ee78ae610cab582 HTTP/1.1" 200 None 2026-03-07 09:03:21,196 - lava_callback - ERROR - Error processing callback for node 69a946cd7ee78ae610cab582: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 09:03:21,239 - lava_callback - INFO - Received callback for node 69abe99040deb775998f4371 INFO: 172.19.0.1:40972 - "POST /node/69abe99040deb775998f4371 HTTP/1.0" 202 Accepted 2026-03-07 09:03:21,248 - lava_callback - INFO - Starting async job submit for node 69abe99040deb775998f4371 2026-03-07 09:03:21,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:21,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99040deb775998f4371 HTTP/1.1" 200 None 2026-03-07 09:03:21,312 - lava_callback - DEBUG - Processing node 69abe99040deb775998f4371: baseline-arm64 2026-03-07 09:03:21,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:21,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:21,965 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99040deb775998f4371/log.txt.gz 2026-03-07 09:03:22,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:22,571 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:22,573 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99040deb775998f4371/lava-logs.yaml 2026-03-07 09:03:22,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:22,637 - lava_callback - INFO - Received callback for node 69abe98840deb775998f4356 INFO: 172.19.0.1:40986 - "POST /node/69abe98840deb775998f4356 HTTP/1.0" 202 Accepted 2026-03-07 09:03:22,647 - lava_callback - INFO - Starting async job submit for node 69abe98840deb775998f4356 2026-03-07 09:03:22,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:22,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98840deb775998f4356 HTTP/1.1" 200 None 2026-03-07 09:03:22,701 - lava_callback - DEBUG - Processing node 69abe98840deb775998f4356: baseline-arm64 2026-03-07 09:03:22,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:22,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99040deb775998f4371/lava_callback.json.gz 2026-03-07 09:03:22,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:22,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99040deb775998f4371 HTTP/1.1" 200 None 2026-03-07 09:03:22,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:23,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:23,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:23,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:23,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99040deb775998f4371 HTTP/1.1" 200 None 2026-03-07 09:03:23,164 - lava_callback - INFO - Completed processing callback for node 69abe99040deb775998f4371 2026-03-07 09:03:23,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:23,453 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98840deb775998f4356/log.txt.gz 2026-03-07 09:03:23,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:24,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:24,183 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98840deb775998f4356/lava-logs.yaml 2026-03-07 09:03:24,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:24,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:24,396 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98840deb775998f4356/lava_callback.json.gz 2026-03-07 09:03:24,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:24,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98840deb775998f4356 HTTP/1.1" 200 None 2026-03-07 09:03:24,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:24,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:24,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:24,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98840deb775998f4356 HTTP/1.1" 200 None 2026-03-07 09:03:24,482 - lava_callback - INFO - Completed processing callback for node 69abe98840deb775998f4356 2026-03-07 09:03:26,002 - lava_callback - INFO - Received callback for node 69abe98c40deb775998f4362 INFO: 172.19.0.1:41002 - "POST /node/69abe98c40deb775998f4362 HTTP/1.0" 202 Accepted 2026-03-07 09:03:26,013 - lava_callback - INFO - Starting async job submit for node 69abe98c40deb775998f4362 2026-03-07 09:03:26,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:26,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98c40deb775998f4362 HTTP/1.1" 200 None 2026-03-07 09:03:26,068 - lava_callback - DEBUG - Processing node 69abe98c40deb775998f4362: baseline-arm64 INFO: 172.19.0.1:41018 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:26,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:26,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:26,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98c40deb775998f4362/log.txt.gz 2026-03-07 09:03:27,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:27,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:27,608 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98c40deb775998f4362/lava-logs.yaml 2026-03-07 09:03:27,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:27,667 - lava_callback - INFO - Received callback for node 69abe98140deb775998f4330 INFO: 172.19.0.1:41022 - "POST /node/69abe98140deb775998f4330 HTTP/1.0" 202 Accepted 2026-03-07 09:03:27,674 - lava_callback - INFO - Starting async job submit for node 69abe98140deb775998f4330 2026-03-07 09:03:27,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:27,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98140deb775998f4330 HTTP/1.1" 200 None 2026-03-07 09:03:27,724 - lava_callback - DEBUG - Processing node 69abe98140deb775998f4330: baseline-arm64 2026-03-07 09:03:27,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:27,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98c40deb775998f4362/lava_callback.json.gz 2026-03-07 09:03:27,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:27,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98c40deb775998f4362 HTTP/1.1" 200 None 2026-03-07 09:03:27,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:28,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:28,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:28,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98c40deb775998f4362 HTTP/1.1" 200 None 2026-03-07 09:03:28,169 - lava_callback - INFO - Completed processing callback for node 69abe98c40deb775998f4362 2026-03-07 09:03:28,209 - lava_callback - INFO - Received callback for node 69abe98340deb775998f4336 INFO: 172.19.0.1:41026 - "POST /node/69abe98340deb775998f4336 HTTP/1.0" 202 Accepted 2026-03-07 09:03:28,249 - lava_callback - INFO - Starting async job submit for node 69abe98340deb775998f4336 2026-03-07 09:03:28,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:28,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:28,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98340deb775998f4336 HTTP/1.1" 200 None 2026-03-07 09:03:28,375 - lava_callback - DEBUG - Processing node 69abe98340deb775998f4336: baseline-arm64 2026-03-07 09:03:28,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:28,636 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f4330/log.txt.gz 2026-03-07 09:03:29,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:29,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:29,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:29,374 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98340deb775998f4336/log.txt.gz 2026-03-07 09:03:29,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:29,518 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f4330/lava-logs.yaml 2026-03-07 09:03:29,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:29,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:30,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:30,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98140deb775998f4330/lava_callback.json.gz 2026-03-07 09:03:30,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:30,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:30,303 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98340deb775998f4336/lava-logs.yaml 2026-03-07 09:03:30,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98140deb775998f4330 HTTP/1.1" 200 None 2026-03-07 09:03:30,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:30,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:30,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:30,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:30,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98140deb775998f4330 HTTP/1.1" 200 None 2026-03-07 09:03:30,379 - lava_callback - INFO - Completed processing callback for node 69abe98140deb775998f4330 2026-03-07 09:03:30,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:30,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-07 09:03:30,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:30,988 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98340deb775998f4336/lava_callback.json.gz 2026-03-07 09:03:31,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:31,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98340deb775998f4336 HTTP/1.1" 200 None 2026-03-07 09:03:31,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:31,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:31,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:31,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98340deb775998f4336 HTTP/1.1" 200 None 2026-03-07 09:03:31,180 - lava_callback - INFO - Completed processing callback for node 69abe98340deb775998f4336 INFO: 172.19.0.1:58582 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:39,756 - lava_callback - INFO - Received callback for node 69abe9a040deb775998f439a INFO: 172.19.0.1:41798 - "POST /node/69abe9a040deb775998f439a HTTP/1.0" 202 Accepted 2026-03-07 09:03:39,767 - lava_callback - INFO - Starting async job submit for node 69abe9a040deb775998f439a 2026-03-07 09:03:39,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:39,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9a040deb775998f439a HTTP/1.1" 200 None 2026-03-07 09:03:39,848 - lava_callback - DEBUG - Processing node 69abe9a040deb775998f439a: baseline-nfs-arm64 2026-03-07 09:03:40,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:40,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:40,612 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a040deb775998f439a/log.txt.gz 2026-03-07 09:03:40,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:41,259 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:41,261 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a040deb775998f439a/lava-logs.yaml 2026-03-07 09:03:41,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:41,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:41,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a040deb775998f439a/lava_callback.json.gz 2026-03-07 09:03:41,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:41,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9a040deb775998f439a HTTP/1.1" 200 None 2026-03-07 09:03:41,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:41,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:41,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:41,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9a040deb775998f439a HTTP/1.1" 200 None 2026-03-07 09:03:41,505 - lava_callback - INFO - Completed processing callback for node 69abe9a040deb775998f439a 2026-03-07 09:03:45,266 - lava_callback - INFO - Received callback for node 69abe99240deb775998f4379 INFO: 172.19.0.1:41808 - "POST /node/69abe99240deb775998f4379 HTTP/1.0" 202 Accepted 2026-03-07 09:03:45,272 - lava_callback - INFO - Starting async job submit for node 69abe99240deb775998f4379 2026-03-07 09:03:45,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:45,324 - lava_callback - INFO - Received callback for node 69abe99a40deb775998f438b INFO: 172.19.0.1:41810 - "POST /node/69abe99a40deb775998f438b HTTP/1.0" 202 Accepted 2026-03-07 09:03:45,338 - lava_callback - INFO - Starting async job submit for node 69abe99a40deb775998f438b 2026-03-07 09:03:45,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99240deb775998f4379 HTTP/1.1" 200 None 2026-03-07 09:03:45,374 - lava_callback - DEBUG - Processing node 69abe99240deb775998f4379: baseline-arm64 2026-03-07 09:03:45,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:45,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99a40deb775998f438b HTTP/1.1" 200 None 2026-03-07 09:03:45,471 - lava_callback - DEBUG - Processing node 69abe99a40deb775998f438b: baseline-nfs-arm64 2026-03-07 09:03:45,710 - lava_callback - INFO - Received callback for node 69abe9a240deb775998f43a1 INFO: 172.19.0.1:41822 - "POST /node/69abe9a240deb775998f43a1 HTTP/1.0" 202 Accepted 2026-03-07 09:03:45,731 - lava_callback - INFO - Starting async job submit for node 69abe9a240deb775998f43a1 2026-03-07 09:03:45,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:46,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9a240deb775998f43a1 HTTP/1.1" 200 None 2026-03-07 09:03:46,146 - lava_callback - DEBUG - Processing node 69abe9a240deb775998f43a1: baseline-nfs-arm64 2026-03-07 09:03:46,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:41834 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:46,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:47,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:47,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:47,139 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99240deb775998f4379/log.txt.gz 2026-03-07 09:03:47,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:47,246 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99a40deb775998f438b/log.txt.gz 2026-03-07 09:03:47,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:47,370 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a240deb775998f43a1/log.txt.gz 2026-03-07 09:03:47,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:48,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,061 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99240deb775998f4379/lava-logs.yaml 2026-03-07 09:03:48,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:48,575 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99240deb775998f4379/lava_callback.json.gz 2026-03-07 09:03:48,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:48,621 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:48,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99240deb775998f4379 HTTP/1.1" 200 None 2026-03-07 09:03:48,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:48,626 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a240deb775998f43a1/lava-logs.yaml 2026-03-07 09:03:48,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:48,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99a40deb775998f438b/lava-logs.yaml 2026-03-07 09:03:48,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:48,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:48,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:48,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99240deb775998f4379 HTTP/1.1" 200 None 2026-03-07 09:03:48,685 - lava_callback - INFO - Completed processing callback for node 69abe99240deb775998f4379 2026-03-07 09:03:49,319 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:49,322 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe9a240deb775998f43a1/lava_callback.json.gz 2026-03-07 09:03:49,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:49,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,362 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99a40deb775998f438b/lava_callback.json.gz 2026-03-07 09:03:49,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9a240deb775998f43a1 HTTP/1.1" 200 None 2026-03-07 09:03:49,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99a40deb775998f438b HTTP/1.1" 200 None 2026-03-07 09:03:49,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:49,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:03:49,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:49,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9a240deb775998f43a1 HTTP/1.1" 200 None 2026-03-07 09:03:49,478 - lava_callback - INFO - Completed processing callback for node 69abe9a240deb775998f43a1 2026-03-07 09:03:49,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99a40deb775998f438b HTTP/1.1" 200 None 2026-03-07 09:03:49,550 - lava_callback - INFO - Completed processing callback for node 69abe99a40deb775998f438b INFO: 172.19.0.1:48048 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:03:57,466 - lava_callback - INFO - Received callback for node 69abe56040deb775998f3f24 INFO: 172.19.0.1:48056 - "POST /node/69abe56040deb775998f3f24 HTTP/1.0" 202 Accepted 2026-03-07 09:03:57,474 - lava_callback - INFO - Starting async job submit for node 69abe56040deb775998f3f24 2026-03-07 09:03:57,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:57,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe56040deb775998f3f24 HTTP/1.1" 200 None 2026-03-07 09:03:57,559 - lava_callback - DEBUG - Processing node 69abe56040deb775998f3f24: ltp-smoke 2026-03-07 09:03:58,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:58,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:58,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe56040deb775998f3f24/log.txt.gz 2026-03-07 09:03:58,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:58,927 - lava_callback - INFO - Received callback for node 69abe9af40deb775998f43ea INFO: 172.19.0.1:48062 - "POST /node/69abe9af40deb775998f43ea HTTP/1.0" 202 Accepted 2026-03-07 09:03:58,936 - lava_callback - INFO - Starting async job submit for node 69abe9af40deb775998f43ea 2026-03-07 09:03:58,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:59,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9af40deb775998f43ea HTTP/1.1" 200 None 2026-03-07 09:03:59,016 - lava_callback - DEBUG - Processing node 69abe9af40deb775998f43ea: baseline-arm64-broonie 2026-03-07 09:03:59,374 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:59,389 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe56040deb775998f3f24/lava-logs.yaml 2026-03-07 09:03:59,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:59,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:03:59,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:59,556 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69abe56040deb775998f3f24/lava_callback.json.gz 2026-03-07 09:03:59,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:59,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe56040deb775998f3f24 HTTP/1.1" 200 None 2026-03-07 09:03:59,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:59,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2b40deb775998f3bab HTTP/1.1" 200 None 2026-03-07 09:03:59,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:03:59,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe56040deb775998f3f24 HTTP/1.1" 200 None 2026-03-07 09:03:59,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:03:59,941 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9af40deb775998f43ea/log.txt.gz 2026-03-07 09:04:00,133 - lava_callback - INFO - Completed processing callback for node 69abe56040deb775998f3f24 2026-03-07 09:04:00,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:00,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:00,514 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9af40deb775998f43ea/lava-logs.yaml 2026-03-07 09:04:00,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:00,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:00,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-07 09:04:00,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:00,965 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9af40deb775998f43ea/lava_callback.json.gz 2026-03-07 09:04:01,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9af40deb775998f43ea HTTP/1.1" 200 None 2026-03-07 09:04:01,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:01,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9af40deb775998f43ea HTTP/1.1" 200 None 2026-03-07 09:04:01,114 - lava_callback - INFO - Completed processing callback for node 69abe9af40deb775998f43ea 2026-03-07 09:04:01,190 - lava_callback - INFO - Received callback for node 69a946fb7ee78ae610cab5ad INFO: 172.19.0.1:60742 - "POST /node/69a946fb7ee78ae610cab5ad HTTP/1.0" 202 Accepted 2026-03-07 09:04:01,200 - lava_callback - INFO - Starting async job submit for node 69a946fb7ee78ae610cab5ad 2026-03-07 09:04:01,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946fb7ee78ae610cab5ad HTTP/1.1" 200 None 2026-03-07 09:04:01,225 - lava_callback - DEBUG - Processing node 69a946fb7ee78ae610cab5ad: baseline-arm-baylibre 2026-03-07 09:04:01,225 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a946fb7ee78ae610cab5ad 2026-03-07 09:04:01,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a946fb7ee78ae610cab5ad HTTP/1.1" 200 None 2026-03-07 09:04:01,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:04:01,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:01,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a946fb7ee78ae610cab5ad HTTP/1.1" 200 None 2026-03-07 09:04:01,307 - lava_callback - ERROR - Error processing callback for node 69a946fb7ee78ae610cab5ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 09:04:05,715 - lava_callback - INFO - Received callback for node 69abe99540deb775998f437f INFO: 172.19.0.1:60752 - "POST /node/69abe99540deb775998f437f HTTP/1.0" 202 Accepted 2026-03-07 09:04:05,726 - lava_callback - INFO - Starting async job submit for node 69abe99540deb775998f437f 2026-03-07 09:04:05,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:05,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99540deb775998f437f HTTP/1.1" 200 None 2026-03-07 09:04:05,815 - lava_callback - DEBUG - Processing node 69abe99540deb775998f437f: baseline-nfs-arm64 INFO: 172.19.0.1:60754 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:06,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:60758 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:06,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:06,626 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99540deb775998f437f/log.txt.gz 2026-03-07 09:04:06,920 - lava_callback - INFO - Received callback for node 69abe99b40deb775998f438e INFO: 172.19.0.1:60760 - "POST /node/69abe99b40deb775998f438e HTTP/1.0" 202 Accepted 2026-03-07 09:04:06,932 - lava_callback - INFO - Starting async job submit for node 69abe99b40deb775998f438e 2026-03-07 09:04:07,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:07,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:07,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99b40deb775998f438e HTTP/1.1" 200 None 2026-03-07 09:04:07,069 - lava_callback - DEBUG - Processing node 69abe99b40deb775998f438e: baseline-nfs-arm64 2026-03-07 09:04:07,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:07,458 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99540deb775998f437f/lava-logs.yaml 2026-03-07 09:04:07,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:07,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:08,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:08,110 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99b40deb775998f438e/log.txt.gz 2026-03-07 09:04:08,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:08,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99540deb775998f437f/lava_callback.json.gz 2026-03-07 09:04:08,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:08,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99540deb775998f437f HTTP/1.1" 200 None 2026-03-07 09:04:08,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:08,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:08,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:08,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99540deb775998f437f HTTP/1.1" 200 None 2026-03-07 09:04:08,550 - lava_callback - INFO - Completed processing callback for node 69abe99540deb775998f437f 2026-03-07 09:04:08,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:09,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:09,133 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99b40deb775998f438e/lava-logs.yaml 2026-03-07 09:04:09,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:09,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:09,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99b40deb775998f438e/lava_callback.json.gz 2026-03-07 09:04:09,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:09,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99b40deb775998f438e HTTP/1.1" 200 None 2026-03-07 09:04:09,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:09,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:09,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:09,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99b40deb775998f438e HTTP/1.1" 200 None 2026-03-07 09:04:09,470 - lava_callback - INFO - Completed processing callback for node 69abe99b40deb775998f438e 2026-03-07 09:04:10,299 - lava_callback - INFO - Received callback for node 69abe99740deb775998f4385 INFO: 172.19.0.1:47164 - "POST /node/69abe99740deb775998f4385 HTTP/1.0" 202 Accepted 2026-03-07 09:04:10,309 - lava_callback - INFO - Starting async job submit for node 69abe99740deb775998f4385 2026-03-07 09:04:10,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:10,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99740deb775998f4385 HTTP/1.1" 200 None 2026-03-07 09:04:10,387 - lava_callback - DEBUG - Processing node 69abe99740deb775998f4385: baseline-nfs-arm64 2026-03-07 09:04:11,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:11,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:11,323 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99740deb775998f4385/log.txt.gz 2026-03-07 09:04:11,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:12,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:12,026 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99740deb775998f4385/lava-logs.yaml 2026-03-07 09:04:12,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:12,190 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:12,192 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99740deb775998f4385/lava_callback.json.gz 2026-03-07 09:04:12,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:12,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99740deb775998f4385 HTTP/1.1" 200 None 2026-03-07 09:04:12,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:12,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:12,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:12,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99740deb775998f4385 HTTP/1.1" 200 None 2026-03-07 09:04:12,335 - lava_callback - INFO - Completed processing callback for node 69abe99740deb775998f4385 2026-03-07 09:04:14,956 - lava_callback - INFO - Received callback for node 69abe9ca40deb775998f4448 INFO: 172.19.0.1:47166 - "POST /node/69abe9ca40deb775998f4448 HTTP/1.0" 202 Accepted 2026-03-07 09:04:14,966 - lava_callback - INFO - Starting async job submit for node 69abe9ca40deb775998f4448 2026-03-07 09:04:14,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:15,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9ca40deb775998f4448 HTTP/1.1" 200 None 2026-03-07 09:04:15,009 - lava_callback - DEBUG - Processing node 69abe9ca40deb775998f4448: baseline-arm64-pengutronix INFO: 172.19.0.1:47174 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 09:04:15,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:15,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:15,590 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9ca40deb775998f4448/log.txt.gz 2026-03-07 09:04:15,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:15,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:15,919 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9ca40deb775998f4448/lava-logs.yaml 2026-03-07 09:04:15,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:16,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:16,379 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9ca40deb775998f4448/lava_callback.json.gz 2026-03-07 09:04:16,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:16,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9ca40deb775998f4448 HTTP/1.1" 200 None 2026-03-07 09:04:16,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:16,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:16,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:16,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9ca40deb775998f4448 HTTP/1.1" 200 None 2026-03-07 09:04:16,479 - lava_callback - INFO - Completed processing callback for node 69abe9ca40deb775998f4448 INFO: 172.19.0.1:47188 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:17,335 - lava_callback - INFO - Received callback for node 69abe9b840deb775998f4404 INFO: 172.19.0.1:47196 - "POST /node/69abe9b840deb775998f4404 HTTP/1.0" 202 Accepted 2026-03-07 09:04:17,345 - lava_callback - INFO - Starting async job submit for node 69abe9b840deb775998f4404 2026-03-07 09:04:17,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:17,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b840deb775998f4404 HTTP/1.1" 200 None 2026-03-07 09:04:17,410 - lava_callback - DEBUG - Processing node 69abe9b840deb775998f4404: baseline-arm64-broonie 2026-03-07 09:04:17,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:18,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:18,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b840deb775998f4404/log.txt.gz 2026-03-07 09:04:18,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:18,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:18,760 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b840deb775998f4404/lava-logs.yaml 2026-03-07 09:04:18,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:18,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:18,906 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b840deb775998f4404/lava_callback.json.gz 2026-03-07 09:04:18,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:18,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b840deb775998f4404 HTTP/1.1" 200 None 2026-03-07 09:04:18,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:18,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:18,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:18,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b840deb775998f4404 HTTP/1.1" 200 None 2026-03-07 09:04:18,995 - lava_callback - INFO - Completed processing callback for node 69abe9b840deb775998f4404 2026-03-07 09:04:24,901 - lava_callback - INFO - Received callback for node 69abe9cb40deb775998f444b INFO: 172.19.0.1:34102 - "POST /node/69abe9cb40deb775998f444b HTTP/1.0" 202 Accepted 2026-03-07 09:04:24,912 - lava_callback - INFO - Starting async job submit for node 69abe9cb40deb775998f444b 2026-03-07 09:04:24,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:24,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cb40deb775998f444b HTTP/1.1" 200 None 2026-03-07 09:04:24,959 - lava_callback - DEBUG - Processing node 69abe9cb40deb775998f444b: baseline-arm64-pengutronix 2026-03-07 09:04:25,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:25,418 - lava_callback - INFO - Received callback for node 69abe98f40deb775998f436e INFO: 172.19.0.1:34118 - "POST /node/69abe98f40deb775998f436e HTTP/1.0" 202 Accepted 2026-03-07 09:04:25,432 - lava_callback - INFO - Starting async job submit for node 69abe98f40deb775998f436e 2026-03-07 09:04:25,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:25,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98f40deb775998f436e HTTP/1.1" 200 None 2026-03-07 09:04:25,500 - lava_callback - DEBUG - Processing node 69abe98f40deb775998f436e: baseline-arm64 2026-03-07 09:04:25,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:25,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cb40deb775998f444b/log.txt.gz 2026-03-07 09:04:25,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:26,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:34122 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:26,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:26,547 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98f40deb775998f436e/log.txt.gz 2026-03-07 09:04:26,577 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:26,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cb40deb775998f444b/lava-logs.yaml 2026-03-07 09:04:26,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:26,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:27,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:27,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cb40deb775998f444b/lava_callback.json.gz 2026-03-07 09:04:27,240 - lava_callback - INFO - Received callback for node 69abe9bc40deb775998f440a INFO: 172.19.0.1:34126 - "POST /node/69abe9bc40deb775998f440a HTTP/1.0" 202 Accepted 2026-03-07 09:04:27,261 - lava_callback - INFO - Starting async job submit for node 69abe9bc40deb775998f440a 2026-03-07 09:04:27,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:27,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:27,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cb40deb775998f444b HTTP/1.1" 200 None 2026-03-07 09:04:27,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:27,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9bc40deb775998f440a HTTP/1.1" 200 None 2026-03-07 09:04:27,347 - lava_callback - DEBUG - Processing node 69abe9bc40deb775998f440a: baseline-arm64-broonie 2026-03-07 09:04:27,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:27,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:27,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98f40deb775998f436e/lava-logs.yaml 2026-03-07 09:04:27,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:27,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:27,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9cb40deb775998f444b HTTP/1.1" 200 None 2026-03-07 09:04:27,539 - lava_callback - INFO - Completed processing callback for node 69abe9cb40deb775998f444b 2026-03-07 09:04:27,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:28,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:28,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98f40deb775998f436e/lava_callback.json.gz 2026-03-07 09:04:28,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:28,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:28,184 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9bc40deb775998f440a/log.txt.gz 2026-03-07 09:04:28,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98f40deb775998f436e HTTP/1.1" 200 None 2026-03-07 09:04:28,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:28,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:28,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:28,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:28,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98f40deb775998f436e HTTP/1.1" 200 None 2026-03-07 09:04:28,407 - lava_callback - INFO - Completed processing callback for node 69abe98f40deb775998f436e 2026-03-07 09:04:28,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:28,972 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9bc40deb775998f440a/lava-logs.yaml 2026-03-07 09:04:28,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:29,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:29,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9bc40deb775998f440a/lava_callback.json.gz 2026-03-07 09:04:29,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:29,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9bc40deb775998f440a HTTP/1.1" 200 None 2026-03-07 09:04:29,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:29,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:29,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:29,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9bc40deb775998f440a HTTP/1.1" 200 None 2026-03-07 09:04:29,253 - lava_callback - INFO - Completed processing callback for node 69abe9bc40deb775998f440a 2026-03-07 09:04:30,387 - lava_callback - INFO - Received callback for node 69abe9cd40deb775998f444e INFO: 172.19.0.1:32824 - "POST /node/69abe9cd40deb775998f444e HTTP/1.0" 202 Accepted 2026-03-07 09:04:30,397 - lava_callback - INFO - Starting async job submit for node 69abe9cd40deb775998f444e 2026-03-07 09:04:30,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:30,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cd40deb775998f444e HTTP/1.1" 200 None 2026-03-07 09:04:30,472 - lava_callback - DEBUG - Processing node 69abe9cd40deb775998f444e: baseline-arm64-pengutronix 2026-03-07 09:04:30,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:30,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:30,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-07 09:04:31,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:31,151 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cd40deb775998f444e/log.txt.gz 2026-03-07 09:04:31,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:31,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:31,870 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cd40deb775998f444e/lava-logs.yaml 2026-03-07 09:04:31,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:32,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:32,043 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69abe9cd40deb775998f444e/lava_callback.json.gz 2026-03-07 09:04:32,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:32,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cd40deb775998f444e HTTP/1.1" 200 None 2026-03-07 09:04:32,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:32,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:32,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:32,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9cd40deb775998f444e HTTP/1.1" 200 None 2026-03-07 09:04:32,128 - lava_callback - INFO - Completed processing callback for node 69abe9cd40deb775998f444e INFO: 172.19.0.1:32832 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:37,679 - lava_callback - INFO - Received callback for node 69abe9b240deb775998f43f4 INFO: 172.19.0.1:32846 - "POST /node/69abe9b240deb775998f43f4 HTTP/1.0" 202 Accepted 2026-03-07 09:04:37,685 - lava_callback - INFO - Starting async job submit for node 69abe9b240deb775998f43f4 2026-03-07 09:04:37,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:37,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b240deb775998f43f4 HTTP/1.1" 200 None 2026-03-07 09:04:37,720 - lava_callback - DEBUG - Processing node 69abe9b240deb775998f43f4: baseline-arm64-broonie 2026-03-07 09:04:38,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:38,180 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:38,182 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b240deb775998f43f4/log.txt.gz 2026-03-07 09:04:38,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:38,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:38,557 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b240deb775998f43f4/lava-logs.yaml 2026-03-07 09:04:38,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:38,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:38,690 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b240deb775998f43f4/lava_callback.json.gz 2026-03-07 09:04:38,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:38,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b240deb775998f43f4 HTTP/1.1" 200 None 2026-03-07 09:04:38,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:38,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:38,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:38,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b240deb775998f43f4 HTTP/1.1" 200 None 2026-03-07 09:04:38,775 - lava_callback - INFO - Completed processing callback for node 69abe9b240deb775998f43f4 2026-03-07 09:04:41,105 - lava_callback - INFO - Received callback for node 69a947277ee78ae610cab601 INFO: 172.19.0.1:33318 - "POST /node/69a947277ee78ae610cab601 HTTP/1.0" 202 Accepted 2026-03-07 09:04:41,110 - lava_callback - INFO - Starting async job submit for node 69a947277ee78ae610cab601 2026-03-07 09:04:41,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:41,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947277ee78ae610cab601 HTTP/1.1" 200 None 2026-03-07 09:04:41,136 - lava_callback - DEBUG - Processing node 69a947277ee78ae610cab601: baseline-arm-baylibre 2026-03-07 09:04:41,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a947277ee78ae610cab601 2026-03-07 09:04:41,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:41,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947277ee78ae610cab601 HTTP/1.1" 200 None 2026-03-07 09:04:41,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:41,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:04:41,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:41,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a947277ee78ae610cab601 HTTP/1.1" 200 None 2026-03-07 09:04:41,189 - lava_callback - ERROR - Error processing callback for node 69a947277ee78ae610cab601: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-07 09:04:45,782 - lava_callback - INFO - Received callback for node 69abe9c240deb775998f4418 INFO: 172.19.0.1:33322 - "POST /node/69abe9c240deb775998f4418 HTTP/1.0" 202 Accepted 2026-03-07 09:04:45,788 - lava_callback - INFO - Starting async job submit for node 69abe9c240deb775998f4418 2026-03-07 09:04:45,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:45,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c240deb775998f4418 HTTP/1.1" 200 None 2026-03-07 09:04:45,830 - lava_callback - DEBUG - Processing node 69abe9c240deb775998f4418: baseline-arm64-clabbe 2026-03-07 09:04:46,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:46,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:46,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c240deb775998f4418/log.txt.gz 2026-03-07 09:04:46,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:46,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:46,481 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c240deb775998f4418/lava-logs.yaml 2026-03-07 09:04:46,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:33334 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:46,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:46,615 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c240deb775998f4418/lava_callback.json.gz 2026-03-07 09:04:46,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:46,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c240deb775998f4418 HTTP/1.1" 200 None 2026-03-07 09:04:46,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:46,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:46,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:46,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9c240deb775998f4418 HTTP/1.1" 200 None 2026-03-07 09:04:46,713 - lava_callback - INFO - Completed processing callback for node 69abe9c240deb775998f4418 2026-03-07 09:04:47,413 - lava_callback - INFO - Received callback for node 69abe9b440deb775998f43f7 INFO: 172.19.0.1:33350 - "POST /node/69abe9b440deb775998f43f7 HTTP/1.0" 202 Accepted 2026-03-07 09:04:47,419 - lava_callback - INFO - Starting async job submit for node 69abe9b440deb775998f43f7 2026-03-07 09:04:47,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:47,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b440deb775998f43f7 HTTP/1.1" 200 None 2026-03-07 09:04:47,459 - lava_callback - DEBUG - Processing node 69abe9b440deb775998f43f7: baseline-arm64-broonie 2026-03-07 09:04:47,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:47,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:47,840 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b440deb775998f43f7/log.txt.gz 2026-03-07 09:04:47,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:48,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:48,199 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b440deb775998f43f7/lava-logs.yaml 2026-03-07 09:04:48,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:48,347 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:48,349 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b440deb775998f43f7/lava_callback.json.gz 2026-03-07 09:04:48,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:48,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b440deb775998f43f7 HTTP/1.1" 200 None 2026-03-07 09:04:48,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:48,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:48,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:48,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b440deb775998f43f7 HTTP/1.1" 200 None 2026-03-07 09:04:48,466 - lava_callback - INFO - Completed processing callback for node 69abe9b440deb775998f43f7 2026-03-07 09:04:48,833 - lava_callback - INFO - Received callback for node 69abe9b540deb775998f43fa INFO: 172.19.0.1:33360 - "POST /node/69abe9b540deb775998f43fa HTTP/1.0" 202 Accepted 2026-03-07 09:04:48,840 - lava_callback - INFO - Starting async job submit for node 69abe9b540deb775998f43fa 2026-03-07 09:04:48,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:48,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b540deb775998f43fa HTTP/1.1" 200 None 2026-03-07 09:04:48,887 - lava_callback - DEBUG - Processing node 69abe9b540deb775998f43fa: baseline-arm64-broonie 2026-03-07 09:04:49,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:49,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:49,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b540deb775998f43fa/log.txt.gz 2026-03-07 09:04:49,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:49,653 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:49,655 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b540deb775998f43fa/lava-logs.yaml 2026-03-07 09:04:49,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:49,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:49,786 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b540deb775998f43fa/lava_callback.json.gz 2026-03-07 09:04:49,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:49,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b540deb775998f43fa HTTP/1.1" 200 None 2026-03-07 09:04:49,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:49,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:49,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:49,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b540deb775998f43fa HTTP/1.1" 200 None 2026-03-07 09:04:49,874 - lava_callback - INFO - Completed processing callback for node 69abe9b540deb775998f43fa 2026-03-07 09:04:53,314 - lava_callback - INFO - Received callback for node 69abe9c140deb775998f4413 INFO: 172.19.0.1:34292 - "POST /node/69abe9c140deb775998f4413 HTTP/1.0" 202 Accepted 2026-03-07 09:04:53,321 - lava_callback - INFO - Starting async job submit for node 69abe9c140deb775998f4413 2026-03-07 09:04:53,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:53,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c140deb775998f4413 HTTP/1.1" 200 None 2026-03-07 09:04:53,358 - lava_callback - DEBUG - Processing node 69abe9c140deb775998f4413: baseline-arm64-clabbe 2026-03-07 09:04:53,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:53,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:53,802 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c140deb775998f4413/log.txt.gz 2026-03-07 09:04:53,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:54,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:54,205 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c140deb775998f4413/lava-logs.yaml 2026-03-07 09:04:54,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:54,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:54,364 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c140deb775998f4413/lava_callback.json.gz 2026-03-07 09:04:54,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:54,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c140deb775998f4413 HTTP/1.1" 200 None 2026-03-07 09:04:54,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:54,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:54,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:54,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9c140deb775998f4413 HTTP/1.1" 200 None 2026-03-07 09:04:54,474 - lava_callback - INFO - Completed processing callback for node 69abe9c140deb775998f4413 INFO: 172.19.0.1:34302 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:04:57,038 - lava_callback - INFO - Received callback for node 69abe61b40deb775998f3f96 INFO: 172.19.0.1:34312 - "POST /node/69abe61b40deb775998f3f96 HTTP/1.0" 202 Accepted 2026-03-07 09:04:57,044 - lava_callback - INFO - Starting async job submit for node 69abe61b40deb775998f3f96 2026-03-07 09:04:57,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:57,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61b40deb775998f3f96 HTTP/1.1" 200 None 2026-03-07 09:04:57,113 - lava_callback - DEBUG - Processing node 69abe61b40deb775998f3f96: baseline-arm 2026-03-07 09:04:57,327 - lava_callback - INFO - Received callback for node 69abe9be40deb775998f440d INFO: 172.19.0.1:34322 - "POST /node/69abe9be40deb775998f440d HTTP/1.0" 202 Accepted 2026-03-07 09:04:57,383 - lava_callback - INFO - Starting async job submit for node 69abe9be40deb775998f440d 2026-03-07 09:04:57,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:57,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9be40deb775998f440d HTTP/1.1" 200 None 2026-03-07 09:04:57,557 - lava_callback - DEBUG - Processing node 69abe9be40deb775998f440d: baseline-arm64-broonie 2026-03-07 09:04:58,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:58,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:58,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:58,412 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9be40deb775998f440d/log.txt.gz 2026-03-07 09:04:58,434 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:58,465 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f96/log.txt.gz 2026-03-07 09:04:58,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:58,934 - lava_callback - INFO - Received callback for node 69abe99f40deb775998f4397 INFO: 172.19.0.1:34324 - "POST /node/69abe99f40deb775998f4397 HTTP/1.0" 202 Accepted 2026-03-07 09:04:58,952 - lava_callback - INFO - Starting async job submit for node 69abe99f40deb775998f4397 2026-03-07 09:04:58,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:58,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:58,997 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9be40deb775998f440d/lava-logs.yaml 2026-03-07 09:04:58,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:59,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:59,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99f40deb775998f4397 HTTP/1.1" 200 None 2026-03-07 09:04:59,017 - lava_callback - DEBUG - Processing node 69abe99f40deb775998f4397: baseline-nfs-arm64 2026-03-07 09:04:59,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:59,243 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9be40deb775998f440d/lava_callback.json.gz 2026-03-07 09:04:59,300 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:59,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:59,369 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f96/lava-logs.yaml 2026-03-07 09:04:59,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9be40deb775998f440d HTTP/1.1" 200 None 2026-03-07 09:04:59,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:59,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:59,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:04:59,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:04:59,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:04:59,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9be40deb775998f440d HTTP/1.1" 200 None 2026-03-07 09:04:59,637 - lava_callback - INFO - Completed processing callback for node 69abe9be40deb775998f440d 2026-03-07 09:04:59,789 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:59,791 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abe61b40deb775998f3f96/lava_callback.json.gz 2026-03-07 09:04:59,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:04:59,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99f40deb775998f4397/log.txt.gz DEBUG: Setup failed for 69abe61b40deb775998f3f96. Transitting job node result: incomplete -> fail 2026-03-07 09:05:00,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe61b40deb775998f3f96 HTTP/1.1" 200 None 2026-03-07 09:05:00,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:05:00,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:00,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe61b40deb775998f3f96 HTTP/1.1" 200 None 2026-03-07 09:05:00,371 - lava_callback - INFO - Completed processing callback for node 69abe61b40deb775998f3f96 2026-03-07 09:05:00,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:00,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99f40deb775998f4397/lava-logs.yaml 2026-03-07 09:05:00,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:00,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:00,695 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99f40deb775998f4397/lava_callback.json.gz 2026-03-07 09:05:00,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99f40deb775998f4397 HTTP/1.1" 200 None 2026-03-07 09:05:00,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:05:00,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99f40deb775998f4397 HTTP/1.1" 200 None 2026-03-07 09:05:00,785 - lava_callback - INFO - Completed processing callback for node 69abe99f40deb775998f4397 2026-03-07 09:05:00,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:00,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.19.0.1:44644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44654 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:05:07,185 - lava_callback - INFO - Received callback for node 69abe9ba40deb775998f4407 INFO: 172.19.0.1:44658 - "POST /node/69abe9ba40deb775998f4407 HTTP/1.0" 202 Accepted 2026-03-07 09:05:07,196 - lava_callback - INFO - Starting async job submit for node 69abe9ba40deb775998f4407 2026-03-07 09:05:07,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:07,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9ba40deb775998f4407 HTTP/1.1" 200 None 2026-03-07 09:05:07,264 - lava_callback - DEBUG - Processing node 69abe9ba40deb775998f4407: baseline-arm64-broonie 2026-03-07 09:05:07,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:07,829 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:07,831 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9ba40deb775998f4407/log.txt.gz 2026-03-07 09:05:07,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:08,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:08,189 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9ba40deb775998f4407/lava-logs.yaml 2026-03-07 09:05:08,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:08,338 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:08,339 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9ba40deb775998f4407/lava_callback.json.gz 2026-03-07 09:05:08,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:08,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9ba40deb775998f4407 HTTP/1.1" 200 None 2026-03-07 09:05:08,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:08,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:05:08,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:08,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9ba40deb775998f4407 HTTP/1.1" 200 None 2026-03-07 09:05:08,431 - lava_callback - INFO - Completed processing callback for node 69abe9ba40deb775998f4407 INFO: 172.19.0.1:41962 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 09:05:16,152 - lava_callback - INFO - Received callback for node 69abe9c540deb775998f443c INFO: 172.19.0.1:41978 - "POST /node/69abe9c540deb775998f443c HTTP/1.0" 202 Accepted 2026-03-07 09:05:16,158 - lava_callback - INFO - Starting async job submit for node 69abe9c540deb775998f443c 2026-03-07 09:05:16,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:16,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c540deb775998f443c HTTP/1.1" 200 None 2026-03-07 09:05:16,195 - lava_callback - DEBUG - Processing node 69abe9c540deb775998f443c: baseline-arm64-clabbe 2026-03-07 09:05:16,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:41984 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:05:16,558 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:16,560 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c540deb775998f443c/log.txt.gz 2026-03-07 09:05:16,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:16,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:16,875 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c540deb775998f443c/lava-logs.yaml 2026-03-07 09:05:16,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:17,040 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:17,042 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c540deb775998f443c/lava_callback.json.gz 2026-03-07 09:05:17,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:17,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c540deb775998f443c HTTP/1.1" 200 None 2026-03-07 09:05:17,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:17,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:05:17,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:17,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9c540deb775998f443c HTTP/1.1" 200 None 2026-03-07 09:05:17,122 - lava_callback - INFO - Completed processing callback for node 69abe9c540deb775998f443c 2026-03-07 09:05:17,277 - lava_callback - INFO - Received callback for node 69abe9b140deb775998f43f0 INFO: 172.19.0.1:41990 - "POST /node/69abe9b140deb775998f43f0 HTTP/1.0" 202 Accepted 2026-03-07 09:05:17,284 - lava_callback - INFO - Starting async job submit for node 69abe9b140deb775998f43f0 2026-03-07 09:05:17,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:17,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b140deb775998f43f0 HTTP/1.1" 200 None 2026-03-07 09:05:17,337 - lava_callback - DEBUG - Processing node 69abe9b140deb775998f43f0: baseline-arm64-broonie 2026-03-07 09:05:17,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:17,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:17,717 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b140deb775998f43f0/log.txt.gz 2026-03-07 09:05:17,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:18,032 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:18,034 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b140deb775998f43f0/lava-logs.yaml 2026-03-07 09:05:18,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:05:18,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:05:18,198 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b140deb775998f43f0/lava_callback.json.gz 2026-03-07 09:05:18,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:18,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b140deb775998f43f0 HTTP/1.1" 200 None 2026-03-07 09:05:18,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:18,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:05:18,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:18,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b140deb775998f43f0 HTTP/1.1" 200 None 2026-03-07 09:05:18,277 - lava_callback - INFO - Completed processing callback for node 69abe9b140deb775998f43f0 INFO: 172.19.0.1:33852 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:05:30,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:30,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33904 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:05:41,177 - lava_callback - INFO - Received callback for node 69a947577ee78ae610cab631 INFO: 172.19.0.1:44544 - "POST /node/69a947577ee78ae610cab631 HTTP/1.0" 202 Accepted 2026-03-07 09:05:41,183 - lava_callback - INFO - Starting async job submit for node 69a947577ee78ae610cab631 2026-03-07 09:05:41,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:41,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947577ee78ae610cab631 HTTP/1.1" 200 None 2026-03-07 09:05:41,206 - lava_callback - DEBUG - Processing node 69a947577ee78ae610cab631: baseline-arm-baylibre 2026-03-07 09:05:41,206 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a947577ee78ae610cab631 2026-03-07 09:05:41,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:41,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947577ee78ae610cab631 HTTP/1.1" 200 None 2026-03-07 09:05:41,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:41,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 09:05:41,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:05:41,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a947577ee78ae610cab631 HTTP/1.1" 200 None 2026-03-07 09:05:41,263 - lava_callback - ERROR - Error processing callback for node 69a947577ee78ae610cab631: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45824 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:06:03,464 - lava_callback - INFO - Received callback for node 69abe99640deb775998f4382 INFO: 172.19.0.1:56404 - "POST /node/69abe99640deb775998f4382 HTTP/1.0" 202 Accepted 2026-03-07 09:06:03,470 - lava_callback - INFO - Starting async job submit for node 69abe99640deb775998f4382 2026-03-07 09:06:03,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:03,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99640deb775998f4382 HTTP/1.1" 200 None 2026-03-07 09:06:03,504 - lava_callback - DEBUG - Processing node 69abe99640deb775998f4382: baseline-nfs-arm64 2026-03-07 09:06:03,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:04,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:04,060 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99640deb775998f4382/log.txt.gz 2026-03-07 09:06:04,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:04,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:04,500 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99640deb775998f4382/lava-logs.yaml 2026-03-07 09:06:04,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:04,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:04,744 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99640deb775998f4382/lava_callback.json.gz 2026-03-07 09:06:04,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:04,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99640deb775998f4382 HTTP/1.1" 200 None 2026-03-07 09:06:04,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:04,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:06:04,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:04,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99640deb775998f4382 HTTP/1.1" 200 None 2026-03-07 09:06:04,823 - lava_callback - INFO - Completed processing callback for node 69abe99640deb775998f4382 INFO: 172.19.0.1:56406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56418 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:06:13,183 - lava_callback - INFO - Received callback for node 69abe9c740deb775998f4443 INFO: 172.19.0.1:32854 - "POST /node/69abe9c740deb775998f4443 HTTP/1.0" 202 Accepted 2026-03-07 09:06:13,189 - lava_callback - INFO - Starting async job submit for node 69abe9c740deb775998f4443 2026-03-07 09:06:13,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:13,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c740deb775998f4443 HTTP/1.1" 200 None 2026-03-07 09:06:13,226 - lava_callback - DEBUG - Processing node 69abe9c740deb775998f4443: baseline-arm64-clabbe 2026-03-07 09:06:13,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:13,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:13,614 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c740deb775998f4443/log.txt.gz 2026-03-07 09:06:13,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:13,947 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:13,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c740deb775998f4443/lava-logs.yaml 2026-03-07 09:06:13,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:14,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:14,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c740deb775998f4443/lava_callback.json.gz 2026-03-07 09:06:14,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:14,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c740deb775998f4443 HTTP/1.1" 200 None 2026-03-07 09:06:14,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:14,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:06:14,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:14,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9c740deb775998f4443 HTTP/1.1" 200 None 2026-03-07 09:06:14,202 - lava_callback - INFO - Completed processing callback for node 69abe9c740deb775998f4443 INFO: 172.19.0.1:32870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35196 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:06:30,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:30,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:46702 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:06:37,296 - lava_callback - INFO - Received callback for node 69abe9c340deb775998f441b INFO: 172.19.0.1:46710 - "POST /node/69abe9c340deb775998f441b HTTP/1.0" 202 Accepted 2026-03-07 09:06:37,302 - lava_callback - INFO - Starting async job submit for node 69abe9c340deb775998f441b 2026-03-07 09:06:37,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:37,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c340deb775998f441b HTTP/1.1" 200 None 2026-03-07 09:06:37,347 - lava_callback - DEBUG - Processing node 69abe9c340deb775998f441b: baseline-arm64-clabbe 2026-03-07 09:06:37,426 - lava_callback - INFO - Received callback for node 69abe9b740deb775998f43fd INFO: 172.19.0.1:46722 - "POST /node/69abe9b740deb775998f43fd HTTP/1.0" 202 Accepted 2026-03-07 09:06:37,442 - lava_callback - INFO - Starting async job submit for node 69abe9b740deb775998f43fd 2026-03-07 09:06:37,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:37,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b740deb775998f43fd HTTP/1.1" 200 None 2026-03-07 09:06:37,589 - lava_callback - DEBUG - Processing node 69abe9b740deb775998f43fd: baseline-arm64-broonie 2026-03-07 09:06:37,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:37,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:38,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,036 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c340deb775998f441b/log.txt.gz 2026-03-07 09:06:38,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,134 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b740deb775998f43fd/log.txt.gz 2026-03-07 09:06:38,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:38,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:38,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,604 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c340deb775998f441b/lava-logs.yaml 2026-03-07 09:06:38,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:38,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,632 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b740deb775998f43fd/lava-logs.yaml 2026-03-07 09:06:38,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:06:38,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69abe9c340deb775998f441b/lava_callback.json.gz 2026-03-07 09:06:38,815 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:06:38,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69abe9b740deb775998f43fd/lava_callback.json.gz 2026-03-07 09:06:38,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9c340deb775998f441b HTTP/1.1" 200 None 2026-03-07 09:06:38,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9b740deb775998f43fd HTTP/1.1" 200 None 2026-03-07 09:06:38,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:06:38,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:06:38,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:38,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9c340deb775998f441b HTTP/1.1" 200 None 2026-03-07 09:06:38,931 - lava_callback - INFO - Completed processing callback for node 69abe9c340deb775998f441b 2026-03-07 09:06:38,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9b740deb775998f43fd HTTP/1.1" 200 None 2026-03-07 09:06:38,959 - lava_callback - INFO - Completed processing callback for node 69abe9b740deb775998f43fd 2026-03-07 09:06:41,228 - lava_callback - INFO - Received callback for node 69a947917ee78ae610cab68d INFO: 172.19.0.1:59390 - "POST /node/69a947917ee78ae610cab68d HTTP/1.0" 202 Accepted 2026-03-07 09:06:41,233 - lava_callback - INFO - Starting async job submit for node 69a947917ee78ae610cab68d 2026-03-07 09:06:41,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:41,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947917ee78ae610cab68d HTTP/1.1" 200 None 2026-03-07 09:06:41,249 - lava_callback - DEBUG - Processing node 69a947917ee78ae610cab68d: baseline-arm64-baylibre 2026-03-07 09:06:41,249 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a947917ee78ae610cab68d 2026-03-07 09:06:41,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:41,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a947917ee78ae610cab68d HTTP/1.1" 200 None 2026-03-07 09:06:41,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:41,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 09:06:41,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:06:41,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a947917ee78ae610cab68d HTTP/1.1" 200 None 2026-03-07 09:06:41,314 - lava_callback - ERROR - Error processing callback for node 69a947917ee78ae610cab68d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42860 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:07:00,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:07:00,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53170 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:53182 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:07:36,708 - lava_callback - INFO - Received callback for node 69abe64540deb775998f403b INFO: 172.19.0.1:53184 - "POST /node/69abe64540deb775998f403b HTTP/1.0" 202 Accepted 2026-03-07 09:07:36,757 - lava_callback - INFO - Starting async job submit for node 69abe64540deb775998f403b 2026-03-07 09:07:36,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:07:36,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64540deb775998f403b HTTP/1.1" 200 None 2026-03-07 09:07:36,796 - lava_callback - DEBUG - Processing node 69abe64540deb775998f403b: baseline-arm-pengutronix 2026-03-07 09:07:36,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:07:37,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:07:37,111 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64540deb775998f403b/log.txt.gz 2026-03-07 09:07:37,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:07:37,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:07:37,416 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64540deb775998f403b/lava-logs.yaml 2026-03-07 09:07:37,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:07:37,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:07:37,547 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abe64540deb775998f403b/lava_callback.json.gz DEBUG: Setup failed for 69abe64540deb775998f403b. Transitting job node result: incomplete -> fail 2026-03-07 09:07:37,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:07:37,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe64540deb775998f403b HTTP/1.1" 200 None 2026-03-07 09:07:37,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:07:37,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:07:37,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:07:37,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe64540deb775998f403b HTTP/1.1" 200 None 2026-03-07 09:07:37,726 - lava_callback - INFO - Completed processing callback for node 69abe64540deb775998f403b INFO: 172.19.0.1:40200 - "GET /wiki HTTP/1.0" 404 Not Found INFO: 172.19.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48176 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:08:00,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:08:00,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39052 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:08:41,393 - lava_callback - INFO - Received callback for node 69a9480f7ee78ae610cab6f5 INFO: 172.19.0.1:39488 - "POST /node/69a9480f7ee78ae610cab6f5 HTTP/1.0" 202 Accepted 2026-03-07 09:08:41,398 - lava_callback - INFO - Starting async job submit for node 69a9480f7ee78ae610cab6f5 2026-03-07 09:08:41,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:08:41,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9480f7ee78ae610cab6f5 HTTP/1.1" 200 None 2026-03-07 09:08:41,424 - lava_callback - DEBUG - Processing node 69a9480f7ee78ae610cab6f5: baseline-arm64-baylibre 2026-03-07 09:08:41,424 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9480f7ee78ae610cab6f5 2026-03-07 09:08:41,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:08:41,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9480f7ee78ae610cab6f5 HTTP/1.1" 200 None 2026-03-07 09:08:41,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:08:41,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 09:08:41,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:08:41,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9480f7ee78ae610cab6f5 HTTP/1.1" 200 None 2026-03-07 09:08:41,492 - lava_callback - ERROR - Error processing callback for node 69a9480f7ee78ae610cab6f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47628 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:11:01,468 - lava_callback - INFO - Received callback for node 69a948957ee78ae610cab7b0 INFO: 172.19.0.1:42408 - "POST /node/69a948957ee78ae610cab7b0 HTTP/1.0" 202 Accepted 2026-03-07 09:11:01,473 - lava_callback - INFO - Starting async job submit for node 69a948957ee78ae610cab7b0 2026-03-07 09:11:01,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:11:01,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a948957ee78ae610cab7b0 HTTP/1.1" 200 None 2026-03-07 09:11:01,499 - lava_callback - DEBUG - Processing node 69a948957ee78ae610cab7b0: baseline-arm64-baylibre 2026-03-07 09:11:01,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a948957ee78ae610cab7b0 2026-03-07 09:11:01,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:11:01,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a948957ee78ae610cab7b0 HTTP/1.1" 200 None 2026-03-07 09:11:01,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:11:01,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 09:11:01,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:11:01,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a948957ee78ae610cab7b0 HTTP/1.1" 200 None 2026-03-07 09:11:01,556 - lava_callback - ERROR - Error processing callback for node 69a948957ee78ae610cab7b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48080 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:14:46,744 - lava_callback - INFO - Received callback for node 69abe98740deb775998f4344 INFO: 172.19.0.1:48088 - "POST /node/69abe98740deb775998f4344 HTTP/1.0" 202 Accepted 2026-03-07 09:14:46,751 - lava_callback - INFO - Starting async job submit for node 69abe98740deb775998f4344 2026-03-07 09:14:46,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:14:46,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98740deb775998f4344 HTTP/1.1" 200 None 2026-03-07 09:14:46,807 - lava_callback - DEBUG - Processing node 69abe98740deb775998f4344: baseline-arm64 2026-03-07 09:14:47,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:14:47,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:14:47,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98740deb775998f4344/log.txt.gz 2026-03-07 09:14:48,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:14:48,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:14:48,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98740deb775998f4344/lava-logs.yaml 2026-03-07 09:14:48,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:14:48,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:14:48,487 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98740deb775998f4344/lava_callback.json.gz 2026-03-07 09:14:48,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:14:48,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98740deb775998f4344 HTTP/1.1" 200 None 2026-03-07 09:14:48,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:14:48,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:14:48,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:14:48,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98740deb775998f4344 HTTP/1.1" 200 None 2026-03-07 09:14:48,570 - lava_callback - INFO - Completed processing callback for node 69abe98740deb775998f4344 INFO: 172.19.0.1:45904 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:15:00,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:15:00,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56488 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:16:04,520 - lava_callback - INFO - Received callback for node 69abeccc40deb775998f46b7 INFO: 172.19.0.1:44418 - "POST /node/69abeccc40deb775998f46b7 HTTP/1.0" 202 Accepted 2026-03-07 09:16:04,525 - lava_callback - INFO - Starting async job submit for node 69abeccc40deb775998f46b7 2026-03-07 09:16:04,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:04,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abeccc40deb775998f46b7 HTTP/1.1" 200 None 2026-03-07 09:16:04,544 - lava_callback - DEBUG - Processing node 69abeccc40deb775998f46b7: baseline-arm 2026-03-07 09:16:04,549 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:16:04,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:16:04,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:16:04,700 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abeccc40deb775998f46b7/lava-logs.yaml 2026-03-07 09:16:04,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:16:04,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:16:04,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abeccc40deb775998f46b7/lava_callback.json.gz 2026-03-07 09:16:04,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:04,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abeccc40deb775998f46b7 HTTP/1.1" 200 None 2026-03-07 09:16:04,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:04,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:16:04,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:04,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abeccc40deb775998f46b7 HTTP/1.1" 200 None 2026-03-07 09:16:04,938 - lava_callback - INFO - Completed processing callback for node 69abeccc40deb775998f46b7 INFO: 172.19.0.1:44428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42108 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:16:25,938 - lava_callback - INFO - Received callback for node 69abe99440deb775998f437c INFO: 172.19.0.1:34746 - "POST /node/69abe99440deb775998f437c HTTP/1.0" 202 Accepted 2026-03-07 09:16:25,945 - lava_callback - INFO - Starting async job submit for node 69abe99440deb775998f437c 2026-03-07 09:16:25,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:25,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99440deb775998f437c HTTP/1.1" 200 None 2026-03-07 09:16:25,997 - lava_callback - DEBUG - Processing node 69abe99440deb775998f437c: baseline-arm64 2026-03-07 09:16:26,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:34748 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:16:26,533 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:16:26,535 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99440deb775998f437c/log.txt.gz 2026-03-07 09:16:26,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:16:27,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:16:27,092 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99440deb775998f437c/lava-logs.yaml 2026-03-07 09:16:27,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:16:27,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:16:27,278 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe99440deb775998f437c/lava_callback.json.gz DEBUG: Setup failed for 69abe99440deb775998f437c. Transitting job node result: incomplete -> fail 2026-03-07 09:16:27,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:27,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99440deb775998f437c HTTP/1.1" 200 None 2026-03-07 09:16:27,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:27,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:16:27,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:27,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99440deb775998f437c HTTP/1.1" 200 None 2026-03-07 09:16:27,533 - lava_callback - INFO - Completed processing callback for node 69abe99440deb775998f437c 2026-03-07 09:16:30,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:16:31,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59440 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:19:11,577 - lava_callback - INFO - Received callback for node 69abed2d40deb775998f46e5 INFO: 172.19.0.1:40686 - "POST /node/69abed2d40deb775998f46e5 HTTP/1.0" 202 Accepted 2026-03-07 09:19:11,583 - lava_callback - INFO - Starting async job submit for node 69abed2d40deb775998f46e5 2026-03-07 09:19:11,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:11,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abed2d40deb775998f46e5 HTTP/1.1" 200 None 2026-03-07 09:19:11,618 - lava_callback - DEBUG - Processing node 69abed2d40deb775998f46e5: baseline-x86 2026-03-07 09:19:11,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:12,026 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:12,028 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69abed2d40deb775998f46e5/log.txt.gz 2026-03-07 09:19:12,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:12,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:12,448 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69abed2d40deb775998f46e5/lava-logs.yaml 2026-03-07 09:19:12,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:12,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:12,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69abed2d40deb775998f46e5/lava_callback.json.gz 2026-03-07 09:19:12,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:12,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abed2d40deb775998f46e5 HTTP/1.1" 200 None 2026-03-07 09:19:12,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:12,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf4740deb775998f3bd2 HTTP/1.1" 200 None 2026-03-07 09:19:12,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:12,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abed2d40deb775998f46e5 HTTP/1.1" 200 None 2026-03-07 09:19:12,784 - lava_callback - INFO - Completed processing callback for node 69abed2d40deb775998f46e5 INFO: 172.19.0.1:40692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50132 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:19:31,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:31,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:39110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56268 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:19:47,623 - lava_callback - INFO - Received callback for node 69abe67140deb775998f40a7 INFO: 172.19.0.1:56282 - "POST /node/69abe67140deb775998f40a7 HTTP/1.0" 202 Accepted 2026-03-07 09:19:47,669 - lava_callback - INFO - Starting async job submit for node 69abe67140deb775998f40a7 2026-03-07 09:19:47,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:47,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe67140deb775998f40a7 HTTP/1.1" 200 None 2026-03-07 09:19:47,710 - lava_callback - DEBUG - Processing node 69abe67140deb775998f40a7: ltp-timers 2026-03-07 09:19:47,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:47,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:47,947 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69abe67140deb775998f40a7/log.txt.gz 2026-03-07 09:19:47,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:48,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:48,161 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69abe67140deb775998f40a7/lava-logs.yaml 2026-03-07 09:19:48,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:19:48,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:19:48,289 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69abe67140deb775998f40a7/lava_callback.json.gz 2026-03-07 09:19:48,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:48,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe67140deb775998f40a7 HTTP/1.1" 200 None 2026-03-07 09:19:48,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:48,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:19:48,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:19:48,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe67140deb775998f40a7 HTTP/1.1" 200 None 2026-03-07 09:19:48,434 - lava_callback - INFO - Completed processing callback for node 69abe67140deb775998f40a7 INFO: 172.19.0.1:41704 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:20:01,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:20:01,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:56786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37492 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:22:25,828 - lava_callback - INFO - Received callback for node 69abe99940deb775998f4388 INFO: 172.19.0.1:52480 - "POST /node/69abe99940deb775998f4388 HTTP/1.0" 202 Accepted 2026-03-07 09:22:25,836 - lava_callback - INFO - Starting async job submit for node 69abe99940deb775998f4388 2026-03-07 09:22:25,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:25,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99940deb775998f4388 HTTP/1.1" 200 None 2026-03-07 09:22:25,894 - lava_callback - DEBUG - Processing node 69abe99940deb775998f4388: baseline-nfs-arm64 INFO: 172.19.0.1:52494 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:22:26,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:22:27,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:22:27,141 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99940deb775998f4388/log.txt.gz 2026-03-07 09:22:27,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:22:27,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:22:27,986 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99940deb775998f4388/lava-logs.yaml 2026-03-07 09:22:28,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:22:28,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:22:28,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99940deb775998f4388/lava_callback.json.gz DEBUG: Setup failed for 69abe99940deb775998f4388. Transitting job node result: incomplete -> fail 2026-03-07 09:22:28,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:28,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99940deb775998f4388 HTTP/1.1" 200 None 2026-03-07 09:22:28,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:28,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:22:28,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:28,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99940deb775998f4388 HTTP/1.1" 200 None 2026-03-07 09:22:28,461 - lava_callback - INFO - Completed processing callback for node 69abe99940deb775998f4388 2026-03-07 09:22:31,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:31,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44932 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:22:42,151 - lava_callback - INFO - Received callback for node 69a94b4e7ee78ae610caba4a INFO: 172.19.0.1:53050 - "POST /node/69a94b4e7ee78ae610caba4a HTTP/1.0" 202 Accepted 2026-03-07 09:22:42,157 - lava_callback - INFO - Starting async job submit for node 69a94b4e7ee78ae610caba4a 2026-03-07 09:22:42,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:42,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94b4e7ee78ae610caba4a HTTP/1.1" 200 None 2026-03-07 09:22:42,173 - lava_callback - DEBUG - Processing node 69a94b4e7ee78ae610caba4a: baseline-arm64-baylibre 2026-03-07 09:22:42,173 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94b4e7ee78ae610caba4a 2026-03-07 09:22:42,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:42,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94b4e7ee78ae610caba4a HTTP/1.1" 200 None 2026-03-07 09:22:42,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:42,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 09:22:42,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:22:42,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94b4e7ee78ae610caba4a HTTP/1.1" 200 None 2026-03-07 09:22:42,231 - lava_callback - ERROR - Error processing callback for node 69a94b4e7ee78ae610caba4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42238 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41518 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:25:22,243 - lava_callback - INFO - Received callback for node 69a94bfb7ee78ae610cababf INFO: 172.19.0.1:38666 - "POST /node/69a94bfb7ee78ae610cababf HTTP/1.0" 202 Accepted 2026-03-07 09:25:22,248 - lava_callback - INFO - Starting async job submit for node 69a94bfb7ee78ae610cababf 2026-03-07 09:25:22,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:25:22,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94bfb7ee78ae610cababf HTTP/1.1" 200 None 2026-03-07 09:25:22,265 - lava_callback - DEBUG - Processing node 69a94bfb7ee78ae610cababf: baseline-arm64-baylibre 2026-03-07 09:25:22,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94bfb7ee78ae610cababf 2026-03-07 09:25:22,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:25:22,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94bfb7ee78ae610cababf HTTP/1.1" 200 None 2026-03-07 09:25:22,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:25:22,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 09:25:22,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:25:22,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94bfb7ee78ae610cababf HTTP/1.1" 200 None 2026-03-07 09:25:22,350 - lava_callback - ERROR - Error processing callback for node 69a94bfb7ee78ae610cababf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58228 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:26:00,377 - lava_callback - INFO - Received callback for node 69abef1740deb775998f479d INFO: 172.19.0.1:41694 - "POST /node/69abef1740deb775998f479d HTTP/1.0" 202 Accepted 2026-03-07 09:26:00,383 - lava_callback - INFO - Starting async job submit for node 69abef1740deb775998f479d 2026-03-07 09:26:00,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:26:00,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abef1740deb775998f479d HTTP/1.1" 200 None 2026-03-07 09:26:00,399 - lava_callback - DEBUG - Processing node 69abef1740deb775998f479d: baseline-nfs-arm64 2026-03-07 09:26:00,401 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:26:00,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:26:00,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:26:00,557 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abef1740deb775998f479d/lava-logs.yaml 2026-03-07 09:26:00,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:26:00,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:26:00,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abef1740deb775998f479d/lava_callback.json.gz 2026-03-07 09:26:00,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:26:00,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abef1740deb775998f479d HTTP/1.1" 200 None 2026-03-07 09:26:00,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:26:00,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:26:00,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:26:00,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abef1740deb775998f479d HTTP/1.1" 200 None 2026-03-07 09:26:00,840 - lava_callback - INFO - Completed processing callback for node 69abef1740deb775998f479d 2026-03-07 09:26:01,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:26:01,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33626 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:27:02,347 - lava_callback - INFO - Received callback for node 69a94c527ee78ae610cabaf7 INFO: 172.19.0.1:44554 - "POST /node/69a94c527ee78ae610cabaf7 HTTP/1.0" 202 Accepted 2026-03-07 09:27:02,352 - lava_callback - INFO - Starting async job submit for node 69a94c527ee78ae610cabaf7 2026-03-07 09:27:02,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:27:02,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94c527ee78ae610cabaf7 HTTP/1.1" 200 None 2026-03-07 09:27:02,369 - lava_callback - DEBUG - Processing node 69a94c527ee78ae610cabaf7: baseline-arm64-baylibre 2026-03-07 09:27:02,370 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94c527ee78ae610cabaf7 2026-03-07 09:27:02,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:27:02,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94c527ee78ae610cabaf7 HTTP/1.1" 200 None 2026-03-07 09:27:02,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:27:02,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 09:27:02,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:27:02,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94c527ee78ae610cabaf7 HTTP/1.1" 200 None 2026-03-07 09:27:02,440 - lava_callback - ERROR - Error processing callback for node 69a94c527ee78ae610cabaf7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43204 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:28:09,910 - lava_callback - INFO - Received callback for node 69abef7c40deb775998f47cd INFO: 172.19.0.1:56480 - "POST /node/69abef7c40deb775998f47cd HTTP/1.0" 202 Accepted 2026-03-07 09:28:09,917 - lava_callback - INFO - Starting async job submit for node 69abef7c40deb775998f47cd 2026-03-07 09:28:09,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:09,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abef7c40deb775998f47cd HTTP/1.1" 200 None 2026-03-07 09:28:09,961 - lava_callback - DEBUG - Processing node 69abef7c40deb775998f47cd: baseline-arm64 2026-03-07 09:28:10,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:28:10,306 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:28:10,308 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abef7c40deb775998f47cd/log.txt.gz 2026-03-07 09:28:10,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:28:10,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:28:10,582 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abef7c40deb775998f47cd/lava-logs.yaml 2026-03-07 09:28:10,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:28:10,744 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:28:10,746 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abef7c40deb775998f47cd/lava_callback.json.gz 2026-03-07 09:28:10,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:10,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abef7c40deb775998f47cd HTTP/1.1" 200 None 2026-03-07 09:28:10,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:10,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:28:10,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:10,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abef7c40deb775998f47cd HTTP/1.1" 200 None 2026-03-07 09:28:10,925 - lava_callback - INFO - Completed processing callback for node 69abef7c40deb775998f47cd INFO: 172.19.0.1:56486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56492 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:28:22,452 - lava_callback - INFO - Received callback for node 69a94ca87ee78ae610cabb36 INFO: 172.19.0.1:42784 - "POST /node/69a94ca87ee78ae610cabb36 HTTP/1.0" 202 Accepted 2026-03-07 09:28:22,458 - lava_callback - INFO - Starting async job submit for node 69a94ca87ee78ae610cabb36 2026-03-07 09:28:22,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:22,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94ca87ee78ae610cabb36 HTTP/1.1" 200 None 2026-03-07 09:28:22,499 - lava_callback - DEBUG - Processing node 69a94ca87ee78ae610cabb36: baseline-arm64-baylibre 2026-03-07 09:28:22,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94ca87ee78ae610cabb36 2026-03-07 09:28:22,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:22,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94ca87ee78ae610cabb36 HTTP/1.1" 200 None 2026-03-07 09:28:22,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:22,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 09:28:22,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:22,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94ca87ee78ae610cabb36 HTTP/1.1" 200 None 2026-03-07 09:28:22,576 - lava_callback - ERROR - Error processing callback for node 69a94ca87ee78ae610cabb36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42800 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:28:31,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:28:31,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57486 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:29:32,942 - lava_callback - INFO - Received callback for node 69abefc640deb775998f47f3 INFO: 172.19.0.1:45316 - "POST /node/69abefc640deb775998f47f3 HTTP/1.0" 202 Accepted 2026-03-07 09:29:32,949 - lava_callback - INFO - Starting async job submit for node 69abefc640deb775998f47f3 2026-03-07 09:29:32,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:29:32,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abefc640deb775998f47f3 HTTP/1.1" 200 None 2026-03-07 09:29:32,994 - lava_callback - DEBUG - Processing node 69abefc640deb775998f47f3: baseline-arm64 2026-03-07 09:29:33,128 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:29:33,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:29:33,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:29:33,404 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abefc640deb775998f47f3/lava-logs.yaml 2026-03-07 09:29:33,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:29:33,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:29:33,570 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abefc640deb775998f47f3/lava_callback.json.gz 2026-03-07 09:29:33,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:29:33,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abefc640deb775998f47f3 HTTP/1.1" 200 None 2026-03-07 09:29:33,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:29:33,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:29:33,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:29:33,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abefc640deb775998f47f3 HTTP/1.1" 200 None 2026-03-07 09:29:33,742 - lava_callback - INFO - Completed processing callback for node 69abefc640deb775998f47f3 INFO: 172.19.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40058 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:30:01,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:30:01,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53112 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:33:22,714 - lava_callback - INFO - Received callback for node 69a94dd57ee78ae610cabc16 INFO: 172.19.0.1:57004 - "POST /node/69a94dd57ee78ae610cabc16 HTTP/1.0" 202 Accepted 2026-03-07 09:33:22,719 - lava_callback - INFO - Starting async job submit for node 69a94dd57ee78ae610cabc16 2026-03-07 09:33:22,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:33:22,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94dd57ee78ae610cabc16 HTTP/1.1" 200 None 2026-03-07 09:33:22,744 - lava_callback - DEBUG - Processing node 69a94dd57ee78ae610cabc16: baseline-arm64-baylibre 2026-03-07 09:33:22,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94dd57ee78ae610cabc16 2026-03-07 09:33:22,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:33:22,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94dd57ee78ae610cabc16 HTTP/1.1" 200 None 2026-03-07 09:33:22,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:33:22,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 09:33:22,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:33:22,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94dd57ee78ae610cabc16 HTTP/1.1" 200 None 2026-03-07 09:33:22,796 - lava_callback - ERROR - Error processing callback for node 69a94dd57ee78ae610cabc16: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38368 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:36:32,542 - lava_callback - INFO - Received callback for node 69abe98e40deb775998f436b INFO: 172.19.0.1:43462 - "POST /node/69abe98e40deb775998f436b HTTP/1.0" 202 Accepted 2026-03-07 09:36:32,548 - lava_callback - INFO - Starting async job submit for node 69abe98e40deb775998f436b 2026-03-07 09:36:32,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:36:32,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98e40deb775998f436b HTTP/1.1" 200 None 2026-03-07 09:36:32,584 - lava_callback - DEBUG - Processing node 69abe98e40deb775998f436b: baseline-arm64 2026-03-07 09:36:32,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:36:33,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:36:33,006 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98e40deb775998f436b/log.txt.gz 2026-03-07 09:36:33,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:36:33,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:36:33,385 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98e40deb775998f436b/lava-logs.yaml 2026-03-07 09:36:33,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:36:33,552 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:36:33,554 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abe98e40deb775998f436b/lava_callback.json.gz 2026-03-07 09:36:33,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:36:33,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe98e40deb775998f436b HTTP/1.1" 200 None 2026-03-07 09:36:33,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:36:33,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:36:33,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:36:33,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe98e40deb775998f436b HTTP/1.1" 200 None 2026-03-07 09:36:33,667 - lava_callback - INFO - Completed processing callback for node 69abe98e40deb775998f436b INFO: 172.19.0.1:43474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57836 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:37:01,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:37:01,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46928 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:38:03,264 - lava_callback - INFO - Received callback for node 69abe99d40deb775998f4394 INFO: 172.19.0.1:57692 - "POST /node/69abe99d40deb775998f4394 HTTP/1.0" 202 Accepted 2026-03-07 09:38:03,270 - lava_callback - INFO - Starting async job submit for node 69abe99d40deb775998f4394 2026-03-07 09:38:03,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:38:03,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99d40deb775998f4394 HTTP/1.1" 200 None 2026-03-07 09:38:03,316 - lava_callback - DEBUG - Processing node 69abe99d40deb775998f4394: baseline-nfs-arm64 2026-03-07 09:38:03,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:38:03,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:38:03,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99d40deb775998f4394/log.txt.gz 2026-03-07 09:38:04,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:38:04,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:38:04,283 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99d40deb775998f4394/lava-logs.yaml 2026-03-07 09:38:04,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:38:04,450 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:38:04,452 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abe99d40deb775998f4394/lava_callback.json.gz 2026-03-07 09:38:04,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:38:04,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe99d40deb775998f4394 HTTP/1.1" 200 None 2026-03-07 09:38:04,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:38:04,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:38:04,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:38:04,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe99d40deb775998f4394 HTTP/1.1" 200 None 2026-03-07 09:38:04,533 - lava_callback - INFO - Completed processing callback for node 69abe99d40deb775998f4394 INFO: 172.19.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33586 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:38:31,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:38:31,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43112 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:39:23,066 - lava_callback - INFO - Received callback for node 69a94f3a7ee78ae610cabd1d INFO: 172.19.0.1:37414 - "POST /node/69a94f3a7ee78ae610cabd1d HTTP/1.0" 202 Accepted 2026-03-07 09:39:23,071 - lava_callback - INFO - Starting async job submit for node 69a94f3a7ee78ae610cabd1d 2026-03-07 09:39:23,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:39:23,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94f3a7ee78ae610cabd1d HTTP/1.1" 200 None 2026-03-07 09:39:23,088 - lava_callback - DEBUG - Processing node 69a94f3a7ee78ae610cabd1d: baseline-arm64-baylibre 2026-03-07 09:39:23,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a94f3a7ee78ae610cabd1d 2026-03-07 09:39:23,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:39:23,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a94f3a7ee78ae610cabd1d HTTP/1.1" 200 None 2026-03-07 09:39:23,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:39:23,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 09:39:23,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:39:23,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a94f3a7ee78ae610cabd1d HTTP/1.1" 200 None 2026-03-07 09:39:23,147 - lava_callback - ERROR - Error processing callback for node 69a94f3a7ee78ae610cabd1d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43330 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:43:48,870 - lava_callback - INFO - Received callback for node 69abf26f40deb775998f4909 INFO: 172.19.0.1:43342 - "POST /node/69abf26f40deb775998f4909 HTTP/1.0" 202 Accepted 2026-03-07 09:43:48,876 - lava_callback - INFO - Starting async job submit for node 69abf26f40deb775998f4909 2026-03-07 09:43:48,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:43:48,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf26f40deb775998f4909 HTTP/1.1" 200 None 2026-03-07 09:43:48,938 - lava_callback - DEBUG - Processing node 69abf26f40deb775998f4909: ltp-timers 2026-03-07 09:43:49,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:43:49,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:43:49,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69abf26f40deb775998f4909/log.txt.gz 2026-03-07 09:43:49,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:43:49,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:43:49,892 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69abf26f40deb775998f4909/lava-logs.yaml 2026-03-07 09:43:49,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:43:50,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:43:50,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69abf26f40deb775998f4909/lava_callback.json.gz 2026-03-07 09:43:50,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:43:50,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf26f40deb775998f4909 HTTP/1.1" 200 None 2026-03-07 09:43:50,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:43:50,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:43:50,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:43:50,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf26f40deb775998f4909 HTTP/1.1" 200 None 2026-03-07 09:43:50,174 - lava_callback - INFO - Completed processing callback for node 69abf26f40deb775998f4909 INFO: 172.19.0.1:32988 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:44:01,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:44:01,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36048 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33526 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:47:56,640 - lava_callback - INFO - Received callback for node 69abf20840deb775998f48dc INFO: 172.19.0.1:33528 - "POST /node/69abf20840deb775998f48dc HTTP/1.0" 202 Accepted 2026-03-07 09:47:56,647 - lava_callback - INFO - Starting async job submit for node 69abf20840deb775998f48dc 2026-03-07 09:47:56,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:47:56,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf20840deb775998f48dc HTTP/1.1" 200 None 2026-03-07 09:47:56,707 - lava_callback - DEBUG - Processing node 69abf20840deb775998f48dc: baseline-arm64 2026-03-07 09:47:57,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:47:57,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:47:57,274 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf20840deb775998f48dc/log.txt.gz 2026-03-07 09:47:57,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:47:57,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:47:57,719 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf20840deb775998f48dc/lava-logs.yaml 2026-03-07 09:47:57,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:47:57,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:47:57,914 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf20840deb775998f48dc/lava_callback.json.gz DEBUG: Setup failed for 69abf20840deb775998f48dc. Transitting job node result: incomplete -> fail 2026-03-07 09:47:57,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:47:58,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf20840deb775998f48dc HTTP/1.1" 200 None 2026-03-07 09:47:58,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:47:58,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:47:58,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:47:58,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf20840deb775998f48dc HTTP/1.1" 200 None 2026-03-07 09:47:58,131 - lava_callback - INFO - Completed processing callback for node 69abf20840deb775998f48dc 2026-03-07 09:48:01,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:01,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 09:48:01,321 - lava_callback - INFO - Received callback for node 69abf43340deb775998f49a8 INFO: 172.19.0.1:34266 - "POST /node/69abf43340deb775998f49a8 HTTP/1.0" 202 Accepted 2026-03-07 09:48:01,327 - lava_callback - INFO - Starting async job submit for node 69abf43340deb775998f49a8 2026-03-07 09:48:01,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:01,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf43340deb775998f49a8 HTTP/1.1" 200 None 2026-03-07 09:48:01,343 - lava_callback - DEBUG - Processing node 69abf43340deb775998f49a8: baseline-nfs-arm64 2026-03-07 09:48:01,344 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:48:01,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:48:01,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:48:01,492 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf43340deb775998f49a8/lava-logs.yaml 2026-03-07 09:48:01,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:48:01,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:48:01,659 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf43340deb775998f49a8/lava_callback.json.gz 2026-03-07 09:48:01,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:01,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf43340deb775998f49a8 HTTP/1.1" 200 None 2026-03-07 09:48:01,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:01,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:48:01,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:01,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf43340deb775998f49a8 HTTP/1.1" 200 None 2026-03-07 09:48:01,718 - lava_callback - INFO - Completed processing callback for node 69abf43340deb775998f49a8 INFO: 172.19.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49508 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:48:31,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:31,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:49520 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:48:39,203 - lava_callback - INFO - Received callback for node 69abf05640deb775998f4828 INFO: 172.19.0.1:49522 - "POST /node/69abf05640deb775998f4828 HTTP/1.0" 202 Accepted 2026-03-07 09:48:39,210 - lava_callback - INFO - Starting async job submit for node 69abf05640deb775998f4828 2026-03-07 09:48:39,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:39,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf05640deb775998f4828 HTTP/1.1" 200 None 2026-03-07 09:48:39,285 - lava_callback - DEBUG - Processing node 69abf05640deb775998f4828: ltp-smoke 2026-03-07 09:48:39,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:48:40,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:48:40,012 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf05640deb775998f4828/log.txt.gz 2026-03-07 09:48:40,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:48:40,478 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:48:40,480 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf05640deb775998f4828/lava-logs.yaml 2026-03-07 09:48:40,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:48:40,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:48:40,652 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf05640deb775998f4828/lava_callback.json.gz 2026-03-07 09:48:40,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:40,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf05640deb775998f4828 HTTP/1.1" 200 None 2026-03-07 09:48:40,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:40,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2b40deb775998f3bab HTTP/1.1" 200 None 2026-03-07 09:48:40,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:48:40,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf05640deb775998f4828 HTTP/1.1" 200 None 2026-03-07 09:48:40,986 - lava_callback - INFO - Completed processing callback for node 69abf05640deb775998f4828 INFO: 172.19.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42430 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:49:01,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:01,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-07 09:49:03,560 - lava_callback - INFO - Received callback for node 69a951887ee78ae610cabf28 INFO: 172.19.0.1:43570 - "POST /node/69a951887ee78ae610cabf28 HTTP/1.0" 202 Accepted 2026-03-07 09:49:03,566 - lava_callback - INFO - Starting async job submit for node 69a951887ee78ae610cabf28 2026-03-07 09:49:03,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:03,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a951887ee78ae610cabf28 HTTP/1.1" 200 None 2026-03-07 09:49:03,592 - lava_callback - DEBUG - Processing node 69a951887ee78ae610cabf28: baseline-arm64-baylibre 2026-03-07 09:49:03,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a951887ee78ae610cabf28 2026-03-07 09:49:03,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:03,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a951887ee78ae610cabf28 HTTP/1.1" 200 None 2026-03-07 09:49:03,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:03,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 09:49:03,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:03,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a951887ee78ae610cabf28 HTTP/1.1" 200 None 2026-03-07 09:49:03,650 - lava_callback - ERROR - Error processing callback for node 69a951887ee78ae610cabf28: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47916 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:49:56,770 - lava_callback - INFO - Received callback for node 69abf09d40deb775998f4849 INFO: 172.19.0.1:47922 - "POST /node/69abf09d40deb775998f4849 HTTP/1.0" 202 Accepted 2026-03-07 09:49:56,782 - lava_callback - INFO - Starting async job submit for node 69abf09d40deb775998f4849 2026-03-07 09:49:56,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:56,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf09d40deb775998f4849 HTTP/1.1" 200 None 2026-03-07 09:49:56,856 - lava_callback - DEBUG - Processing node 69abf09d40deb775998f4849: baseline-arm 2026-03-07 09:49:57,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:49:57,608 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:49:57,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abf09d40deb775998f4849/log.txt.gz 2026-03-07 09:49:57,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:49:58,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:49:58,215 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abf09d40deb775998f4849/lava-logs.yaml 2026-03-07 09:49:58,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:49:58,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:49:58,391 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abf09d40deb775998f4849/lava_callback.json.gz DEBUG: Setup failed for 69abf09d40deb775998f4849. Transitting job node result: incomplete -> fail 2026-03-07 09:49:58,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:58,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf09d40deb775998f4849 HTTP/1.1" 200 None 2026-03-07 09:49:58,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:58,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:49:58,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:49:58,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf09d40deb775998f4849 HTTP/1.1" 200 None 2026-03-07 09:49:58,702 - lava_callback - INFO - Completed processing callback for node 69abf09d40deb775998f4849 2026-03-07 09:50:01,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:50:01,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45040 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:50:49,049 - lava_callback - INFO - Received callback for node 69abf4c040deb775998f49e2 INFO: 172.19.0.1:45042 - "POST /node/69abf4c040deb775998f49e2 HTTP/1.0" 202 Accepted 2026-03-07 09:50:49,056 - lava_callback - INFO - Starting async job submit for node 69abf4c040deb775998f49e2 2026-03-07 09:50:49,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:50:49,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf4c040deb775998f49e2 HTTP/1.1" 200 None 2026-03-07 09:50:49,111 - lava_callback - DEBUG - Processing node 69abf4c040deb775998f49e2: baseline-arm64 2026-03-07 09:50:49,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:50:49,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:50:49,392 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf4c040deb775998f49e2/log.txt.gz 2026-03-07 09:50:49,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:50:49,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:50:49,627 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf4c040deb775998f49e2/lava-logs.yaml 2026-03-07 09:50:49,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:50:49,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:50:49,774 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf4c040deb775998f49e2/lava_callback.json.gz 2026-03-07 09:50:49,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:50:49,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf4c040deb775998f49e2 HTTP/1.1" 200 None 2026-03-07 09:50:49,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:50:49,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:50:49,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:50:49,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf4c040deb775998f49e2 HTTP/1.1" 200 None 2026-03-07 09:50:49,914 - lava_callback - INFO - Completed processing callback for node 69abf4c040deb775998f49e2 INFO: 172.19.0.1:57608 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:51:01,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:51:01,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36812 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:53:29,276 - lava_callback - INFO - Received callback for node 69abf55340deb775998f4a0d INFO: 172.19.0.1:36814 - "POST /node/69abf55340deb775998f4a0d HTTP/1.0" 202 Accepted 2026-03-07 09:53:29,282 - lava_callback - INFO - Starting async job submit for node 69abf55340deb775998f4a0d 2026-03-07 09:53:29,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:53:29,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf55340deb775998f4a0d HTTP/1.1" 200 None 2026-03-07 09:53:29,326 - lava_callback - DEBUG - Processing node 69abf55340deb775998f4a0d: baseline-arm64 2026-03-07 09:53:29,461 - lava_callback - WARNING - Failed to upload log 2026-03-07 09:53:29,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:53:29,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:53:29,750 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf55340deb775998f4a0d/lava-logs.yaml 2026-03-07 09:53:29,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:53:29,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:53:29,893 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf55340deb775998f4a0d/lava_callback.json.gz 2026-03-07 09:53:29,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:53:29,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf55340deb775998f4a0d HTTP/1.1" 200 None 2026-03-07 09:53:29,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:53:29,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 09:53:29,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:53:30,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf55340deb775998f4a0d HTTP/1.1" 200 None 2026-03-07 09:53:30,071 - lava_callback - INFO - Completed processing callback for node 69abf55340deb775998f4a0d 2026-03-07 09:53:31,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:53:31,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42970 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:54:33,745 - lava_callback - INFO - Received callback for node 69abf15540deb775998f4895 INFO: 172.19.0.1:49224 - "POST /node/69abf15540deb775998f4895 HTTP/1.0" 202 Accepted 2026-03-07 09:54:33,793 - lava_callback - INFO - Starting async job submit for node 69abf15540deb775998f4895 2026-03-07 09:54:33,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:54:33,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf15540deb775998f4895 HTTP/1.1" 200 None 2026-03-07 09:54:33,832 - lava_callback - DEBUG - Processing node 69abf15540deb775998f4895: baseline-arm-pengutronix 2026-03-07 09:54:33,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:54:34,107 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:54:34,109 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf15540deb775998f4895/log.txt.gz 2026-03-07 09:54:34,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:54:34,350 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:54:34,352 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf15540deb775998f4895/lava-logs.yaml 2026-03-07 09:54:34,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 09:54:34,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 09:54:34,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf15540deb775998f4895/lava_callback.json.gz DEBUG: Setup failed for 69abf15540deb775998f4895. Transitting job node result: incomplete -> fail 2026-03-07 09:54:34,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:54:34,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf15540deb775998f4895 HTTP/1.1" 200 None 2026-03-07 09:54:34,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:54:34,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 09:54:34,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:54:34,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf15540deb775998f4895 HTTP/1.1" 200 None 2026-03-07 09:54:34,648 - lava_callback - INFO - Completed processing callback for node 69abf15540deb775998f4895 INFO: 172.19.0.1:49236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50216 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:55:01,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:55:01,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41834 - "GET / HTTP/1.0" 200 OK 2026-03-07 09:57:04,062 - lava_callback - INFO - Received callback for node 69a953677ee78ae610cac0f3 INFO: 172.19.0.1:44924 - "POST /node/69a953677ee78ae610cac0f3 HTTP/1.0" 202 Accepted 2026-03-07 09:57:04,068 - lava_callback - INFO - Starting async job submit for node 69a953677ee78ae610cac0f3 2026-03-07 09:57:04,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:57:04,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a953677ee78ae610cac0f3 HTTP/1.1" 200 None 2026-03-07 09:57:04,086 - lava_callback - DEBUG - Processing node 69a953677ee78ae610cac0f3: baseline-arm64-baylibre 2026-03-07 09:57:04,086 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a953677ee78ae610cac0f3 2026-03-07 09:57:04,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:57:04,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a953677ee78ae610cac0f3 HTTP/1.1" 200 None 2026-03-07 09:57:04,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:57:04,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a5e0fe32aaccb4c112eb82 HTTP/1.1" 200 None 2026-03-07 09:57:04,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 09:57:04,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a953677ee78ae610cac0f3 HTTP/1.1" 200 None 2026-03-07 09:57:04,155 - lava_callback - ERROR - Error processing callback for node 69a953677ee78ae610cac0f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59314 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:01:11,226 - lava_callback - INFO - Received callback for node 69abf2c240deb775998f4926 INFO: 172.19.0.1:46552 - "POST /node/69abf2c240deb775998f4926 HTTP/1.0" 202 Accepted 2026-03-07 10:01:11,234 - lava_callback - INFO - Starting async job submit for node 69abf2c240deb775998f4926 2026-03-07 10:01:11,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:11,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf2c240deb775998f4926 HTTP/1.1" 200 None 2026-03-07 10:01:11,294 - lava_callback - DEBUG - Processing node 69abf2c240deb775998f4926: baseline-nfs-arm64 2026-03-07 10:01:12,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:01:12,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:01:12,584 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf2c240deb775998f4926/log.txt.gz 2026-03-07 10:01:13,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:01:13,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:01:13,413 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf2c240deb775998f4926/lava-logs.yaml 2026-03-07 10:01:13,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:01:13,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:01:13,641 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf2c240deb775998f4926/lava_callback.json.gz DEBUG: Setup failed for 69abf2c240deb775998f4926. Transitting job node result: incomplete -> fail 2026-03-07 10:01:13,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:13,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf2c240deb775998f4926 HTTP/1.1" 200 None 2026-03-07 10:01:13,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:13,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:01:13,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:13,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf2c240deb775998f4926 HTTP/1.1" 200 None 2026-03-07 10:01:13,915 - lava_callback - INFO - Completed processing callback for node 69abf2c240deb775998f4926 INFO: 172.19.0.1:46568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46574 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:01:21,864 - lava_callback - INFO - Received callback for node 69abf75a40deb775998f4a91 INFO: 172.19.0.1:41156 - "POST /node/69abf75a40deb775998f4a91 HTTP/1.0" 202 Accepted 2026-03-07 10:01:21,870 - lava_callback - INFO - Starting async job submit for node 69abf75a40deb775998f4a91 2026-03-07 10:01:21,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:21,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf75a40deb775998f4a91 HTTP/1.1" 200 None 2026-03-07 10:01:21,892 - lava_callback - DEBUG - Processing node 69abf75a40deb775998f4a91: baseline-nfs-arm64 2026-03-07 10:01:21,893 - lava_callback - WARNING - Failed to upload log 2026-03-07 10:01:21,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:01:22,045 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:01:22,047 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf75a40deb775998f4a91/lava-logs.yaml 2026-03-07 10:01:22,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:01:22,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:01:22,196 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf75a40deb775998f4a91/lava_callback.json.gz 2026-03-07 10:01:22,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:22,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf75a40deb775998f4a91 HTTP/1.1" 200 None 2026-03-07 10:01:22,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:22,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:01:22,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:22,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf75a40deb775998f4a91 HTTP/1.1" 200 None 2026-03-07 10:01:22,259 - lava_callback - INFO - Completed processing callback for node 69abf75a40deb775998f4a91 INFO: 172.19.0.1:41164 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:01:31,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:01:31,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49018 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:04:54,378 - lava_callback - INFO - Received callback for node 69abf80c40deb775998f4adb INFO: 172.19.0.1:46514 - "POST /node/69abf80c40deb775998f4adb HTTP/1.0" 202 Accepted 2026-03-07 10:04:54,385 - lava_callback - INFO - Starting async job submit for node 69abf80c40deb775998f4adb 2026-03-07 10:04:54,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:04:54,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf80c40deb775998f4adb HTTP/1.1" 200 None 2026-03-07 10:04:54,438 - lava_callback - DEBUG - Processing node 69abf80c40deb775998f4adb: baseline-arm64 2026-03-07 10:04:54,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:04:54,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:04:54,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf80c40deb775998f4adb/log.txt.gz 2026-03-07 10:04:54,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:04:55,034 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:04:55,036 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf80c40deb775998f4adb/lava-logs.yaml 2026-03-07 10:04:55,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:04:55,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:04:55,191 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf80c40deb775998f4adb/lava_callback.json.gz 2026-03-07 10:04:55,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:04:55,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf80c40deb775998f4adb HTTP/1.1" 200 None 2026-03-07 10:04:55,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:04:55,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:04:55,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:04:55,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf80c40deb775998f4adb HTTP/1.1" 200 None 2026-03-07 10:04:55,351 - lava_callback - INFO - Completed processing callback for node 69abf80c40deb775998f4adb INFO: 172.19.0.1:46520 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:05:01,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:05:01,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43756 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:06:29,776 - lava_callback - INFO - Received callback for node 69abf85740deb775998f4af4 INFO: 172.19.0.1:33770 - "POST /node/69abf85740deb775998f4af4 HTTP/1.0" 202 Accepted 2026-03-07 10:06:29,786 - lava_callback - INFO - Starting async job submit for node 69abf85740deb775998f4af4 2026-03-07 10:06:29,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:06:29,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf85740deb775998f4af4 HTTP/1.1" 200 None 2026-03-07 10:06:29,836 - lava_callback - DEBUG - Processing node 69abf85740deb775998f4af4: baseline-arm64 2026-03-07 10:06:29,975 - lava_callback - WARNING - Failed to upload log 2026-03-07 10:06:30,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:06:30,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:06:30,260 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf85740deb775998f4af4/lava-logs.yaml 2026-03-07 10:06:30,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:06:30,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:06:30,415 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf85740deb775998f4af4/lava_callback.json.gz 2026-03-07 10:06:30,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:06:30,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf85740deb775998f4af4 HTTP/1.1" 200 None 2026-03-07 10:06:30,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:06:30,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:06:30,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:06:30,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf85740deb775998f4af4 HTTP/1.1" 200 None 2026-03-07 10:06:30,580 - lava_callback - INFO - Completed processing callback for node 69abf85740deb775998f4af4 2026-03-07 10:06:31,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:06:31,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59782 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:07:08,796 - lava_callback - INFO - Received callback for node 69abf70e40deb775998f4a82 INFO: 172.19.0.1:59796 - "POST /node/69abf70e40deb775998f4a82 HTTP/1.0" 202 Accepted 2026-03-07 10:07:08,803 - lava_callback - INFO - Starting async job submit for node 69abf70e40deb775998f4a82 2026-03-07 10:07:08,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:07:08,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf70e40deb775998f4a82 HTTP/1.1" 200 None 2026-03-07 10:07:08,864 - lava_callback - DEBUG - Processing node 69abf70e40deb775998f4a82: baseline-arm64 2026-03-07 10:07:09,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:07:09,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:07:09,433 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf70e40deb775998f4a82/log.txt.gz 2026-03-07 10:07:09,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:07:09,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:07:09,943 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf70e40deb775998f4a82/lava-logs.yaml 2026-03-07 10:07:09,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:07:10,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:07:10,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf70e40deb775998f4a82/lava_callback.json.gz DEBUG: Setup failed for 69abf70e40deb775998f4a82. Transitting job node result: incomplete -> fail 2026-03-07 10:07:10,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:07:10,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf70e40deb775998f4a82 HTTP/1.1" 200 None 2026-03-07 10:07:10,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:07:10,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:07:10,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:07:10,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf70e40deb775998f4a82 HTTP/1.1" 200 None 2026-03-07 10:07:10,360 - lava_callback - INFO - Completed processing callback for node 69abf70e40deb775998f4a82 INFO: 172.19.0.1:54392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42256 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:07:31,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:07:31,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:52044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44866 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:13:47,872 - lava_callback - INFO - Received callback for node 69abf91940deb775998f4b39 INFO: 172.19.0.1:44868 - "POST /node/69abf91940deb775998f4b39 HTTP/1.0" 202 Accepted 2026-03-07 10:13:47,879 - lava_callback - INFO - Starting async job submit for node 69abf91940deb775998f4b39 2026-03-07 10:13:47,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:13:47,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf91940deb775998f4b39 HTTP/1.1" 200 None 2026-03-07 10:13:47,942 - lava_callback - DEBUG - Processing node 69abf91940deb775998f4b39: baseline-arm64 2026-03-07 10:13:48,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:13:48,474 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:13:48,476 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf91940deb775998f4b39/log.txt.gz 2026-03-07 10:13:48,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:13:48,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:13:48,940 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf91940deb775998f4b39/lava-logs.yaml 2026-03-07 10:13:48,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:13:49,132 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:13:49,134 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69abf91940deb775998f4b39/lava_callback.json.gz DEBUG: Setup failed for 69abf91940deb775998f4b39. Transitting job node result: incomplete -> fail 2026-03-07 10:13:49,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:13:49,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf91940deb775998f4b39 HTTP/1.1" 200 None 2026-03-07 10:13:49,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:13:49,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:13:49,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:13:49,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf91940deb775998f4b39 HTTP/1.1" 200 None 2026-03-07 10:13:49,369 - lava_callback - INFO - Completed processing callback for node 69abf91940deb775998f4b39 INFO: 172.19.0.1:42358 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:14:01,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:14:01,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:37390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58048 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:19:42,525 - lava_callback - INFO - Received callback for node 69abf79c40deb775998f4aaf INFO: 172.19.0.1:37982 - "POST /node/69abf79c40deb775998f4aaf HTTP/1.0" 202 Accepted 2026-03-07 10:19:42,531 - lava_callback - INFO - Starting async job submit for node 69abf79c40deb775998f4aaf 2026-03-07 10:19:42,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:19:42,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf79c40deb775998f4aaf HTTP/1.1" 200 None 2026-03-07 10:19:42,622 - lava_callback - DEBUG - Processing node 69abf79c40deb775998f4aaf: ltp-smoke 2026-03-07 10:19:43,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:19:43,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:19:43,274 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf79c40deb775998f4aaf/log.txt.gz 2026-03-07 10:19:43,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:19:43,803 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:19:43,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf79c40deb775998f4aaf/lava-logs.yaml 2026-03-07 10:19:43,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:19:44,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:19:44,003 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69abf79c40deb775998f4aaf/lava_callback.json.gz 2026-03-07 10:19:44,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:19:44,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf79c40deb775998f4aaf HTTP/1.1" 200 None 2026-03-07 10:19:44,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:19:44,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2b40deb775998f3bab HTTP/1.1" 200 None 2026-03-07 10:19:44,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:19:44,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf79c40deb775998f4aaf HTTP/1.1" 200 None 2026-03-07 10:19:44,313 - lava_callback - INFO - Completed processing callback for node 69abf79c40deb775998f4aaf INFO: 172.19.0.1:37992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51630 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:20:01,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:20:01,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42910 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:20:54,018 - lava_callback - INFO - Received callback for node 69abf7e840deb775998f4ac9 INFO: 172.19.0.1:39372 - "POST /node/69abf7e840deb775998f4ac9 HTTP/1.0" 202 Accepted 2026-03-07 10:20:54,025 - lava_callback - INFO - Starting async job submit for node 69abf7e840deb775998f4ac9 2026-03-07 10:20:54,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:20:54,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf7e840deb775998f4ac9 HTTP/1.1" 200 None 2026-03-07 10:20:54,120 - lava_callback - DEBUG - Processing node 69abf7e840deb775998f4ac9: baseline-arm 2026-03-07 10:20:54,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:20:54,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:20:54,886 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abf7e840deb775998f4ac9/log.txt.gz 2026-03-07 10:20:55,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:39378 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:21:00,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:21:00,164 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abf7e840deb775998f4ac9/lava-logs.yaml 2026-03-07 10:21:00,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:21:00,373 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:21:00,375 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abf7e840deb775998f4ac9/lava_callback.json.gz DEBUG: Setup failed for 69abf7e840deb775998f4ac9. Transitting job node result: incomplete -> fail 2026-03-07 10:21:00,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:21:00,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf7e840deb775998f4ac9 HTTP/1.1" 200 None 2026-03-07 10:21:00,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:21:00,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 10:21:00,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:21:00,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf7e840deb775998f4ac9 HTTP/1.1" 200 None 2026-03-07 10:21:00,650 - lava_callback - INFO - Completed processing callback for node 69abf7e840deb775998f4ac9 2026-03-07 10:21:01,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:21:01,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47054 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:23:25,436 - lava_callback - INFO - Received callback for node 69a959897ee78ae610cac5ce INFO: 172.19.0.1:36566 - "POST /node/69a959897ee78ae610cac5ce HTTP/1.0" 202 Accepted 2026-03-07 10:23:25,442 - lava_callback - INFO - Starting async job submit for node 69a959897ee78ae610cac5ce 2026-03-07 10:23:25,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:23:25,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a959897ee78ae610cac5ce HTTP/1.1" 200 None 2026-03-07 10:23:25,463 - lava_callback - DEBUG - Processing node 69a959897ee78ae610cac5ce: baseline-arm-baylibre 2026-03-07 10:23:25,463 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a959897ee78ae610cac5ce 2026-03-07 10:23:25,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:23:25,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a959897ee78ae610cac5ce HTTP/1.1" 200 None 2026-03-07 10:23:25,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:23:25,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:23:25,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:23:25,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a959897ee78ae610cac5ce HTTP/1.1" 200 None 2026-03-07 10:23:25,530 - lava_callback - ERROR - Error processing callback for node 69a959897ee78ae610cac5ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42516 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:25:54,811 - lava_callback - INFO - Received callback for node 69abf8aa40deb775998f4b12 INFO: 172.19.0.1:33408 - "POST /node/69abf8aa40deb775998f4b12 HTTP/1.0" 202 Accepted 2026-03-07 10:25:54,857 - lava_callback - INFO - Starting async job submit for node 69abf8aa40deb775998f4b12 2026-03-07 10:25:54,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:25:54,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf8aa40deb775998f4b12 HTTP/1.1" 200 None 2026-03-07 10:25:54,897 - lava_callback - DEBUG - Processing node 69abf8aa40deb775998f4b12: baseline-arm-pengutronix 2026-03-07 10:25:55,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:25:55,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:25:55,165 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf8aa40deb775998f4b12/log.txt.gz 2026-03-07 10:25:55,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:25:55,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:25:55,423 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf8aa40deb775998f4b12/lava-logs.yaml 2026-03-07 10:25:55,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:25:55,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:25:55,588 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abf8aa40deb775998f4b12/lava_callback.json.gz DEBUG: Setup failed for 69abf8aa40deb775998f4b12. Transitting job node result: incomplete -> fail 2026-03-07 10:25:55,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:25:55,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf8aa40deb775998f4b12 HTTP/1.1" 200 None 2026-03-07 10:25:55,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:25:55,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 10:25:55,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:25:55,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf8aa40deb775998f4b12 HTTP/1.1" 200 None 2026-03-07 10:25:55,744 - lava_callback - INFO - Completed processing callback for node 69abf8aa40deb775998f4b12 INFO: 172.19.0.1:33410 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:26:01,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:26:01,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54556 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:27:01,551 - lava_callback - INFO - Received callback for node 69abf8cb40deb775998f4b21 INFO: 172.19.0.1:45362 - "POST /node/69abf8cb40deb775998f4b21 HTTP/1.0" 202 Accepted 2026-03-07 10:27:01,558 - lava_callback - INFO - Starting async job submit for node 69abf8cb40deb775998f4b21 2026-03-07 10:27:01,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:27:01,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf8cb40deb775998f4b21 HTTP/1.1" 200 None 2026-03-07 10:27:01,625 - lava_callback - DEBUG - Processing node 69abf8cb40deb775998f4b21: baseline-nfs-arm64 2026-03-07 10:27:02,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:27:02,825 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:27:02,827 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf8cb40deb775998f4b21/log.txt.gz 2026-03-07 10:27:03,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:27:03,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:27:03,724 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf8cb40deb775998f4b21/lava-logs.yaml 2026-03-07 10:27:03,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:27:03,941 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:27:03,943 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abf8cb40deb775998f4b21/lava_callback.json.gz DEBUG: Setup failed for 69abf8cb40deb775998f4b21. Transitting job node result: incomplete -> fail 2026-03-07 10:27:04,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:27:04,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abf8cb40deb775998f4b21 HTTP/1.1" 200 None 2026-03-07 10:27:04,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:27:04,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:27:04,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:27:04,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abf8cb40deb775998f4b21 HTTP/1.1" 200 None 2026-03-07 10:27:04,175 - lava_callback - INFO - Completed processing callback for node 69abf8cb40deb775998f4b21 INFO: 172.19.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38458 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:27:31,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:27:31,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42018 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:29:45,740 - lava_callback - INFO - Received callback for node 69a95b177ee78ae610cac755 INFO: 172.19.0.1:57074 - "POST /node/69a95b177ee78ae610cac755 HTTP/1.0" 202 Accepted 2026-03-07 10:29:45,749 - lava_callback - INFO - Starting async job submit for node 69a95b177ee78ae610cac755 2026-03-07 10:29:45,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:29:45,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95b177ee78ae610cac755 HTTP/1.1" 200 None 2026-03-07 10:29:45,776 - lava_callback - DEBUG - Processing node 69a95b177ee78ae610cac755: baseline-arm-baylibre 2026-03-07 10:29:45,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a95b177ee78ae610cac755 2026-03-07 10:29:45,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:29:45,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95b177ee78ae610cac755 HTTP/1.1" 200 None 2026-03-07 10:29:45,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:29:45,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:29:45,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:29:45,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a95b177ee78ae610cac755 HTTP/1.1" 200 None 2026-03-07 10:29:45,851 - lava_callback - ERROR - Error processing callback for node 69a95b177ee78ae610cac755: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55500 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:55502 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.19.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55524 - "GET /sitemap.xml HTTP/1.0" 404 Not Found INFO: 172.19.0.1:51536 - "GET /config.json HTTP/1.0" 404 Not Found INFO: 172.19.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59476 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:33:05,908 - lava_callback - INFO - Received callback for node 69a95bd07ee78ae610cac831 INFO: 172.19.0.1:52746 - "POST /node/69a95bd07ee78ae610cac831 HTTP/1.0" 202 Accepted 2026-03-07 10:33:05,914 - lava_callback - INFO - Starting async job submit for node 69a95bd07ee78ae610cac831 2026-03-07 10:33:05,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:05,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95bd07ee78ae610cac831 HTTP/1.1" 200 None 2026-03-07 10:33:05,930 - lava_callback - DEBUG - Processing node 69a95bd07ee78ae610cac831: baseline-arm-baylibre 2026-03-07 10:33:05,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a95bd07ee78ae610cac831 2026-03-07 10:33:05,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:05,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95bd07ee78ae610cac831 HTTP/1.1" 200 None 2026-03-07 10:33:05,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:05,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:33:05,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:05,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a95bd07ee78ae610cac831 HTTP/1.1" 200 None 2026-03-07 10:33:05,982 - lava_callback - ERROR - Error processing callback for node 69a95bd07ee78ae610cac831: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49338 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:33:45,931 - lava_callback - INFO - Received callback for node 69a95bfd7ee78ae610cac84d INFO: 172.19.0.1:59954 - "POST /node/69a95bfd7ee78ae610cac84d HTTP/1.0" 202 Accepted 2026-03-07 10:33:45,937 - lava_callback - INFO - Starting async job submit for node 69a95bfd7ee78ae610cac84d 2026-03-07 10:33:45,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:45,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95bfd7ee78ae610cac84d HTTP/1.1" 200 None 2026-03-07 10:33:45,952 - lava_callback - DEBUG - Processing node 69a95bfd7ee78ae610cac84d: baseline-arm-baylibre 2026-03-07 10:33:45,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a95bfd7ee78ae610cac84d 2026-03-07 10:33:45,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:45,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95bfd7ee78ae610cac84d HTTP/1.1" 200 None 2026-03-07 10:33:45,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:45,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:33:45,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:33:46,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a95bfd7ee78ae610cac84d HTTP/1.1" 200 None 2026-03-07 10:33:46,013 - lava_callback - ERROR - Error processing callback for node 69a95bfd7ee78ae610cac84d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45574 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:36:06,197 - lava_callback - INFO - Received callback for node 69a95c817ee78ae610cac8f1 INFO: 172.19.0.1:35814 - "POST /node/69a95c817ee78ae610cac8f1 HTTP/1.0" 202 Accepted 2026-03-07 10:36:06,203 - lava_callback - INFO - Starting async job submit for node 69a95c817ee78ae610cac8f1 2026-03-07 10:36:06,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:36:06,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95c817ee78ae610cac8f1 HTTP/1.1" 200 None 2026-03-07 10:36:06,220 - lava_callback - DEBUG - Processing node 69a95c817ee78ae610cac8f1: baseline-arm-baylibre 2026-03-07 10:36:06,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a95c817ee78ae610cac8f1 2026-03-07 10:36:06,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:36:06,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95c817ee78ae610cac8f1 HTTP/1.1" 200 None 2026-03-07 10:36:06,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:36:06,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:36:06,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:36:06,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a95c817ee78ae610cac8f1 HTTP/1.1" 200 None 2026-03-07 10:36:06,314 - lava_callback - ERROR - Error processing callback for node 69a95c817ee78ae610cac8f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47250 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:37:01,025 - lava_callback - INFO - Received callback for node 69abfbc140deb775998f4bcb INFO: 172.19.0.1:50742 - "POST /node/69abfbc140deb775998f4bcb HTTP/1.0" 202 Accepted 2026-03-07 10:37:01,033 - lava_callback - INFO - Starting async job submit for node 69abfbc140deb775998f4bcb 2026-03-07 10:37:01,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:37:01,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfbc140deb775998f4bcb HTTP/1.1" 200 None 2026-03-07 10:37:01,109 - lava_callback - DEBUG - Processing node 69abfbc140deb775998f4bcb: ltp-smoke 2026-03-07 10:37:01,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:37:01,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:37:01,768 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69abfbc140deb775998f4bcb/log.txt.gz 2026-03-07 10:37:02,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:37:02,303 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:37:02,306 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69abfbc140deb775998f4bcb/lava-logs.yaml 2026-03-07 10:37:02,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:37:02,499 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:37:02,501 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69abfbc140deb775998f4bcb/lava_callback.json.gz 2026-03-07 10:37:02,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:37:02,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfbc140deb775998f4bcb HTTP/1.1" 200 None 2026-03-07 10:37:02,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:37:02,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2b40deb775998f3bab HTTP/1.1" 200 None 2026-03-07 10:37:02,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:37:02,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abfbc140deb775998f4bcb HTTP/1.1" 200 None 2026-03-07 10:37:02,828 - lava_callback - INFO - Completed processing callback for node 69abfbc140deb775998f4bcb INFO: 172.19.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38096 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:37:31,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:37:31,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39374 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:38:06,157 - lava_callback - INFO - Received callback for node 69a95d077ee78ae610cac986 INFO: 172.19.0.1:39474 - "POST /node/69a95d077ee78ae610cac986 HTTP/1.0" 202 Accepted 2026-03-07 10:38:06,162 - lava_callback - INFO - Starting async job submit for node 69a95d077ee78ae610cac986 2026-03-07 10:38:06,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:06,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95d077ee78ae610cac986 HTTP/1.1" 200 None 2026-03-07 10:38:06,178 - lava_callback - DEBUG - Processing node 69a95d077ee78ae610cac986: baseline-arm-baylibre 2026-03-07 10:38:06,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a95d077ee78ae610cac986 2026-03-07 10:38:06,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:06,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a95d077ee78ae610cac986 HTTP/1.1" 200 None 2026-03-07 10:38:06,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:06,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152c92b7cf147caaefeb1 HTTP/1.1" 200 None 2026-03-07 10:38:06,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:06,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a95d077ee78ae610cac986 HTTP/1.1" 200 None 2026-03-07 10:38:06,240 - lava_callback - ERROR - Error processing callback for node 69a95d077ee78ae610cac986: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34838 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:38:55,701 - lava_callback - INFO - Received callback for node 69abfc0d40deb775998f4bea INFO: 172.19.0.1:60916 - "POST /node/69abfc0d40deb775998f4bea HTTP/1.0" 202 Accepted 2026-03-07 10:38:55,708 - lava_callback - INFO - Starting async job submit for node 69abfc0d40deb775998f4bea 2026-03-07 10:38:55,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:55,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfc0d40deb775998f4bea HTTP/1.1" 200 None 2026-03-07 10:38:55,778 - lava_callback - DEBUG - Processing node 69abfc0d40deb775998f4bea: baseline-arm 2026-03-07 10:38:56,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:60918 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:38:56,551 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:38:56,552 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69abfc0d40deb775998f4bea/log.txt.gz 2026-03-07 10:38:56,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:38:57,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:38:57,146 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69abfc0d40deb775998f4bea/lava-logs.yaml 2026-03-07 10:38:57,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:38:57,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:38:57,360 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69abfc0d40deb775998f4bea/lava_callback.json.gz DEBUG: Setup failed for 69abfc0d40deb775998f4bea. Transitting job node result: incomplete -> fail 2026-03-07 10:38:57,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:57,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfc0d40deb775998f4bea HTTP/1.1" 200 None 2026-03-07 10:38:57,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:57,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 10:38:57,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:38:57,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abfc0d40deb775998f4bea HTTP/1.1" 200 None 2026-03-07 10:38:57,628 - lava_callback - INFO - Completed processing callback for node 69abfc0d40deb775998f4bea 2026-03-07 10:39:01,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:39:01,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:40632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45430 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:45:35,816 - lava_callback - INFO - Received callback for node 69abfd4040deb775998f4c3b INFO: 172.19.0.1:60248 - "POST /node/69abfd4040deb775998f4c3b HTTP/1.0" 202 Accepted 2026-03-07 10:45:35,865 - lava_callback - INFO - Starting async job submit for node 69abfd4040deb775998f4c3b 2026-03-07 10:45:35,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:45:35,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfd4040deb775998f4c3b HTTP/1.1" 200 None 2026-03-07 10:45:35,904 - lava_callback - DEBUG - Processing node 69abfd4040deb775998f4c3b: baseline-arm-pengutronix 2026-03-07 10:45:36,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:45:36,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:45:36,190 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abfd4040deb775998f4c3b/log.txt.gz 2026-03-07 10:45:36,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.19.0.1:60258 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:45:36,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:45:36,558 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abfd4040deb775998f4c3b/lava-logs.yaml 2026-03-07 10:45:36,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:45:36,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:45:36,706 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69abfd4040deb775998f4c3b/lava_callback.json.gz DEBUG: Setup failed for 69abfd4040deb775998f4c3b. Transitting job node result: incomplete -> fail 2026-03-07 10:45:36,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:45:36,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfd4040deb775998f4c3b HTTP/1.1" 200 None 2026-03-07 10:45:36,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:45:36,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf2740deb775998f3ba4 HTTP/1.1" 200 None 2026-03-07 10:45:36,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:45:36,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abfd4040deb775998f4c3b HTTP/1.1" 200 None 2026-03-07 10:45:36,865 - lava_callback - INFO - Completed processing callback for node 69abfd4040deb775998f4c3b INFO: 172.19.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56068 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:46:01,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:46:01,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42454 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33986 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:47:20,861 - lava_callback - INFO - Received callback for node 69abfd8040deb775998f4c58 INFO: 172.19.0.1:36696 - "POST /node/69abfd8040deb775998f4c58 HTTP/1.0" 202 Accepted 2026-03-07 10:47:20,869 - lava_callback - INFO - Starting async job submit for node 69abfd8040deb775998f4c58 2026-03-07 10:47:20,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:47:20,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfd8040deb775998f4c58 HTTP/1.1" 200 None 2026-03-07 10:47:20,927 - lava_callback - DEBUG - Processing node 69abfd8040deb775998f4c58: baseline-nfs-arm64 2026-03-07 10:47:21,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:47:22,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:47:22,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abfd8040deb775998f4c58/log.txt.gz 2026-03-07 10:47:22,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:47:23,016 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:47:23,019 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abfd8040deb775998f4c58/lava-logs.yaml 2026-03-07 10:47:23,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 10:47:23,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 10:47:23,241 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69abfd8040deb775998f4c58/lava_callback.json.gz DEBUG: Setup failed for 69abfd8040deb775998f4c58. Transitting job node result: incomplete -> fail 2026-03-07 10:47:23,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:47:23,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abfd8040deb775998f4c58 HTTP/1.1" 200 None 2026-03-07 10:47:23,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:47:23,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 10:47:23,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:47:23,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abfd8040deb775998f4c58 HTTP/1.1" 200 None 2026-03-07 10:47:23,496 - lava_callback - INFO - Completed processing callback for node 69abfd8040deb775998f4c58 INFO: 172.19.0.1:36700 - "GET / HTTP/1.0" 200 OK 2026-03-07 10:47:31,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 10:47:31,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48922 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:48924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56602 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:14:48,215 - lava_callback - INFO - Received callback for node 69a965a27ee78ae610cad0ef INFO: 172.19.0.1:56618 - "POST /node/69a965a27ee78ae610cad0ef HTTP/1.0" 202 Accepted 2026-03-07 11:14:48,220 - lava_callback - INFO - Starting async job submit for node 69a965a27ee78ae610cad0ef 2026-03-07 11:14:48,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:14:48,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a965a27ee78ae610cad0ef HTTP/1.1" 200 None 2026-03-07 11:14:48,238 - lava_callback - DEBUG - Processing node 69a965a27ee78ae610cad0ef: baseline-arm-baylibre 2026-03-07 11:14:48,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a965a27ee78ae610cad0ef 2026-03-07 11:14:48,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:14:48,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a965a27ee78ae610cad0ef HTTP/1.1" 200 None 2026-03-07 11:14:48,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:14:48,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:14:48,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:14:48,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a965a27ee78ae610cad0ef HTTP/1.1" 200 None 2026-03-07 11:14:48,291 - lava_callback - ERROR - Error processing callback for node 69a965a27ee78ae610cad0ef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:32784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50174 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:17:08,277 - lava_callback - INFO - Received callback for node 69a966237ee78ae610cad15c INFO: 172.19.0.1:50188 - "POST /node/69a966237ee78ae610cad15c HTTP/1.0" 202 Accepted 2026-03-07 11:17:08,283 - lava_callback - INFO - Starting async job submit for node 69a966237ee78ae610cad15c 2026-03-07 11:17:08,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:08,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a966237ee78ae610cad15c HTTP/1.1" 200 None 2026-03-07 11:17:08,302 - lava_callback - DEBUG - Processing node 69a966237ee78ae610cad15c: baseline-arm-baylibre 2026-03-07 11:17:08,302 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a966237ee78ae610cad15c 2026-03-07 11:17:08,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:08,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a966237ee78ae610cad15c HTTP/1.1" 200 None 2026-03-07 11:17:08,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:08,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:17:08,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:08,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a966237ee78ae610cad15c HTTP/1.1" 200 None 2026-03-07 11:17:08,367 - lava_callback - ERROR - Error processing callback for node 69a966237ee78ae610cad15c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50816 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:17:48,300 - lava_callback - INFO - Received callback for node 69a966507ee78ae610cad174 INFO: 172.19.0.1:50824 - "POST /node/69a966507ee78ae610cad174 HTTP/1.0" 202 Accepted 2026-03-07 11:17:48,306 - lava_callback - INFO - Starting async job submit for node 69a966507ee78ae610cad174 2026-03-07 11:17:48,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:48,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a966507ee78ae610cad174 HTTP/1.1" 200 None 2026-03-07 11:17:48,352 - lava_callback - DEBUG - Processing node 69a966507ee78ae610cad174: baseline-arm-baylibre 2026-03-07 11:17:48,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a966507ee78ae610cad174 2026-03-07 11:17:48,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:48,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a966507ee78ae610cad174 HTTP/1.1" 200 None 2026-03-07 11:17:48,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:48,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:17:48,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:17:48,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a966507ee78ae610cad174 HTTP/1.1" 200 None 2026-03-07 11:17:48,412 - lava_callback - ERROR - Error processing callback for node 69a966507ee78ae610cad174: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58264 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:18:28,339 - lava_callback - INFO - Received callback for node 69a9667d7ee78ae610cad1c7 INFO: 172.19.0.1:58272 - "POST /node/69a9667d7ee78ae610cad1c7 HTTP/1.0" 202 Accepted 2026-03-07 11:18:28,345 - lava_callback - INFO - Starting async job submit for node 69a9667d7ee78ae610cad1c7 2026-03-07 11:18:28,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:18:28,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9667d7ee78ae610cad1c7 HTTP/1.1" 200 None 2026-03-07 11:18:28,361 - lava_callback - DEBUG - Processing node 69a9667d7ee78ae610cad1c7: baseline-arm-baylibre 2026-03-07 11:18:28,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9667d7ee78ae610cad1c7 2026-03-07 11:18:28,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:18:28,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9667d7ee78ae610cad1c7 HTTP/1.1" 200 None 2026-03-07 11:18:28,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:18:28,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:18:28,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:18:28,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9667d7ee78ae610cad1c7 HTTP/1.1" 200 None 2026-03-07 11:18:28,419 - lava_callback - ERROR - Error processing callback for node 69a9667d7ee78ae610cad1c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60012 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:20:48,517 - lava_callback - INFO - Received callback for node 69a967007ee78ae610cad23e INFO: 172.19.0.1:60018 - "POST /node/69a967007ee78ae610cad23e HTTP/1.0" 202 Accepted 2026-03-07 11:20:48,522 - lava_callback - INFO - Starting async job submit for node 69a967007ee78ae610cad23e 2026-03-07 11:20:48,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:20:48,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a967007ee78ae610cad23e HTTP/1.1" 200 None 2026-03-07 11:20:48,540 - lava_callback - DEBUG - Processing node 69a967007ee78ae610cad23e: baseline-arm-baylibre 2026-03-07 11:20:48,540 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a967007ee78ae610cad23e 2026-03-07 11:20:48,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:20:48,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a967007ee78ae610cad23e HTTP/1.1" 200 None 2026-03-07 11:20:48,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:20:48,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:20:48,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:20:48,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a967007ee78ae610cad23e HTTP/1.1" 200 None 2026-03-07 11:20:48,592 - lava_callback - ERROR - Error processing callback for node 69a967007ee78ae610cad23e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51896 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:21:28,506 - lava_callback - INFO - Received callback for node 69a9672d7ee78ae610cad285 INFO: 172.19.0.1:51898 - "POST /node/69a9672d7ee78ae610cad285 HTTP/1.0" 202 Accepted 2026-03-07 11:21:28,512 - lava_callback - INFO - Starting async job submit for node 69a9672d7ee78ae610cad285 2026-03-07 11:21:28,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:21:28,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9672d7ee78ae610cad285 HTTP/1.1" 200 None 2026-03-07 11:21:28,529 - lava_callback - DEBUG - Processing node 69a9672d7ee78ae610cad285: baseline-arm-baylibre 2026-03-07 11:21:28,529 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9672d7ee78ae610cad285 2026-03-07 11:21:28,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:21:28,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9672d7ee78ae610cad285 HTTP/1.1" 200 None 2026-03-07 11:21:28,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:21:28,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b4ca41e9451dcf40fe3 HTTP/1.1" 200 None 2026-03-07 11:21:28,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:21:28,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9672d7ee78ae610cad285 HTTP/1.1" 200 None 2026-03-07 11:21:28,584 - lava_callback - ERROR - Error processing callback for node 69a9672d7ee78ae610cad285: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40184 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:23:48,696 - lava_callback - INFO - Received callback for node 69a967ba7ee78ae610cad308 INFO: 172.19.0.1:40198 - "POST /node/69a967ba7ee78ae610cad308 HTTP/1.0" 202 Accepted 2026-03-07 11:23:48,702 - lava_callback - INFO - Starting async job submit for node 69a967ba7ee78ae610cad308 2026-03-07 11:23:48,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:23:48,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a967ba7ee78ae610cad308 HTTP/1.1" 200 None 2026-03-07 11:23:48,728 - lava_callback - DEBUG - Processing node 69a967ba7ee78ae610cad308: baseline-arm64-baylibre 2026-03-07 11:23:48,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a967ba7ee78ae610cad308 2026-03-07 11:23:48,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:23:48,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a967ba7ee78ae610cad308 HTTP/1.1" 200 None 2026-03-07 11:23:48,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:23:48,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a85aff440c1da21c2371fe HTTP/1.1" 200 None 2026-03-07 11:23:48,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:23:48,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a967ba7ee78ae610cad308 HTTP/1.1" 200 None 2026-03-07 11:23:48,782 - lava_callback - ERROR - Error processing callback for node 69a967ba7ee78ae610cad308: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37738 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:30:29,003 - lava_callback - INFO - Received callback for node 69a9694a7ee78ae610cad428 INFO: 172.19.0.1:37742 - "POST /node/69a9694a7ee78ae610cad428 HTTP/1.0" 202 Accepted 2026-03-07 11:30:29,009 - lava_callback - INFO - Starting async job submit for node 69a9694a7ee78ae610cad428 2026-03-07 11:30:29,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:30:29,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9694a7ee78ae610cad428 HTTP/1.1" 200 None 2026-03-07 11:30:29,057 - lava_callback - DEBUG - Processing node 69a9694a7ee78ae610cad428: baseline-arm64-baylibre 2026-03-07 11:30:29,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9694a7ee78ae610cad428 2026-03-07 11:30:29,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:30:29,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9694a7ee78ae610cad428 HTTP/1.1" 200 None 2026-03-07 11:30:29,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:30:29,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:30:29,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:30:29,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9694a7ee78ae610cad428 HTTP/1.1" 200 None 2026-03-07 11:30:29,123 - lava_callback - ERROR - Error processing callback for node 69a9694a7ee78ae610cad428: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43574 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49602 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51036 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:39:29,476 - lava_callback - INFO - Received callback for node 69a96b637ee78ae610cad5a9 INFO: 172.19.0.1:51044 - "POST /node/69a96b637ee78ae610cad5a9 HTTP/1.0" 202 Accepted 2026-03-07 11:39:29,482 - lava_callback - INFO - Starting async job submit for node 69a96b637ee78ae610cad5a9 2026-03-07 11:39:29,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:39:29,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96b637ee78ae610cad5a9 HTTP/1.1" 200 None 2026-03-07 11:39:29,516 - lava_callback - DEBUG - Processing node 69a96b637ee78ae610cad5a9: baseline-arm64-baylibre 2026-03-07 11:39:29,516 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a96b637ee78ae610cad5a9 2026-03-07 11:39:29,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:39:29,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96b637ee78ae610cad5a9 HTTP/1.1" 200 None 2026-03-07 11:39:29,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:39:29,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:39:29,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:39:29,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a96b637ee78ae610cad5a9 HTTP/1.1" 200 None 2026-03-07 11:39:29,573 - lava_callback - ERROR - Error processing callback for node 69a96b637ee78ae610cad5a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44134 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46638 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:45:09,884 - lava_callback - INFO - Received callback for node 69a96cbc7ee78ae610cad6b2 INFO: 172.19.0.1:39646 - "POST /node/69a96cbc7ee78ae610cad6b2 HTTP/1.0" 202 Accepted 2026-03-07 11:45:09,889 - lava_callback - INFO - Starting async job submit for node 69a96cbc7ee78ae610cad6b2 2026-03-07 11:45:09,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:45:09,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96cbc7ee78ae610cad6b2 HTTP/1.1" 200 None 2026-03-07 11:45:09,905 - lava_callback - DEBUG - Processing node 69a96cbc7ee78ae610cad6b2: baseline-arm64-baylibre 2026-03-07 11:45:09,906 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a96cbc7ee78ae610cad6b2 2026-03-07 11:45:09,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:45:09,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96cbc7ee78ae610cad6b2 HTTP/1.1" 200 None 2026-03-07 11:45:09,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:45:09,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:45:09,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:45:09,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a96cbc7ee78ae610cad6b2 HTTP/1.1" 200 None 2026-03-07 11:45:09,966 - lava_callback - ERROR - Error processing callback for node 69a96cbc7ee78ae610cad6b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40588 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:46:29,843 - lava_callback - INFO - Received callback for node 69a96d137ee78ae610cad6e6 INFO: 172.19.0.1:41660 - "POST /node/69a96d137ee78ae610cad6e6 HTTP/1.0" 202 Accepted 2026-03-07 11:46:29,853 - lava_callback - INFO - Starting async job submit for node 69a96d137ee78ae610cad6e6 2026-03-07 11:46:29,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:46:29,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96d137ee78ae610cad6e6 HTTP/1.1" 200 None 2026-03-07 11:46:29,879 - lava_callback - DEBUG - Processing node 69a96d137ee78ae610cad6e6: baseline-arm64-baylibre 2026-03-07 11:46:29,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a96d137ee78ae610cad6e6 2026-03-07 11:46:29,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:46:29,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96d137ee78ae610cad6e6 HTTP/1.1" 200 None 2026-03-07 11:46:29,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:46:29,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:46:29,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:46:29,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a96d137ee78ae610cad6e6 HTTP/1.1" 200 None 2026-03-07 11:46:29,974 - lava_callback - ERROR - Error processing callback for node 69a96d137ee78ae610cad6e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58394 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:50:50,121 - lava_callback - INFO - Received callback for node 69a96e107ee78ae610cad799 INFO: 172.19.0.1:57464 - "POST /node/69a96e107ee78ae610cad799 HTTP/1.0" 202 Accepted 2026-03-07 11:50:50,126 - lava_callback - INFO - Starting async job submit for node 69a96e107ee78ae610cad799 2026-03-07 11:50:50,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:50:50,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96e107ee78ae610cad799 HTTP/1.1" 200 None 2026-03-07 11:50:50,144 - lava_callback - DEBUG - Processing node 69a96e107ee78ae610cad799: baseline-arm64-baylibre 2026-03-07 11:50:50,144 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a96e107ee78ae610cad799 2026-03-07 11:50:50,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:50:50,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96e107ee78ae610cad799 HTTP/1.1" 200 None 2026-03-07 11:50:50,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:50:50,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:50:50,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:50:50,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a96e107ee78ae610cad799 HTTP/1.1" 200 None 2026-03-07 11:50:50,229 - lava_callback - ERROR - Error processing callback for node 69a96e107ee78ae610cad799: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57358 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44820 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47776 - "GET / HTTP/1.0" 200 OK 2026-03-07 11:57:50,467 - lava_callback - INFO - Received callback for node 69a96fb87ee78ae610cad8dc INFO: 172.19.0.1:43764 - "POST /node/69a96fb87ee78ae610cad8dc HTTP/1.0" 202 Accepted 2026-03-07 11:57:50,473 - lava_callback - INFO - Starting async job submit for node 69a96fb87ee78ae610cad8dc 2026-03-07 11:57:50,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:57:50,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96fb87ee78ae610cad8dc HTTP/1.1" 200 None 2026-03-07 11:57:50,489 - lava_callback - DEBUG - Processing node 69a96fb87ee78ae610cad8dc: baseline-arm64-baylibre 2026-03-07 11:57:50,489 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a96fb87ee78ae610cad8dc 2026-03-07 11:57:50,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:57:50,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a96fb87ee78ae610cad8dc HTTP/1.1" 200 None 2026-03-07 11:57:50,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:57:50,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a152d52b7cf147caaefec5 HTTP/1.1" 200 None 2026-03-07 11:57:50,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 11:57:50,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a96fb87ee78ae610cad8dc HTTP/1.1" 200 None 2026-03-07 11:57:50,546 - lava_callback - ERROR - Error processing callback for node 69a96fb87ee78ae610cad8dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52370 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:00:30,631 - lava_callback - INFO - Received callback for node 69a970497ee78ae610cad925 INFO: 172.19.0.1:40526 - "POST /node/69a970497ee78ae610cad925 HTTP/1.0" 202 Accepted 2026-03-07 12:00:30,637 - lava_callback - INFO - Starting async job submit for node 69a970497ee78ae610cad925 2026-03-07 12:00:30,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:00:30,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a970497ee78ae610cad925 HTTP/1.1" 200 None 2026-03-07 12:00:30,656 - lava_callback - DEBUG - Processing node 69a970497ee78ae610cad925: baseline-arm64-baylibre 2026-03-07 12:00:30,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a970497ee78ae610cad925 2026-03-07 12:00:30,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:00:30,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a970497ee78ae610cad925 HTTP/1.1" 200 None 2026-03-07 12:00:30,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:00:30,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:00:30,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:00:30,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a970497ee78ae610cad925 HTTP/1.1" 200 None 2026-03-07 12:00:30,744 - lava_callback - ERROR - Error processing callback for node 69a970497ee78ae610cad925: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:40538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56862 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:01:50,748 - lava_callback - INFO - Received callback for node 69a9709f7ee78ae610cad970 INFO: 172.19.0.1:54508 - "POST /node/69a9709f7ee78ae610cad970 HTTP/1.0" 202 Accepted 2026-03-07 12:01:50,754 - lava_callback - INFO - Starting async job submit for node 69a9709f7ee78ae610cad970 2026-03-07 12:01:50,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:01:50,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9709f7ee78ae610cad970 HTTP/1.1" 200 None 2026-03-07 12:01:50,775 - lava_callback - DEBUG - Processing node 69a9709f7ee78ae610cad970: baseline-arm64-baylibre 2026-03-07 12:01:50,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9709f7ee78ae610cad970 2026-03-07 12:01:50,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:01:50,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9709f7ee78ae610cad970 HTTP/1.1" 200 None 2026-03-07 12:01:50,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:01:50,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:01:50,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:01:50,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9709f7ee78ae610cad970 HTTP/1.1" 200 None 2026-03-07 12:01:50,854 - lava_callback - ERROR - Error processing callback for node 69a9709f7ee78ae610cad970: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50016 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:03:10,688 - lava_callback - INFO - Received callback for node 69a970f67ee78ae610cad9ae INFO: 172.19.0.1:49282 - "POST /node/69a970f67ee78ae610cad9ae HTTP/1.0" 202 Accepted 2026-03-07 12:03:10,693 - lava_callback - INFO - Starting async job submit for node 69a970f67ee78ae610cad9ae 2026-03-07 12:03:10,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:03:10,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a970f67ee78ae610cad9ae HTTP/1.1" 200 None 2026-03-07 12:03:10,709 - lava_callback - DEBUG - Processing node 69a970f67ee78ae610cad9ae: baseline-arm64-baylibre 2026-03-07 12:03:10,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a970f67ee78ae610cad9ae 2026-03-07 12:03:10,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:03:10,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a970f67ee78ae610cad9ae HTTP/1.1" 200 None 2026-03-07 12:03:10,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:03:10,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:03:10,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:03:10,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a970f67ee78ae610cad9ae HTTP/1.1" 200 None 2026-03-07 12:03:10,768 - lava_callback - ERROR - Error processing callback for node 69a970f67ee78ae610cad9ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37676 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:04:50,775 - lava_callback - INFO - Received callback for node 69a971547ee78ae610cad9f4 INFO: 172.19.0.1:52486 - "POST /node/69a971547ee78ae610cad9f4 HTTP/1.0" 202 Accepted 2026-03-07 12:04:50,781 - lava_callback - INFO - Starting async job submit for node 69a971547ee78ae610cad9f4 2026-03-07 12:04:50,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:04:50,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a971547ee78ae610cad9f4 HTTP/1.1" 200 None 2026-03-07 12:04:50,807 - lava_callback - DEBUG - Processing node 69a971547ee78ae610cad9f4: baseline-arm64-baylibre 2026-03-07 12:04:50,807 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a971547ee78ae610cad9f4 2026-03-07 12:04:50,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:04:50,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a971547ee78ae610cad9f4 HTTP/1.1" 200 None 2026-03-07 12:04:50,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:04:50,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:04:50,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:04:50,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a971547ee78ae610cad9f4 HTTP/1.1" 200 None 2026-03-07 12:04:50,901 - lava_callback - ERROR - Error processing callback for node 69a971547ee78ae610cad9f4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40588 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:06:10,847 - lava_callback - INFO - Received callback for node 69a971ab7ee78ae610cada2a INFO: 172.19.0.1:58074 - "POST /node/69a971ab7ee78ae610cada2a HTTP/1.0" 202 Accepted 2026-03-07 12:06:10,853 - lava_callback - INFO - Starting async job submit for node 69a971ab7ee78ae610cada2a 2026-03-07 12:06:10,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:06:10,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a971ab7ee78ae610cada2a HTTP/1.1" 200 None 2026-03-07 12:06:10,873 - lava_callback - DEBUG - Processing node 69a971ab7ee78ae610cada2a: baseline-arm64-baylibre 2026-03-07 12:06:10,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a971ab7ee78ae610cada2a 2026-03-07 12:06:10,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:06:10,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a971ab7ee78ae610cada2a HTTP/1.1" 200 None 2026-03-07 12:06:10,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:06:10,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:06:10,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:06:10,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a971ab7ee78ae610cada2a HTTP/1.1" 200 None 2026-03-07 12:06:10,940 - lava_callback - ERROR - Error processing callback for node 69a971ab7ee78ae610cada2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60772 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59056 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:07:50,994 - lava_callback - INFO - Received callback for node 69a972017ee78ae610cada6d INFO: 172.19.0.1:59604 - "POST /node/69a972017ee78ae610cada6d HTTP/1.0" 202 Accepted 2026-03-07 12:07:50,999 - lava_callback - INFO - Starting async job submit for node 69a972017ee78ae610cada6d 2026-03-07 12:07:51,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:07:51,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a972017ee78ae610cada6d HTTP/1.1" 200 None 2026-03-07 12:07:51,017 - lava_callback - DEBUG - Processing node 69a972017ee78ae610cada6d: baseline-arm64-baylibre 2026-03-07 12:07:51,018 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a972017ee78ae610cada6d 2026-03-07 12:07:51,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:07:51,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a972017ee78ae610cada6d HTTP/1.1" 200 None 2026-03-07 12:07:51,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:07:51,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a15b5ba41e9451dcf41003 HTTP/1.1" 200 None 2026-03-07 12:07:51,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:07:51,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a972017ee78ae610cada6d HTTP/1.1" 200 None 2026-03-07 12:07:51,102 - lava_callback - ERROR - Error processing callback for node 69a972017ee78ae610cada6d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60486 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48224 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42314 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48224 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38510 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53310 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37664 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45886 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53654 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45860 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49636 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52502 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:42:33,148 - lava_callback - INFO - Received callback for node 69a97a357ee78ae610cadc29 INFO: 172.19.0.1:54368 - "POST /node/69a97a357ee78ae610cadc29 HTTP/1.0" 202 Accepted 2026-03-07 12:42:33,158 - lava_callback - INFO - Starting async job submit for node 69a97a357ee78ae610cadc29 2026-03-07 12:42:33,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:42:33,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a357ee78ae610cadc29 HTTP/1.1" 200 None 2026-03-07 12:42:33,183 - lava_callback - DEBUG - Processing node 69a97a357ee78ae610cadc29: baseline-arm-baylibre 2026-03-07 12:42:33,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97a357ee78ae610cadc29 2026-03-07 12:42:33,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:42:33,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a357ee78ae610cadc29 HTTP/1.1" 200 None 2026-03-07 12:42:33,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:42:33,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:42:33,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:42:33,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97a357ee78ae610cadc29 HTTP/1.1" 200 None 2026-03-07 12:42:33,286 - lava_callback - ERROR - Error processing callback for node 69a97a357ee78ae610cadc29: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35274 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:43:32,839 - lava_callback - INFO - Received callback for node 69a97a607ee78ae610cadc36 INFO: 172.19.0.1:56906 - "POST /node/69a97a607ee78ae610cadc36 HTTP/1.0" 202 Accepted 2026-03-07 12:43:32,844 - lava_callback - INFO - Starting async job submit for node 69a97a607ee78ae610cadc36 2026-03-07 12:43:32,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:43:32,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a607ee78ae610cadc36 HTTP/1.1" 200 None 2026-03-07 12:43:32,861 - lava_callback - DEBUG - Processing node 69a97a607ee78ae610cadc36: baseline-arm-baylibre 2026-03-07 12:43:32,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97a607ee78ae610cadc36 2026-03-07 12:43:32,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:43:32,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a607ee78ae610cadc36 HTTP/1.1" 200 None 2026-03-07 12:43:32,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:43:32,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:43:32,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:43:32,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97a607ee78ae610cadc36 HTTP/1.1" 200 None 2026-03-07 12:43:32,918 - lava_callback - ERROR - Error processing callback for node 69a97a607ee78ae610cadc36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48124 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:44:12,965 - lava_callback - INFO - Received callback for node 69a97a8a7ee78ae610cadc81 INFO: 172.19.0.1:35992 - "POST /node/69a97a8a7ee78ae610cadc81 HTTP/1.0" 202 Accepted 2026-03-07 12:44:12,970 - lava_callback - INFO - Starting async job submit for node 69a97a8a7ee78ae610cadc81 2026-03-07 12:44:12,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:44:12,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a8a7ee78ae610cadc81 HTTP/1.1" 200 None 2026-03-07 12:44:12,986 - lava_callback - DEBUG - Processing node 69a97a8a7ee78ae610cadc81: baseline-arm-baylibre 2026-03-07 12:44:12,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97a8a7ee78ae610cadc81 2026-03-07 12:44:12,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:44:13,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97a8a7ee78ae610cadc81 HTTP/1.1" 200 None 2026-03-07 12:44:13,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:44:13,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:44:13,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:44:13,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97a8a7ee78ae610cadc81 HTTP/1.1" 200 None 2026-03-07 12:44:13,041 - lava_callback - ERROR - Error processing callback for node 69a97a8a7ee78ae610cadc81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46748 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:45:33,044 - lava_callback - INFO - Received callback for node 69a97aeb7ee78ae610cadcc9 INFO: 172.19.0.1:50364 - "POST /node/69a97aeb7ee78ae610cadcc9 HTTP/1.0" 202 Accepted 2026-03-07 12:45:33,050 - lava_callback - INFO - Starting async job submit for node 69a97aeb7ee78ae610cadcc9 2026-03-07 12:45:33,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:45:33,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97aeb7ee78ae610cadcc9 HTTP/1.1" 200 None 2026-03-07 12:45:33,066 - lava_callback - DEBUG - Processing node 69a97aeb7ee78ae610cadcc9: baseline-arm-baylibre 2026-03-07 12:45:33,066 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97aeb7ee78ae610cadcc9 2026-03-07 12:45:33,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:45:33,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97aeb7ee78ae610cadcc9 HTTP/1.1" 200 None 2026-03-07 12:45:33,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:45:33,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:45:33,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:45:33,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97aeb7ee78ae610cadcc9 HTTP/1.1" 200 None 2026-03-07 12:45:33,123 - lava_callback - ERROR - Error processing callback for node 69a97aeb7ee78ae610cadcc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53756 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:46:53,085 - lava_callback - INFO - Received callback for node 69a97b287ee78ae610cadcfe INFO: 172.19.0.1:47664 - "POST /node/69a97b287ee78ae610cadcfe HTTP/1.0" 202 Accepted 2026-03-07 12:46:53,090 - lava_callback - INFO - Starting async job submit for node 69a97b287ee78ae610cadcfe 2026-03-07 12:46:53,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:46:53,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b287ee78ae610cadcfe HTTP/1.1" 200 None 2026-03-07 12:46:53,106 - lava_callback - DEBUG - Processing node 69a97b287ee78ae610cadcfe: baseline-arm-baylibre 2026-03-07 12:46:53,106 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97b287ee78ae610cadcfe 2026-03-07 12:46:53,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:46:53,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b287ee78ae610cadcfe HTTP/1.1" 200 None 2026-03-07 12:46:53,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:46:53,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:46:53,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:46:53,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97b287ee78ae610cadcfe HTTP/1.1" 200 None 2026-03-07 12:46:53,167 - lava_callback - ERROR - Error processing callback for node 69a97b287ee78ae610cadcfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37818 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44346 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:47:53,189 - lava_callback - INFO - Received callback for node 69a97b657ee78ae610cadd36 INFO: 172.19.0.1:34980 - "POST /node/69a97b657ee78ae610cadd36 HTTP/1.0" 202 Accepted 2026-03-07 12:47:53,194 - lava_callback - INFO - Starting async job submit for node 69a97b657ee78ae610cadd36 2026-03-07 12:47:53,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:47:53,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b657ee78ae610cadd36 HTTP/1.1" 200 None 2026-03-07 12:47:53,233 - lava_callback - DEBUG - Processing node 69a97b657ee78ae610cadd36: baseline-arm-baylibre 2026-03-07 12:47:53,233 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97b657ee78ae610cadd36 2026-03-07 12:47:53,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:47:53,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b657ee78ae610cadd36 HTTP/1.1" 200 None 2026-03-07 12:47:53,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:47:53,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:47:53,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:47:53,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97b657ee78ae610cadd36 HTTP/1.1" 200 None 2026-03-07 12:47:53,295 - lava_callback - ERROR - Error processing callback for node 69a97b657ee78ae610cadd36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36142 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:48:33,240 - lava_callback - INFO - Received callback for node 69a97b8d7ee78ae610cadd6c INFO: 172.19.0.1:36880 - "POST /node/69a97b8d7ee78ae610cadd6c HTTP/1.0" 202 Accepted 2026-03-07 12:48:33,246 - lava_callback - INFO - Starting async job submit for node 69a97b8d7ee78ae610cadd6c 2026-03-07 12:48:33,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:48:33,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b8d7ee78ae610cadd6c HTTP/1.1" 200 None 2026-03-07 12:48:33,262 - lava_callback - DEBUG - Processing node 69a97b8d7ee78ae610cadd6c: baseline-arm-baylibre 2026-03-07 12:48:33,263 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97b8d7ee78ae610cadd6c 2026-03-07 12:48:33,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:48:33,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97b8d7ee78ae610cadd6c HTTP/1.1" 200 None 2026-03-07 12:48:33,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:48:33,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:48:33,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:48:33,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97b8d7ee78ae610cadd6c HTTP/1.1" 200 None 2026-03-07 12:48:33,337 - lava_callback - ERROR - Error processing callback for node 69a97b8d7ee78ae610cadd6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59390 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:49:13,179 - lava_callback - INFO - Received callback for node 69a97bbb7ee78ae610cadd94 INFO: 172.19.0.1:34194 - "POST /node/69a97bbb7ee78ae610cadd94 HTTP/1.0" 202 Accepted 2026-03-07 12:49:13,185 - lava_callback - INFO - Starting async job submit for node 69a97bbb7ee78ae610cadd94 2026-03-07 12:49:13,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:49:13,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97bbb7ee78ae610cadd94 HTTP/1.1" 200 None 2026-03-07 12:49:13,202 - lava_callback - DEBUG - Processing node 69a97bbb7ee78ae610cadd94: baseline-arm-baylibre 2026-03-07 12:49:13,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97bbb7ee78ae610cadd94 2026-03-07 12:49:13,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:49:13,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97bbb7ee78ae610cadd94 HTTP/1.1" 200 None 2026-03-07 12:49:13,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:49:13,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:49:13,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:49:13,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97bbb7ee78ae610cadd94 HTTP/1.1" 200 None 2026-03-07 12:49:13,261 - lava_callback - ERROR - Error processing callback for node 69a97bbb7ee78ae610cadd94: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37354 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:50:13,307 - lava_callback - INFO - Received callback for node 69a97bf87ee78ae610cadddf INFO: 172.19.0.1:46158 - "POST /node/69a97bf87ee78ae610cadddf HTTP/1.0" 202 Accepted 2026-03-07 12:50:13,312 - lava_callback - INFO - Starting async job submit for node 69a97bf87ee78ae610cadddf 2026-03-07 12:50:13,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:13,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97bf87ee78ae610cadddf HTTP/1.1" 200 None 2026-03-07 12:50:13,328 - lava_callback - DEBUG - Processing node 69a97bf87ee78ae610cadddf: baseline-arm-baylibre 2026-03-07 12:50:13,329 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97bf87ee78ae610cadddf 2026-03-07 12:50:13,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:13,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97bf87ee78ae610cadddf HTTP/1.1" 200 None 2026-03-07 12:50:13,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:13,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:50:13,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:13,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97bf87ee78ae610cadddf HTTP/1.1" 200 None 2026-03-07 12:50:13,380 - lava_callback - ERROR - Error processing callback for node 69a97bf87ee78ae610cadddf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46162 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56770 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:50:53,276 - lava_callback - INFO - Received callback for node 69a97c227ee78ae610cade00 INFO: 172.19.0.1:39652 - "POST /node/69a97c227ee78ae610cade00 HTTP/1.0" 202 Accepted 2026-03-07 12:50:53,281 - lava_callback - INFO - Starting async job submit for node 69a97c227ee78ae610cade00 2026-03-07 12:50:53,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:53,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97c227ee78ae610cade00 HTTP/1.1" 200 None 2026-03-07 12:50:53,297 - lava_callback - DEBUG - Processing node 69a97c227ee78ae610cade00: baseline-arm-baylibre 2026-03-07 12:50:53,297 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97c227ee78ae610cade00 2026-03-07 12:50:53,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:53,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97c227ee78ae610cade00 HTTP/1.1" 200 None 2026-03-07 12:50:53,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:53,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:50:53,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:50:53,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97c227ee78ae610cade00 HTTP/1.1" 200 None 2026-03-07 12:50:53,374 - lava_callback - ERROR - Error processing callback for node 69a97c227ee78ae610cade00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48406 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:53:13,456 - lava_callback - INFO - Received callback for node 69a97cae7ee78ae610cade6a INFO: 172.19.0.1:56132 - "POST /node/69a97cae7ee78ae610cade6a HTTP/1.0" 202 Accepted 2026-03-07 12:53:13,462 - lava_callback - INFO - Starting async job submit for node 69a97cae7ee78ae610cade6a 2026-03-07 12:53:13,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:53:13,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97cae7ee78ae610cade6a HTTP/1.1" 200 None 2026-03-07 12:53:13,478 - lava_callback - DEBUG - Processing node 69a97cae7ee78ae610cade6a: baseline-arm-baylibre 2026-03-07 12:53:13,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97cae7ee78ae610cade6a 2026-03-07 12:53:13,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:53:13,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97cae7ee78ae610cade6a HTTP/1.1" 200 None 2026-03-07 12:53:13,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:53:13,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:53:13,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:53:13,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97cae7ee78ae610cade6a HTTP/1.1" 200 None 2026-03-07 12:53:13,531 - lava_callback - ERROR - Error processing callback for node 69a97cae7ee78ae610cade6a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41076 - "GET / HTTP/1.0" 200 OK 2026-03-07 12:55:13,574 - lava_callback - INFO - Received callback for node 69a97d1e7ee78ae610cadecb INFO: 172.19.0.1:52694 - "POST /node/69a97d1e7ee78ae610cadecb HTTP/1.0" 202 Accepted 2026-03-07 12:55:13,580 - lava_callback - INFO - Starting async job submit for node 69a97d1e7ee78ae610cadecb 2026-03-07 12:55:13,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:55:13,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97d1e7ee78ae610cadecb HTTP/1.1" 200 None 2026-03-07 12:55:13,597 - lava_callback - DEBUG - Processing node 69a97d1e7ee78ae610cadecb: baseline-arm-baylibre 2026-03-07 12:55:13,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a97d1e7ee78ae610cadecb 2026-03-07 12:55:13,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:55:13,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a97d1e7ee78ae610cadecb HTTP/1.1" 200 None 2026-03-07 12:55:13,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:55:13,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628927da105ad09835991 HTTP/1.1" 200 None 2026-03-07 12:55:13,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 12:55:13,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a97d1e7ee78ae610cadecb HTTP/1.1" 200 None 2026-03-07 12:55:13,677 - lava_callback - ERROR - Error processing callback for node 69a97d1e7ee78ae610cadecb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33810 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42742 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53686 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41848 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:08:14,324 - lava_callback - INFO - Received callback for node 69a9803c7ee78ae610cae03e INFO: 172.19.0.1:43472 - "POST /node/69a9803c7ee78ae610cae03e HTTP/1.0" 202 Accepted 2026-03-07 13:08:14,330 - lava_callback - INFO - Starting async job submit for node 69a9803c7ee78ae610cae03e 2026-03-07 13:08:14,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:08:14,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9803c7ee78ae610cae03e HTTP/1.1" 200 None 2026-03-07 13:08:14,346 - lava_callback - DEBUG - Processing node 69a9803c7ee78ae610cae03e: baseline-arm64-baylibre 2026-03-07 13:08:14,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9803c7ee78ae610cae03e 2026-03-07 13:08:14,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:08:14,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9803c7ee78ae610cae03e HTTP/1.1" 200 None 2026-03-07 13:08:14,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:08:14,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-07 13:08:14,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:08:14,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9803c7ee78ae610cae03e HTTP/1.1" 200 None 2026-03-07 13:08:14,409 - lava_callback - ERROR - Error processing callback for node 69a9803c7ee78ae610cae03e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46914 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:09:54,348 - lava_callback - INFO - Received callback for node 69a9808d7ee78ae610cae079 INFO: 172.19.0.1:39986 - "POST /node/69a9808d7ee78ae610cae079 HTTP/1.0" 202 Accepted 2026-03-07 13:09:54,354 - lava_callback - INFO - Starting async job submit for node 69a9808d7ee78ae610cae079 2026-03-07 13:09:54,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:09:54,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9808d7ee78ae610cae079 HTTP/1.1" 200 None 2026-03-07 13:09:54,370 - lava_callback - DEBUG - Processing node 69a9808d7ee78ae610cae079: baseline-arm64-baylibre 2026-03-07 13:09:54,370 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9808d7ee78ae610cae079 2026-03-07 13:09:54,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:09:54,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9808d7ee78ae610cae079 HTTP/1.1" 200 None 2026-03-07 13:09:54,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:09:54,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:09:54,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:09:54,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9808d7ee78ae610cae079 HTTP/1.1" 200 None 2026-03-07 13:09:54,428 - lava_callback - ERROR - Error processing callback for node 69a9808d7ee78ae610cae079: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50876 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39476 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48618 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:11:14,428 - lava_callback - INFO - Received callback for node 69a980e37ee78ae610cae0ae INFO: 172.19.0.1:60166 - "POST /node/69a980e37ee78ae610cae0ae HTTP/1.0" 202 Accepted 2026-03-07 13:11:14,434 - lava_callback - INFO - Starting async job submit for node 69a980e37ee78ae610cae0ae 2026-03-07 13:11:14,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:11:14,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a980e37ee78ae610cae0ae HTTP/1.1" 200 None 2026-03-07 13:11:14,450 - lava_callback - DEBUG - Processing node 69a980e37ee78ae610cae0ae: baseline-arm64-baylibre 2026-03-07 13:11:14,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a980e37ee78ae610cae0ae 2026-03-07 13:11:14,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:11:14,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a980e37ee78ae610cae0ae HTTP/1.1" 200 None 2026-03-07 13:11:14,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:11:14,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:11:14,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:11:14,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a980e37ee78ae610cae0ae HTTP/1.1" 200 None 2026-03-07 13:11:14,521 - lava_callback - ERROR - Error processing callback for node 69a980e37ee78ae610cae0ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34872 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:12:34,661 - lava_callback - INFO - Received callback for node 69a981397ee78ae610cae0e1 INFO: 172.19.0.1:37668 - "POST /node/69a981397ee78ae610cae0e1 HTTP/1.0" 202 Accepted 2026-03-07 13:12:34,666 - lava_callback - INFO - Starting async job submit for node 69a981397ee78ae610cae0e1 2026-03-07 13:12:34,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:12:34,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a981397ee78ae610cae0e1 HTTP/1.1" 200 None 2026-03-07 13:12:34,683 - lava_callback - DEBUG - Processing node 69a981397ee78ae610cae0e1: baseline-arm64-baylibre 2026-03-07 13:12:34,683 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a981397ee78ae610cae0e1 2026-03-07 13:12:34,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:12:34,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a981397ee78ae610cae0e1 HTTP/1.1" 200 None 2026-03-07 13:12:34,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:12:34,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:12:34,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:12:34,795 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a981397ee78ae610cae0e1 HTTP/1.1" 200 None 2026-03-07 13:12:34,796 - lava_callback - ERROR - Error processing callback for node 69a981397ee78ae610cae0e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49786 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:13:54,634 - lava_callback - INFO - Received callback for node 69a9818f7ee78ae610cae114 INFO: 172.19.0.1:51292 - "POST /node/69a9818f7ee78ae610cae114 HTTP/1.0" 202 Accepted 2026-03-07 13:13:54,640 - lava_callback - INFO - Starting async job submit for node 69a9818f7ee78ae610cae114 2026-03-07 13:13:54,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:13:54,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9818f7ee78ae610cae114 HTTP/1.1" 200 None 2026-03-07 13:13:54,655 - lava_callback - DEBUG - Processing node 69a9818f7ee78ae610cae114: baseline-arm64-baylibre 2026-03-07 13:13:54,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9818f7ee78ae610cae114 2026-03-07 13:13:54,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:13:54,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9818f7ee78ae610cae114 HTTP/1.1" 200 None 2026-03-07 13:13:54,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:13:54,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:13:54,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:13:54,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9818f7ee78ae610cae114 HTTP/1.1" 200 None 2026-03-07 13:13:54,725 - lava_callback - ERROR - Error processing callback for node 69a9818f7ee78ae610cae114: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40932 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37056 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:15:34,676 - lava_callback - INFO - Received callback for node 69a981e57ee78ae610cae14c INFO: 172.19.0.1:56544 - "POST /node/69a981e57ee78ae610cae14c HTTP/1.0" 202 Accepted 2026-03-07 13:15:34,682 - lava_callback - INFO - Starting async job submit for node 69a981e57ee78ae610cae14c 2026-03-07 13:15:34,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:15:34,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a981e57ee78ae610cae14c HTTP/1.1" 200 None 2026-03-07 13:15:34,699 - lava_callback - DEBUG - Processing node 69a981e57ee78ae610cae14c: baseline-arm64-baylibre 2026-03-07 13:15:34,699 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a981e57ee78ae610cae14c 2026-03-07 13:15:34,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:15:34,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a981e57ee78ae610cae14c HTTP/1.1" 200 None 2026-03-07 13:15:34,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:15:34,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:15:34,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:15:34,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a981e57ee78ae610cae14c HTTP/1.1" 200 None 2026-03-07 13:15:34,778 - lava_callback - ERROR - Error processing callback for node 69a981e57ee78ae610cae14c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43284 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:16:54,756 - lava_callback - INFO - Received callback for node 69a9823b7ee78ae610cae180 INFO: 172.19.0.1:59722 - "POST /node/69a9823b7ee78ae610cae180 HTTP/1.0" 202 Accepted 2026-03-07 13:16:54,762 - lava_callback - INFO - Starting async job submit for node 69a9823b7ee78ae610cae180 2026-03-07 13:16:54,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:16:54,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9823b7ee78ae610cae180 HTTP/1.1" 200 None 2026-03-07 13:16:54,787 - lava_callback - DEBUG - Processing node 69a9823b7ee78ae610cae180: baseline-arm64-baylibre 2026-03-07 13:16:54,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9823b7ee78ae610cae180 2026-03-07 13:16:54,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:16:54,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9823b7ee78ae610cae180 HTTP/1.1" 200 None 2026-03-07 13:16:54,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:16:54,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d3423d518458fb340278 HTTP/1.1" 200 None 2026-03-07 13:16:54,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:16:54,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9823b7ee78ae610cae180 HTTP/1.1" 200 None 2026-03-07 13:16:54,848 - lava_callback - ERROR - Error processing callback for node 69a9823b7ee78ae610cae180: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60182 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:18:24,635 - lava_callback - INFO - Received callback for node 69a982977ee78ae610cae1b4 INFO: 172.19.0.1:44182 - "POST /node/69a982977ee78ae610cae1b4 HTTP/1.0" 202 Accepted 2026-03-07 13:18:24,640 - lava_callback - INFO - Starting async job submit for node 69a982977ee78ae610cae1b4 2026-03-07 13:18:24,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:18:24,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a982977ee78ae610cae1b4 HTTP/1.1" 200 None 2026-03-07 13:18:24,656 - lava_callback - DEBUG - Processing node 69a982977ee78ae610cae1b4: baseline-arm64-clabbe 2026-03-07 13:18:24,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a982977ee78ae610cae1b4 2026-03-07 13:18:24,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:18:24,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a982977ee78ae610cae1b4 HTTP/1.1" 200 None 2026-03-07 13:18:24,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:18:24,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbcf911a9cbe7f77ccbd HTTP/1.1" 200 None 2026-03-07 13:18:24,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:18:24,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a982977ee78ae610cae1b4 HTTP/1.1" 200 None 2026-03-07 13:18:24,708 - lava_callback - ERROR - Error processing callback for node 69a982977ee78ae610cae1b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56232 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50384 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51906 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41712 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48124 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:22:24,761 - lava_callback - INFO - Received callback for node 69a9838b7ee78ae610cae2cf INFO: 172.19.0.1:55110 - "POST /node/69a9838b7ee78ae610cae2cf HTTP/1.0" 202 Accepted 2026-03-07 13:22:24,767 - lava_callback - INFO - Starting async job submit for node 69a9838b7ee78ae610cae2cf 2026-03-07 13:22:24,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:22:24,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9838b7ee78ae610cae2cf HTTP/1.1" 200 None 2026-03-07 13:22:24,783 - lava_callback - DEBUG - Processing node 69a9838b7ee78ae610cae2cf: baseline-arm-clabbe 2026-03-07 13:22:24,783 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9838b7ee78ae610cae2cf 2026-03-07 13:22:24,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:22:24,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9838b7ee78ae610cae2cf HTTP/1.1" 200 None 2026-03-07 13:22:24,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:22:24,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-07 13:22:24,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:22:24,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9838b7ee78ae610cae2cf HTTP/1.1" 200 None 2026-03-07 13:22:24,839 - lava_callback - ERROR - Error processing callback for node 69a9838b7ee78ae610cae2cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55114 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34200 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34228 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:23:24,842 - lava_callback - INFO - Received callback for node 69a983b97ee78ae610cae2f2 INFO: 172.19.0.1:42958 - "POST /node/69a983b97ee78ae610cae2f2 HTTP/1.0" 202 Accepted 2026-03-07 13:23:24,848 - lava_callback - INFO - Starting async job submit for node 69a983b97ee78ae610cae2f2 2026-03-07 13:23:24,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:23:24,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a983b97ee78ae610cae2f2 HTTP/1.1" 200 None 2026-03-07 13:23:24,863 - lava_callback - DEBUG - Processing node 69a983b97ee78ae610cae2f2: baseline-arm-clabbe 2026-03-07 13:23:24,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a983b97ee78ae610cae2f2 2026-03-07 13:23:24,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:23:24,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a983b97ee78ae610cae2f2 HTTP/1.1" 200 None 2026-03-07 13:23:24,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:23:24,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a8cbbb911a9cbe7f77ccab HTTP/1.1" 200 None 2026-03-07 13:23:24,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:23:24,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a983b97ee78ae610cae2f2 HTTP/1.1" 200 None 2026-03-07 13:23:24,926 - lava_callback - ERROR - Error processing callback for node 69a983b97ee78ae610cae2f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58326 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:24:15,222 - lava_callback - INFO - Received callback for node 69a983ec7ee78ae610cae347 INFO: 172.19.0.1:58340 - "POST /node/69a983ec7ee78ae610cae347 HTTP/1.0" 202 Accepted 2026-03-07 13:24:15,228 - lava_callback - INFO - Starting async job submit for node 69a983ec7ee78ae610cae347 2026-03-07 13:24:15,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:24:15,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a983ec7ee78ae610cae347 HTTP/1.1" 200 None 2026-03-07 13:24:15,261 - lava_callback - DEBUG - Processing node 69a983ec7ee78ae610cae347: baseline-arm64-baylibre 2026-03-07 13:24:15,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a983ec7ee78ae610cae347 2026-03-07 13:24:15,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:24:15,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a983ec7ee78ae610cae347 HTTP/1.1" 200 None 2026-03-07 13:24:15,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:24:15,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:24:15,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:24:15,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a983ec7ee78ae610cae347 HTTP/1.1" 200 None 2026-03-07 13:24:15,320 - lava_callback - ERROR - Error processing callback for node 69a983ec7ee78ae610cae347: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51812 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:25:35,264 - lava_callback - INFO - Received callback for node 69a984427ee78ae610cae37c INFO: 172.19.0.1:36672 - "POST /node/69a984427ee78ae610cae37c HTTP/1.0" 202 Accepted 2026-03-07 13:25:35,270 - lava_callback - INFO - Starting async job submit for node 69a984427ee78ae610cae37c 2026-03-07 13:25:35,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:25:35,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a984427ee78ae610cae37c HTTP/1.1" 200 None 2026-03-07 13:25:35,286 - lava_callback - DEBUG - Processing node 69a984427ee78ae610cae37c: baseline-arm64-baylibre 2026-03-07 13:25:35,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a984427ee78ae610cae37c 2026-03-07 13:25:35,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:25:35,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a984427ee78ae610cae37c HTTP/1.1" 200 None 2026-03-07 13:25:35,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:25:35,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:25:35,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:25:35,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a984427ee78ae610cae37c HTTP/1.1" 200 None 2026-03-07 13:25:35,346 - lava_callback - ERROR - Error processing callback for node 69a984427ee78ae610cae37c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36676 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58734 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:28:55,474 - lava_callback - INFO - Received callback for node 69a985027ee78ae610cae3b9 INFO: 172.19.0.1:54854 - "POST /node/69a985027ee78ae610cae3b9 HTTP/1.0" 202 Accepted 2026-03-07 13:28:55,479 - lava_callback - INFO - Starting async job submit for node 69a985027ee78ae610cae3b9 2026-03-07 13:28:55,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:28:55,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a985027ee78ae610cae3b9 HTTP/1.1" 200 None 2026-03-07 13:28:55,496 - lava_callback - DEBUG - Processing node 69a985027ee78ae610cae3b9: baseline-arm64-baylibre 2026-03-07 13:28:55,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a985027ee78ae610cae3b9 2026-03-07 13:28:55,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:28:55,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a985027ee78ae610cae3b9 HTTP/1.1" 200 None 2026-03-07 13:28:55,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:28:55,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:28:55,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:28:55,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a985027ee78ae610cae3b9 HTTP/1.1" 200 None 2026-03-07 13:28:55,569 - lava_callback - ERROR - Error processing callback for node 69a985027ee78ae610cae3b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46440 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:30:35,545 - lava_callback - INFO - Received callback for node 69a985687ee78ae610cae400 INFO: 172.19.0.1:56062 - "POST /node/69a985687ee78ae610cae400 HTTP/1.0" 202 Accepted 2026-03-07 13:30:35,551 - lava_callback - INFO - Starting async job submit for node 69a985687ee78ae610cae400 2026-03-07 13:30:35,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:30:35,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a985687ee78ae610cae400 HTTP/1.1" 200 None 2026-03-07 13:30:35,574 - lava_callback - DEBUG - Processing node 69a985687ee78ae610cae400: baseline-arm64-baylibre 2026-03-07 13:30:35,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a985687ee78ae610cae400 2026-03-07 13:30:35,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:30:35,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a985687ee78ae610cae400 HTTP/1.1" 200 None 2026-03-07 13:30:35,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:30:35,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:30:35,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:30:35,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a985687ee78ae610cae400 HTTP/1.1" 200 None 2026-03-07 13:30:35,633 - lava_callback - ERROR - Error processing callback for node 69a985687ee78ae610cae400: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52934 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45740 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:33:35,647 - lava_callback - INFO - Received callback for node 69a986227ee78ae610cae445 INFO: 172.19.0.1:44096 - "POST /node/69a986227ee78ae610cae445 HTTP/1.0" 202 Accepted 2026-03-07 13:33:35,653 - lava_callback - INFO - Starting async job submit for node 69a986227ee78ae610cae445 2026-03-07 13:33:35,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:33:35,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986227ee78ae610cae445 HTTP/1.1" 200 None 2026-03-07 13:33:35,672 - lava_callback - DEBUG - Processing node 69a986227ee78ae610cae445: baseline-arm-baylibre 2026-03-07 13:33:35,672 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a986227ee78ae610cae445 2026-03-07 13:33:35,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:33:35,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986227ee78ae610cae445 HTTP/1.1" 200 None 2026-03-07 13:33:35,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:33:35,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:33:35,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:33:35,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a986227ee78ae610cae445 HTTP/1.1" 200 None 2026-03-07 13:33:35,725 - lava_callback - ERROR - Error processing callback for node 69a986227ee78ae610cae445: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47636 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:34:15,690 - lava_callback - INFO - Received callback for node 69a986507ee78ae610cae46d INFO: 172.19.0.1:47640 - "POST /node/69a986507ee78ae610cae46d HTTP/1.0" 202 Accepted 2026-03-07 13:34:15,699 - lava_callback - INFO - Starting async job submit for node 69a986507ee78ae610cae46d 2026-03-07 13:34:15,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:15,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986507ee78ae610cae46d HTTP/1.1" 200 None 2026-03-07 13:34:15,714 - lava_callback - DEBUG - Processing node 69a986507ee78ae610cae46d: baseline-arm-baylibre 2026-03-07 13:34:15,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a986507ee78ae610cae46d 2026-03-07 13:34:15,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:15,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986507ee78ae610cae46d HTTP/1.1" 200 None 2026-03-07 13:34:15,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:15,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:34:15,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:15,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a986507ee78ae610cae46d HTTP/1.1" 200 None 2026-03-07 13:34:15,767 - lava_callback - ERROR - Error processing callback for node 69a986507ee78ae610cae46d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47650 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52260 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:34:55,768 - lava_callback - INFO - Received callback for node 69a9867d7ee78ae610cae4bc INFO: 172.19.0.1:52268 - "POST /node/69a9867d7ee78ae610cae4bc HTTP/1.0" 202 Accepted 2026-03-07 13:34:55,774 - lava_callback - INFO - Starting async job submit for node 69a9867d7ee78ae610cae4bc 2026-03-07 13:34:55,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:55,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9867d7ee78ae610cae4bc HTTP/1.1" 200 None 2026-03-07 13:34:55,791 - lava_callback - DEBUG - Processing node 69a9867d7ee78ae610cae4bc: baseline-arm-baylibre 2026-03-07 13:34:55,791 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9867d7ee78ae610cae4bc 2026-03-07 13:34:55,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:55,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9867d7ee78ae610cae4bc HTTP/1.1" 200 None 2026-03-07 13:34:55,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:55,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:34:55,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:34:55,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9867d7ee78ae610cae4bc HTTP/1.1" 200 None 2026-03-07 13:34:55,856 - lava_callback - ERROR - Error processing callback for node 69a9867d7ee78ae610cae4bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59504 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:35:55,927 - lava_callback - INFO - Received callback for node 69a986b87ee78ae610cae503 INFO: 172.19.0.1:56514 - "POST /node/69a986b87ee78ae610cae503 HTTP/1.0" 202 Accepted 2026-03-07 13:35:55,933 - lava_callback - INFO - Starting async job submit for node 69a986b87ee78ae610cae503 2026-03-07 13:35:55,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:35:55,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986b87ee78ae610cae503 HTTP/1.1" 200 None 2026-03-07 13:35:55,951 - lava_callback - DEBUG - Processing node 69a986b87ee78ae610cae503: baseline-arm64-baylibre 2026-03-07 13:35:55,951 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a986b87ee78ae610cae503 2026-03-07 13:35:55,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:35:55,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a986b87ee78ae610cae503 HTTP/1.1" 200 None 2026-03-07 13:35:55,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:35:55,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:35:55,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:35:56,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a986b87ee78ae610cae503 HTTP/1.1" 200 None 2026-03-07 13:35:56,007 - lava_callback - ERROR - Error processing callback for node 69a986b87ee78ae610cae503: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59252 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38124 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38136 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:37:15,992 - lava_callback - INFO - Received callback for node 69a987047ee78ae610cae53d INFO: 172.19.0.1:38152 - "POST /node/69a987047ee78ae610cae53d HTTP/1.0" 202 Accepted 2026-03-07 13:37:16,002 - lava_callback - INFO - Starting async job submit for node 69a987047ee78ae610cae53d 2026-03-07 13:37:16,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:16,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987047ee78ae610cae53d HTTP/1.1" 200 None 2026-03-07 13:37:16,027 - lava_callback - DEBUG - Processing node 69a987047ee78ae610cae53d: baseline-arm-baylibre 2026-03-07 13:37:16,027 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a987047ee78ae610cae53d 2026-03-07 13:37:16,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:16,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987047ee78ae610cae53d HTTP/1.1" 200 None 2026-03-07 13:37:16,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:16,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:37:16,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:16,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a987047ee78ae610cae53d HTTP/1.1" 200 None 2026-03-07 13:37:16,136 - lava_callback - ERROR - Error processing callback for node 69a987047ee78ae610cae53d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42550 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:37:55,871 - lava_callback - INFO - Received callback for node 69a987317ee78ae610cae57b INFO: 172.19.0.1:38340 - "POST /node/69a987317ee78ae610cae57b HTTP/1.0" 202 Accepted 2026-03-07 13:37:55,877 - lava_callback - INFO - Starting async job submit for node 69a987317ee78ae610cae57b 2026-03-07 13:37:55,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:55,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987317ee78ae610cae57b HTTP/1.1" 200 None 2026-03-07 13:37:55,893 - lava_callback - DEBUG - Processing node 69a987317ee78ae610cae57b: baseline-arm-baylibre 2026-03-07 13:37:55,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a987317ee78ae610cae57b 2026-03-07 13:37:55,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:55,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987317ee78ae610cae57b HTTP/1.1" 200 None 2026-03-07 13:37:55,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:55,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:37:55,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:37:55,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a987317ee78ae610cae57b HTTP/1.1" 200 None 2026-03-07 13:37:55,984 - lava_callback - ERROR - Error processing callback for node 69a987317ee78ae610cae57b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:38346 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57216 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:38:55,951 - lava_callback - INFO - Received callback for node 69a9875e7ee78ae610cae5a0 INFO: 172.19.0.1:53060 - "POST /node/69a9875e7ee78ae610cae5a0 HTTP/1.0" 202 Accepted 2026-03-07 13:38:55,957 - lava_callback - INFO - Starting async job submit for node 69a9875e7ee78ae610cae5a0 2026-03-07 13:38:55,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:38:55,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9875e7ee78ae610cae5a0 HTTP/1.1" 200 None 2026-03-07 13:38:55,974 - lava_callback - DEBUG - Processing node 69a9875e7ee78ae610cae5a0: baseline-arm-baylibre 2026-03-07 13:38:55,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9875e7ee78ae610cae5a0 2026-03-07 13:38:55,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:38:55,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9875e7ee78ae610cae5a0 HTTP/1.1" 200 None 2026-03-07 13:38:55,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:38:56,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6d31c3d518458fb340253 HTTP/1.1" 200 None 2026-03-07 13:38:56,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:38:56,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9875e7ee78ae610cae5a0 HTTP/1.1" 200 None 2026-03-07 13:38:56,029 - lava_callback - ERROR - Error processing callback for node 69a9875e7ee78ae610cae5a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45296 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:39:35,971 - lava_callback - INFO - Received callback for node 69a987937ee78ae610cae5f9 INFO: 172.19.0.1:39074 - "POST /node/69a987937ee78ae610cae5f9 HTTP/1.0" 202 Accepted 2026-03-07 13:39:35,978 - lava_callback - INFO - Starting async job submit for node 69a987937ee78ae610cae5f9 2026-03-07 13:39:35,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:39:36,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987937ee78ae610cae5f9 HTTP/1.1" 200 None 2026-03-07 13:39:36,035 - lava_callback - DEBUG - Processing node 69a987937ee78ae610cae5f9: baseline-arm64-baylibre 2026-03-07 13:39:36,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a987937ee78ae610cae5f9 2026-03-07 13:39:36,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:39:36,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987937ee78ae610cae5f9 HTTP/1.1" 200 None 2026-03-07 13:39:36,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:39:36,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:39:36,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:39:36,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a987937ee78ae610cae5f9 HTTP/1.1" 200 None 2026-03-07 13:39:36,110 - lava_callback - ERROR - Error processing callback for node 69a987937ee78ae610cae5f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58194 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49204 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:41:16,114 - lava_callback - INFO - Received callback for node 69a987eb7ee78ae610cae636 INFO: 172.19.0.1:49206 - "POST /node/69a987eb7ee78ae610cae636 HTTP/1.0" 202 Accepted 2026-03-07 13:41:16,119 - lava_callback - INFO - Starting async job submit for node 69a987eb7ee78ae610cae636 2026-03-07 13:41:16,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:41:16,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987eb7ee78ae610cae636 HTTP/1.1" 200 None 2026-03-07 13:41:16,136 - lava_callback - DEBUG - Processing node 69a987eb7ee78ae610cae636: baseline-arm64-baylibre 2026-03-07 13:41:16,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a987eb7ee78ae610cae636 2026-03-07 13:41:16,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:41:16,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a987eb7ee78ae610cae636 HTTP/1.1" 200 None 2026-03-07 13:41:16,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:41:16,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:41:16,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:41:16,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a987eb7ee78ae610cae636 HTTP/1.1" 200 None 2026-03-07 13:41:16,194 - lava_callback - ERROR - Error processing callback for node 69a987eb7ee78ae610cae636: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42646 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50280 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:42:36,220 - lava_callback - INFO - Received callback for node 69a9883d7ee78ae610cae676 INFO: 172.19.0.1:37306 - "POST /node/69a9883d7ee78ae610cae676 HTTP/1.0" 202 Accepted 2026-03-07 13:42:36,225 - lava_callback - INFO - Starting async job submit for node 69a9883d7ee78ae610cae676 2026-03-07 13:42:36,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:42:36,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9883d7ee78ae610cae676 HTTP/1.1" 200 None 2026-03-07 13:42:36,242 - lava_callback - DEBUG - Processing node 69a9883d7ee78ae610cae676: baseline-arm64-baylibre 2026-03-07 13:42:36,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9883d7ee78ae610cae676 2026-03-07 13:42:36,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:42:36,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9883d7ee78ae610cae676 HTTP/1.1" 200 None 2026-03-07 13:42:36,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:42:36,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:42:36,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:42:36,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9883d7ee78ae610cae676 HTTP/1.1" 200 None 2026-03-07 13:42:36,294 - lava_callback - ERROR - Error processing callback for node 69a9883d7ee78ae610cae676: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54712 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:43:56,248 - lava_callback - INFO - Received callback for node 69a988937ee78ae610cae6c3 INFO: 172.19.0.1:42580 - "POST /node/69a988937ee78ae610cae6c3 HTTP/1.0" 202 Accepted 2026-03-07 13:43:56,258 - lava_callback - INFO - Starting async job submit for node 69a988937ee78ae610cae6c3 2026-03-07 13:43:56,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:43:56,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a988937ee78ae610cae6c3 HTTP/1.1" 200 None 2026-03-07 13:43:56,291 - lava_callback - DEBUG - Processing node 69a988937ee78ae610cae6c3: baseline-arm64-baylibre 2026-03-07 13:43:56,291 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a988937ee78ae610cae6c3 2026-03-07 13:43:56,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:43:56,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a988937ee78ae610cae6c3 HTTP/1.1" 200 None 2026-03-07 13:43:56,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:43:56,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:43:56,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:43:56,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a988937ee78ae610cae6c3 HTTP/1.1" 200 None 2026-03-07 13:43:56,359 - lava_callback - ERROR - Error processing callback for node 69a988937ee78ae610cae6c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54068 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:45:16,273 - lava_callback - INFO - Received callback for node 69a988ea7ee78ae610cae703 INFO: 172.19.0.1:54070 - "POST /node/69a988ea7ee78ae610cae703 HTTP/1.0" 202 Accepted 2026-03-07 13:45:16,278 - lava_callback - INFO - Starting async job submit for node 69a988ea7ee78ae610cae703 2026-03-07 13:45:16,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:45:16,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a988ea7ee78ae610cae703 HTTP/1.1" 200 None 2026-03-07 13:45:16,295 - lava_callback - DEBUG - Processing node 69a988ea7ee78ae610cae703: baseline-arm64-baylibre 2026-03-07 13:45:16,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a988ea7ee78ae610cae703 2026-03-07 13:45:16,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:45:16,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a988ea7ee78ae610cae703 HTTP/1.1" 200 None 2026-03-07 13:45:16,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:45:16,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:45:16,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:45:16,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a988ea7ee78ae610cae703 HTTP/1.1" 200 None 2026-03-07 13:45:16,350 - lava_callback - ERROR - Error processing callback for node 69a988ea7ee78ae610cae703: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:54072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50440 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38088 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:46:56,401 - lava_callback - INFO - Received callback for node 69a9893e7ee78ae610cae746 INFO: 172.19.0.1:47536 - "POST /node/69a9893e7ee78ae610cae746 HTTP/1.0" 202 Accepted 2026-03-07 13:46:56,406 - lava_callback - INFO - Starting async job submit for node 69a9893e7ee78ae610cae746 2026-03-07 13:46:56,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:46:56,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9893e7ee78ae610cae746 HTTP/1.1" 200 None 2026-03-07 13:46:56,446 - lava_callback - DEBUG - Processing node 69a9893e7ee78ae610cae746: baseline-arm64-baylibre 2026-03-07 13:46:56,446 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9893e7ee78ae610cae746 2026-03-07 13:46:56,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:46:56,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9893e7ee78ae610cae746 HTTP/1.1" 200 None 2026-03-07 13:46:56,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:46:56,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:46:56,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:46:56,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9893e7ee78ae610cae746 HTTP/1.1" 200 None 2026-03-07 13:46:56,527 - lava_callback - ERROR - Error processing callback for node 69a9893e7ee78ae610cae746: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36228 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54672 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-07 13:48:16,475 - lava_callback - INFO - Received callback for node 69a989937ee78ae610cae77d INFO: 172.19.0.1:54676 - "POST /node/69a989937ee78ae610cae77d HTTP/1.0" 202 Accepted 2026-03-07 13:48:16,480 - lava_callback - INFO - Starting async job submit for node 69a989937ee78ae610cae77d 2026-03-07 13:48:16,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.19.0.1:54690 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:48:16,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a989937ee78ae610cae77d HTTP/1.1" 200 None 2026-03-07 13:48:16,522 - lava_callback - DEBUG - Processing node 69a989937ee78ae610cae77d: baseline-arm64-baylibre 2026-03-07 13:48:16,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a989937ee78ae610cae77d 2026-03-07 13:48:16,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:48:16,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a989937ee78ae610cae77d HTTP/1.1" 200 None 2026-03-07 13:48:16,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:48:16,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:48:16,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:48:16,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a989937ee78ae610cae77d HTTP/1.1" 200 None 2026-03-07 13:48:16,601 - lava_callback - ERROR - Error processing callback for node 69a989937ee78ae610cae77d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58652 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39840 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57928 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47404 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33414 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:54:56,799 - lava_callback - INFO - Received callback for node 69a98b287ee78ae610cae830 INFO: 172.19.0.1:33418 - "POST /node/69a98b287ee78ae610cae830 HTTP/1.0" 202 Accepted 2026-03-07 13:54:56,804 - lava_callback - INFO - Starting async job submit for node 69a98b287ee78ae610cae830 2026-03-07 13:54:56,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:54:56,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a98b287ee78ae610cae830 HTTP/1.1" 200 None 2026-03-07 13:54:56,826 - lava_callback - DEBUG - Processing node 69a98b287ee78ae610cae830: baseline-arm64-baylibre 2026-03-07 13:54:56,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a98b287ee78ae610cae830 2026-03-07 13:54:56,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:54:56,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a98b287ee78ae610cae830 HTTP/1.1" 200 None 2026-03-07 13:54:56,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:54:56,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:54:56,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:54:56,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a98b287ee78ae610cae830 HTTP/1.1" 200 None 2026-03-07 13:54:56,905 - lava_callback - ERROR - Error processing callback for node 69a98b287ee78ae610cae830: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32934 - "GET / HTTP/1.0" 200 OK 2026-03-07 13:58:16,965 - lava_callback - INFO - Received callback for node 69a98bf57ee78ae610cae8ab INFO: 172.19.0.1:32946 - "POST /node/69a98bf57ee78ae610cae8ab HTTP/1.0" 202 Accepted 2026-03-07 13:58:16,971 - lava_callback - INFO - Starting async job submit for node 69a98bf57ee78ae610cae8ab 2026-03-07 13:58:16,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:58:16,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a98bf57ee78ae610cae8ab HTTP/1.1" 200 None 2026-03-07 13:58:16,990 - lava_callback - DEBUG - Processing node 69a98bf57ee78ae610cae8ab: baseline-arm64-baylibre 2026-03-07 13:58:16,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a98bf57ee78ae610cae8ab 2026-03-07 13:58:16,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:58:17,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a98bf57ee78ae610cae8ab HTTP/1.1" 200 None 2026-03-07 13:58:17,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:58:17,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a628a67da105ad098359a5 HTTP/1.1" 200 None 2026-03-07 13:58:17,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 13:58:17,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a98bf57ee78ae610cae8ab HTTP/1.1" 200 None 2026-03-07 13:58:17,044 - lava_callback - ERROR - Error processing callback for node 69a98bf57ee78ae610cae8ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57700 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42576 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54436 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55608 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41368 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33466 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47480 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46142 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56126 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40936 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55456 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49954 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44792 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54188 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59492 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46312 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42130 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37974 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59794 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39736 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33474 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47520 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54150 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59324 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50282 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56658 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57592 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55548 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42100 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45102 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44408 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:42:39,469 - lava_callback - INFO - Received callback for node 69a996557ee78ae610caeb35 INFO: 172.19.0.1:44412 - "POST /node/69a996557ee78ae610caeb35 HTTP/1.0" 202 Accepted 2026-03-07 14:42:39,474 - lava_callback - INFO - Starting async job submit for node 69a996557ee78ae610caeb35 2026-03-07 14:42:39,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:42:39,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996557ee78ae610caeb35 HTTP/1.1" 200 None 2026-03-07 14:42:39,512 - lava_callback - DEBUG - Processing node 69a996557ee78ae610caeb35: baseline-arm-baylibre 2026-03-07 14:42:39,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a996557ee78ae610caeb35 2026-03-07 14:42:39,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:42:39,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996557ee78ae610caeb35 HTTP/1.1" 200 None 2026-03-07 14:42:39,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:42:39,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:42:39,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:42:39,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a996557ee78ae610caeb35 HTTP/1.1" 200 None 2026-03-07 14:42:39,594 - lava_callback - ERROR - Error processing callback for node 69a996557ee78ae610caeb35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53650 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:43:19,401 - lava_callback - INFO - Received callback for node 69a996807ee78ae610caeb44 INFO: 172.19.0.1:53658 - "POST /node/69a996807ee78ae610caeb44 HTTP/1.0" 202 Accepted 2026-03-07 14:43:19,407 - lava_callback - INFO - Starting async job submit for node 69a996807ee78ae610caeb44 2026-03-07 14:43:19,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:19,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996807ee78ae610caeb44 HTTP/1.1" 200 None 2026-03-07 14:43:19,423 - lava_callback - DEBUG - Processing node 69a996807ee78ae610caeb44: baseline-arm-baylibre 2026-03-07 14:43:19,423 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a996807ee78ae610caeb44 2026-03-07 14:43:19,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:19,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996807ee78ae610caeb44 HTTP/1.1" 200 None 2026-03-07 14:43:19,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:19,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:43:19,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:19,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a996807ee78ae610caeb44 HTTP/1.1" 200 None 2026-03-07 14:43:19,495 - lava_callback - ERROR - Error processing callback for node 69a996807ee78ae610caeb44: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39348 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53636 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:43:59,517 - lava_callback - INFO - Received callback for node 69a996ad7ee78ae610caeb56 INFO: 172.19.0.1:53642 - "POST /node/69a996ad7ee78ae610caeb56 HTTP/1.0" 202 Accepted 2026-03-07 14:43:59,523 - lava_callback - INFO - Starting async job submit for node 69a996ad7ee78ae610caeb56 2026-03-07 14:43:59,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:59,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996ad7ee78ae610caeb56 HTTP/1.1" 200 None 2026-03-07 14:43:59,538 - lava_callback - DEBUG - Processing node 69a996ad7ee78ae610caeb56: baseline-arm-baylibre 2026-03-07 14:43:59,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a996ad7ee78ae610caeb56 2026-03-07 14:43:59,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:59,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996ad7ee78ae610caeb56 HTTP/1.1" 200 None 2026-03-07 14:43:59,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:59,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:43:59,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:43:59,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a996ad7ee78ae610caeb56 HTTP/1.1" 200 None 2026-03-07 14:43:59,594 - lava_callback - ERROR - Error processing callback for node 69a996ad7ee78ae610caeb56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52462 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60606 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:44:59,463 - lava_callback - INFO - Received callback for node 69a996da7ee78ae610caeb65 INFO: 172.19.0.1:60618 - "POST /node/69a996da7ee78ae610caeb65 HTTP/1.0" 202 Accepted 2026-03-07 14:44:59,468 - lava_callback - INFO - Starting async job submit for node 69a996da7ee78ae610caeb65 2026-03-07 14:44:59,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:44:59,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996da7ee78ae610caeb65 HTTP/1.1" 200 None 2026-03-07 14:44:59,493 - lava_callback - DEBUG - Processing node 69a996da7ee78ae610caeb65: baseline-arm-baylibre 2026-03-07 14:44:59,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a996da7ee78ae610caeb65 2026-03-07 14:44:59,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:44:59,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a996da7ee78ae610caeb65 HTTP/1.1" 200 None 2026-03-07 14:44:59,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:44:59,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:44:59,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:44:59,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a996da7ee78ae610caeb65 HTTP/1.1" 200 None 2026-03-07 14:44:59,547 - lava_callback - ERROR - Error processing callback for node 69a996da7ee78ae610caeb65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54204 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:45:39,565 - lava_callback - INFO - Received callback for node 69a997067ee78ae610caeb7b INFO: 172.19.0.1:54218 - "POST /node/69a997067ee78ae610caeb7b HTTP/1.0" 202 Accepted 2026-03-07 14:45:39,570 - lava_callback - INFO - Starting async job submit for node 69a997067ee78ae610caeb7b 2026-03-07 14:45:39,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:45:39,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997067ee78ae610caeb7b HTTP/1.1" 200 None 2026-03-07 14:45:39,596 - lava_callback - DEBUG - Processing node 69a997067ee78ae610caeb7b: baseline-arm-baylibre 2026-03-07 14:45:39,596 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a997067ee78ae610caeb7b 2026-03-07 14:45:39,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:45:39,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997067ee78ae610caeb7b HTTP/1.1" 200 None 2026-03-07 14:45:39,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:45:39,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:45:39,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:45:39,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a997067ee78ae610caeb7b HTTP/1.1" 200 None 2026-03-07 14:45:39,647 - lava_callback - ERROR - Error processing callback for node 69a997067ee78ae610caeb7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40390 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:46:19,540 - lava_callback - INFO - Received callback for node 69a997337ee78ae610caeb8e INFO: 172.19.0.1:40402 - "POST /node/69a997337ee78ae610caeb8e HTTP/1.0" 202 Accepted 2026-03-07 14:46:19,546 - lava_callback - INFO - Starting async job submit for node 69a997337ee78ae610caeb8e 2026-03-07 14:46:19,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:19,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997337ee78ae610caeb8e HTTP/1.1" 200 None 2026-03-07 14:46:19,562 - lava_callback - DEBUG - Processing node 69a997337ee78ae610caeb8e: baseline-arm-baylibre 2026-03-07 14:46:19,562 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a997337ee78ae610caeb8e 2026-03-07 14:46:19,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:19,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997337ee78ae610caeb8e HTTP/1.1" 200 None 2026-03-07 14:46:19,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:19,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6ed9c2da7ccec10683e47 HTTP/1.1" 200 None 2026-03-07 14:46:19,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:19,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a997337ee78ae610caeb8e HTTP/1.1" 200 None 2026-03-07 14:46:19,647 - lava_callback - ERROR - Error processing callback for node 69a997337ee78ae610caeb8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56400 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40792 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:46:59,704 - lava_callback - INFO - Received callback for node 69a9975b7ee78ae610caebb1 INFO: 172.19.0.1:58830 - "POST /node/69a9975b7ee78ae610caebb1 HTTP/1.0" 202 Accepted 2026-03-07 14:46:59,713 - lava_callback - INFO - Starting async job submit for node 69a9975b7ee78ae610caebb1 2026-03-07 14:46:59,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:59,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9975b7ee78ae610caebb1 HTTP/1.1" 200 None 2026-03-07 14:46:59,755 - lava_callback - DEBUG - Processing node 69a9975b7ee78ae610caebb1: baseline-arm-baylibre 2026-03-07 14:46:59,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9975b7ee78ae610caebb1 2026-03-07 14:46:59,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:59,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9975b7ee78ae610caebb1 HTTP/1.1" 200 None 2026-03-07 14:46:59,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:59,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:46:59,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:46:59,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9975b7ee78ae610caebb1 HTTP/1.1" 200 None 2026-03-07 14:46:59,820 - lava_callback - ERROR - Error processing callback for node 69a9975b7ee78ae610caebb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58834 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51030 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:47:39,663 - lava_callback - INFO - Received callback for node 69a997867ee78ae610caebbf INFO: 172.19.0.1:51034 - "POST /node/69a997867ee78ae610caebbf HTTP/1.0" 202 Accepted 2026-03-07 14:47:39,669 - lava_callback - INFO - Starting async job submit for node 69a997867ee78ae610caebbf 2026-03-07 14:47:39,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:47:39,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997867ee78ae610caebbf HTTP/1.1" 200 None 2026-03-07 14:47:39,690 - lava_callback - DEBUG - Processing node 69a997867ee78ae610caebbf: baseline-arm-baylibre 2026-03-07 14:47:39,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a997867ee78ae610caebbf 2026-03-07 14:47:39,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:47:39,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997867ee78ae610caebbf HTTP/1.1" 200 None 2026-03-07 14:47:39,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:47:39,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:47:39,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:47:39,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a997867ee78ae610caebbf HTTP/1.1" 200 None 2026-03-07 14:47:39,747 - lava_callback - ERROR - Error processing callback for node 69a997867ee78ae610caebbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:60786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47768 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42930 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39116 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:48:39,672 - lava_callback - INFO - Received callback for node 69a997b27ee78ae610caebd4 INFO: 172.19.0.1:39126 - "POST /node/69a997b27ee78ae610caebd4 HTTP/1.0" 202 Accepted 2026-03-07 14:48:39,677 - lava_callback - INFO - Starting async job submit for node 69a997b27ee78ae610caebd4 2026-03-07 14:48:39,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:48:39,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997b27ee78ae610caebd4 HTTP/1.1" 200 None 2026-03-07 14:48:39,697 - lava_callback - DEBUG - Processing node 69a997b27ee78ae610caebd4: baseline-arm-baylibre 2026-03-07 14:48:39,697 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a997b27ee78ae610caebd4 2026-03-07 14:48:39,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:48:39,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997b27ee78ae610caebd4 HTTP/1.1" 200 None 2026-03-07 14:48:39,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:48:39,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:48:39,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:48:39,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a997b27ee78ae610caebd4 HTTP/1.1" 200 None 2026-03-07 14:48:39,752 - lava_callback - ERROR - Error processing callback for node 69a997b27ee78ae610caebd4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46242 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46250 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:49:19,709 - lava_callback - INFO - Received callback for node 69a997e07ee78ae610caebfe INFO: 172.19.0.1:37572 - "POST /node/69a997e07ee78ae610caebfe HTTP/1.0" 202 Accepted 2026-03-07 14:49:19,715 - lava_callback - INFO - Starting async job submit for node 69a997e07ee78ae610caebfe 2026-03-07 14:49:19,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:49:19,729 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997e07ee78ae610caebfe HTTP/1.1" 200 None 2026-03-07 14:49:19,730 - lava_callback - DEBUG - Processing node 69a997e07ee78ae610caebfe: baseline-arm-baylibre 2026-03-07 14:49:19,730 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a997e07ee78ae610caebfe 2026-03-07 14:49:19,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:49:19,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a997e07ee78ae610caebfe HTTP/1.1" 200 None 2026-03-07 14:49:19,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:49:19,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:49:19,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:49:19,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a997e07ee78ae610caebfe HTTP/1.1" 200 None 2026-03-07 14:49:19,795 - lava_callback - ERROR - Error processing callback for node 69a997e07ee78ae610caebfe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59234 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47018 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:52:19,924 - lava_callback - INFO - Received callback for node 69a998937ee78ae610caec50 INFO: 172.19.0.1:55732 - "POST /node/69a998937ee78ae610caec50 HTTP/1.0" 202 Accepted 2026-03-07 14:52:19,929 - lava_callback - INFO - Starting async job submit for node 69a998937ee78ae610caec50 2026-03-07 14:52:19,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:52:19,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a998937ee78ae610caec50 HTTP/1.1" 200 None 2026-03-07 14:52:19,945 - lava_callback - DEBUG - Processing node 69a998937ee78ae610caec50: baseline-arm-baylibre 2026-03-07 14:52:19,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a998937ee78ae610caec50 2026-03-07 14:52:19,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:52:19,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a998937ee78ae610caec50 HTTP/1.1" 200 None 2026-03-07 14:52:19,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:52:19,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:52:19,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:52:19,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a998937ee78ae610caec50 HTTP/1.1" 200 None 2026-03-07 14:52:19,997 - lava_callback - ERROR - Error processing callback for node 69a998937ee78ae610caec50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57554 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:52:59,972 - lava_callback - INFO - Received callback for node 69a998c17ee78ae610caec6f INFO: 172.19.0.1:43492 - "POST /node/69a998c17ee78ae610caec6f HTTP/1.0" 202 Accepted 2026-03-07 14:52:59,977 - lava_callback - INFO - Starting async job submit for node 69a998c17ee78ae610caec6f 2026-03-07 14:52:59,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:52:59,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a998c17ee78ae610caec6f HTTP/1.1" 200 None 2026-03-07 14:52:59,993 - lava_callback - DEBUG - Processing node 69a998c17ee78ae610caec6f: baseline-arm-baylibre 2026-03-07 14:52:59,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a998c17ee78ae610caec6f 2026-03-07 14:52:59,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:53:00,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a998c17ee78ae610caec6f HTTP/1.1" 200 None 2026-03-07 14:53:00,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:53:00,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f61f6ebb1cc56c1de8c8 HTTP/1.1" 200 None 2026-03-07 14:53:00,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:53:00,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a998c17ee78ae610caec6f HTTP/1.1" 200 None 2026-03-07 14:53:00,058 - lava_callback - ERROR - Error processing callback for node 69a998c17ee78ae610caec6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55552 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55898 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34956 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39670 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35934 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:55:00,196 - lava_callback - INFO - Received callback for node 69a9993f7ee78ae610caecca INFO: 172.19.0.1:41032 - "POST /node/69a9993f7ee78ae610caecca HTTP/1.0" 202 Accepted 2026-03-07 14:55:00,201 - lava_callback - INFO - Starting async job submit for node 69a9993f7ee78ae610caecca 2026-03-07 14:55:00,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:55:00,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9993f7ee78ae610caecca HTTP/1.1" 200 None 2026-03-07 14:55:00,217 - lava_callback - DEBUG - Processing node 69a9993f7ee78ae610caecca: baseline-arm-baylibre 2026-03-07 14:55:00,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9993f7ee78ae610caecca 2026-03-07 14:55:00,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:55:00,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9993f7ee78ae610caecca HTTP/1.1" 200 None 2026-03-07 14:55:00,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:55:00,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:55:00,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:55:00,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9993f7ee78ae610caecca HTTP/1.1" 200 None 2026-03-07 14:55:00,279 - lava_callback - ERROR - Error processing callback for node 69a9993f7ee78ae610caecca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:41040 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46408 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36544 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47234 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:56:00,032 - lava_callback - INFO - Received callback for node 69a9996b7ee78ae610caece7 INFO: 172.19.0.1:39694 - "POST /node/69a9996b7ee78ae610caece7 HTTP/1.0" 202 Accepted 2026-03-07 14:56:00,038 - lava_callback - INFO - Starting async job submit for node 69a9996b7ee78ae610caece7 2026-03-07 14:56:00,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:00,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9996b7ee78ae610caece7 HTTP/1.1" 200 None 2026-03-07 14:56:00,064 - lava_callback - DEBUG - Processing node 69a9996b7ee78ae610caece7: baseline-arm-baylibre 2026-03-07 14:56:00,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9996b7ee78ae610caece7 2026-03-07 14:56:00,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:00,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9996b7ee78ae610caece7 HTTP/1.1" 200 None 2026-03-07 14:56:00,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:00,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:56:00,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:00,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9996b7ee78ae610caece7 HTTP/1.1" 200 None 2026-03-07 14:56:00,126 - lava_callback - ERROR - Error processing callback for node 69a9996b7ee78ae610caece7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39708 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40350 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41640 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41754 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:56:40,150 - lava_callback - INFO - Received callback for node 69a999977ee78ae610caed04 INFO: 172.19.0.1:39888 - "POST /node/69a999977ee78ae610caed04 HTTP/1.0" 202 Accepted 2026-03-07 14:56:40,156 - lava_callback - INFO - Starting async job submit for node 69a999977ee78ae610caed04 2026-03-07 14:56:40,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:40,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999977ee78ae610caed04 HTTP/1.1" 200 None 2026-03-07 14:56:40,172 - lava_callback - DEBUG - Processing node 69a999977ee78ae610caed04: baseline-arm-baylibre 2026-03-07 14:56:40,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a999977ee78ae610caed04 2026-03-07 14:56:40,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:40,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999977ee78ae610caed04 HTTP/1.1" 200 None 2026-03-07 14:56:40,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:40,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:56:40,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:56:40,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a999977ee78ae610caed04 HTTP/1.1" 200 None 2026-03-07 14:56:40,225 - lava_callback - ERROR - Error processing callback for node 69a999977ee78ae610caed04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37648 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37668 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:57:20,132 - lava_callback - INFO - Received callback for node 69a999c37ee78ae610caed1c INFO: 172.19.0.1:57850 - "POST /node/69a999c37ee78ae610caed1c HTTP/1.0" 202 Accepted 2026-03-07 14:57:20,137 - lava_callback - INFO - Starting async job submit for node 69a999c37ee78ae610caed1c 2026-03-07 14:57:20,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:57:20,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999c37ee78ae610caed1c HTTP/1.1" 200 None 2026-03-07 14:57:20,153 - lava_callback - DEBUG - Processing node 69a999c37ee78ae610caed1c: baseline-arm-baylibre 2026-03-07 14:57:20,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a999c37ee78ae610caed1c 2026-03-07 14:57:20,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:57:20,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999c37ee78ae610caed1c HTTP/1.1" 200 None 2026-03-07 14:57:20,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:57:20,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:57:20,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:57:20,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a999c37ee78ae610caed1c HTTP/1.1" 200 None 2026-03-07 14:57:20,209 - lava_callback - ERROR - Error processing callback for node 69a999c37ee78ae610caed1c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57866 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59804 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:58:00,238 - lava_callback - INFO - Received callback for node 69a999f07ee78ae610caed36 INFO: 172.19.0.1:43994 - "POST /node/69a999f07ee78ae610caed36 HTTP/1.0" 202 Accepted 2026-03-07 14:58:00,244 - lava_callback - INFO - Starting async job submit for node 69a999f07ee78ae610caed36 2026-03-07 14:58:00,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:00,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999f07ee78ae610caed36 HTTP/1.1" 200 None 2026-03-07 14:58:00,259 - lava_callback - DEBUG - Processing node 69a999f07ee78ae610caed36: baseline-arm-baylibre 2026-03-07 14:58:00,259 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a999f07ee78ae610caed36 2026-03-07 14:58:00,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:00,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a999f07ee78ae610caed36 HTTP/1.1" 200 None 2026-03-07 14:58:00,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:00,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:58:00,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:00,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a999f07ee78ae610caed36 HTTP/1.1" 200 None 2026-03-07 14:58:00,319 - lava_callback - ERROR - Error processing callback for node 69a999f07ee78ae610caed36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:44004 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44692 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39812 - "GET / HTTP/1.0" 200 OK 2026-03-07 14:58:40,395 - lava_callback - INFO - Received callback for node 69a99a1c7ee78ae610caed4e INFO: 172.19.0.1:59968 - "POST /node/69a99a1c7ee78ae610caed4e HTTP/1.0" 202 Accepted 2026-03-07 14:58:40,400 - lava_callback - INFO - Starting async job submit for node 69a99a1c7ee78ae610caed4e 2026-03-07 14:58:40,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:40,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99a1c7ee78ae610caed4e HTTP/1.1" 200 None 2026-03-07 14:58:40,421 - lava_callback - DEBUG - Processing node 69a99a1c7ee78ae610caed4e: baseline-arm-baylibre 2026-03-07 14:58:40,422 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99a1c7ee78ae610caed4e 2026-03-07 14:58:40,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:40,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99a1c7ee78ae610caed4e HTTP/1.1" 200 None 2026-03-07 14:58:40,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:40,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 14:58:40,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 14:58:40,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99a1c7ee78ae610caed4e HTTP/1.1" 200 None 2026-03-07 14:58:40,482 - lava_callback - ERROR - Error processing callback for node 69a99a1c7ee78ae610caed4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52690 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40338 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60108 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:01:09,161 - lava_callback - INFO - Received callback for node 69a99aa17ee78ae610caedac INFO: 172.19.0.1:60120 - "POST /node/69a99aa17ee78ae610caedac HTTP/1.0" 202 Accepted 2026-03-07 15:01:09,170 - lava_callback - INFO - Starting async job submit for node 69a99aa17ee78ae610caedac 2026-03-07 15:01:09,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:09,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99aa17ee78ae610caedac HTTP/1.1" 200 None 2026-03-07 15:01:09,194 - lava_callback - DEBUG - Processing node 69a99aa17ee78ae610caedac: baseline-arm-clabbe 2026-03-07 15:01:09,194 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99aa17ee78ae610caedac 2026-03-07 15:01:09,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:09,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99aa17ee78ae610caedac HTTP/1.1" 200 None 2026-03-07 15:01:09,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:09,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 15:01:09,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:09,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99aa17ee78ae610caedac HTTP/1.1" 200 None 2026-03-07 15:01:09,284 - lava_callback - ERROR - Error processing callback for node 69a99aa17ee78ae610caedac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60178 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:01:49,231 - lava_callback - INFO - Received callback for node 69a99ace7ee78ae610caedc9 INFO: 172.19.0.1:60184 - "POST /node/69a99ace7ee78ae610caedc9 HTTP/1.0" 202 Accepted 2026-03-07 15:01:49,236 - lava_callback - INFO - Starting async job submit for node 69a99ace7ee78ae610caedc9 2026-03-07 15:01:49,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:49,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99ace7ee78ae610caedc9 HTTP/1.1" 200 None 2026-03-07 15:01:49,253 - lava_callback - DEBUG - Processing node 69a99ace7ee78ae610caedc9: baseline-arm-clabbe 2026-03-07 15:01:49,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99ace7ee78ae610caedc9 2026-03-07 15:01:49,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:49,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99ace7ee78ae610caedc9 HTTP/1.1" 200 None 2026-03-07 15:01:49,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:49,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c6a7ee78ae610caa67c HTTP/1.1" 200 None 2026-03-07 15:01:49,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:01:49,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99ace7ee78ae610caedc9 HTTP/1.1" 200 None 2026-03-07 15:01:49,309 - lava_callback - ERROR - Error processing callback for node 69a99ace7ee78ae610caedc9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34132 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37582 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33826 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41682 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53824 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60540 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56586 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48440 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:09:00,862 - lava_callback - INFO - Received callback for node 69a99c7a7ee78ae610caeee0 INFO: 172.19.0.1:57378 - "POST /node/69a99c7a7ee78ae610caeee0 HTTP/1.0" 202 Accepted 2026-03-07 15:09:00,871 - lava_callback - INFO - Starting async job submit for node 69a99c7a7ee78ae610caeee0 2026-03-07 15:09:00,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:09:00,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99c7a7ee78ae610caeee0 HTTP/1.1" 200 None 2026-03-07 15:09:00,897 - lava_callback - DEBUG - Processing node 69a99c7a7ee78ae610caeee0: baseline-arm64-baylibre 2026-03-07 15:09:00,897 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99c7a7ee78ae610caeee0 2026-03-07 15:09:00,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:09:00,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99c7a7ee78ae610caeee0 HTTP/1.1" 200 None 2026-03-07 15:09:00,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:09:00,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 15:09:00,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:09:00,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99c7a7ee78ae610caeee0 HTTP/1.1" 200 None 2026-03-07 15:09:00,978 - lava_callback - ERROR - Error processing callback for node 69a99c7a7ee78ae610caeee0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42322 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48306 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45110 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:10:20,889 - lava_callback - INFO - Received callback for node 69a99cce7ee78ae610caef0a INFO: 172.19.0.1:33256 - "POST /node/69a99cce7ee78ae610caef0a HTTP/1.0" 202 Accepted 2026-03-07 15:10:20,895 - lava_callback - INFO - Starting async job submit for node 69a99cce7ee78ae610caef0a 2026-03-07 15:10:20,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:10:20,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99cce7ee78ae610caef0a HTTP/1.1" 200 None 2026-03-07 15:10:20,911 - lava_callback - DEBUG - Processing node 69a99cce7ee78ae610caef0a: baseline-arm64-baylibre 2026-03-07 15:10:20,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99cce7ee78ae610caef0a 2026-03-07 15:10:20,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:10:20,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99cce7ee78ae610caef0a HTTP/1.1" 200 None 2026-03-07 15:10:20,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:10:20,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 15:10:20,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:10:20,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99cce7ee78ae610caef0a HTTP/1.1" 200 None 2026-03-07 15:10:20,983 - lava_callback - ERROR - Error processing callback for node 69a99cce7ee78ae610caef0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35588 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50084 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:11:40,990 - lava_callback - INFO - Received callback for node 69a99d267ee78ae610caef35 INFO: 172.19.0.1:37858 - "POST /node/69a99d267ee78ae610caef35 HTTP/1.0" 202 Accepted 2026-03-07 15:11:40,995 - lava_callback - INFO - Starting async job submit for node 69a99d267ee78ae610caef35 2026-03-07 15:11:40,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:11:41,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99d267ee78ae610caef35 HTTP/1.1" 200 None 2026-03-07 15:11:41,010 - lava_callback - DEBUG - Processing node 69a99d267ee78ae610caef35: baseline-arm64-baylibre 2026-03-07 15:11:41,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99d267ee78ae610caef35 2026-03-07 15:11:41,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:11:41,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99d267ee78ae610caef35 HTTP/1.1" 200 None 2026-03-07 15:11:41,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:11:41,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 15:11:41,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:11:41,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99d267ee78ae610caef35 HTTP/1.1" 200 None 2026-03-07 15:11:41,073 - lava_callback - ERROR - Error processing callback for node 69a99d267ee78ae610caef35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51194 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:13:01,045 - lava_callback - INFO - Received callback for node 69a99d7a7ee78ae610caef65 INFO: 172.19.0.1:34006 - "POST /node/69a99d7a7ee78ae610caef65 HTTP/1.0" 202 Accepted 2026-03-07 15:13:01,051 - lava_callback - INFO - Starting async job submit for node 69a99d7a7ee78ae610caef65 2026-03-07 15:13:01,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:13:01,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99d7a7ee78ae610caef65 HTTP/1.1" 200 None 2026-03-07 15:13:01,067 - lava_callback - DEBUG - Processing node 69a99d7a7ee78ae610caef65: baseline-arm64-baylibre 2026-03-07 15:13:01,068 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99d7a7ee78ae610caef65 2026-03-07 15:13:01,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:13:01,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99d7a7ee78ae610caef65 HTTP/1.1" 200 None 2026-03-07 15:13:01,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:13:01,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 15:13:01,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:13:01,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99d7a7ee78ae610caef65 HTTP/1.1" 200 None 2026-03-07 15:13:01,126 - lava_callback - ERROR - Error processing callback for node 69a99d7a7ee78ae610caef65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:34022 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49148 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58704 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43398 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35356 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:14:49,781 - lava_callback - INFO - Received callback for node 69a99dd57ee78ae610caef8e INFO: 172.19.0.1:50326 - "POST /node/69a99dd57ee78ae610caef8e HTTP/1.0" 202 Accepted 2026-03-07 15:14:49,786 - lava_callback - INFO - Starting async job submit for node 69a99dd57ee78ae610caef8e 2026-03-07 15:14:49,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:14:49,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99dd57ee78ae610caef8e HTTP/1.1" 200 None 2026-03-07 15:14:49,824 - lava_callback - DEBUG - Processing node 69a99dd57ee78ae610caef8e: baseline-arm64-clabbe 2026-03-07 15:14:49,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99dd57ee78ae610caef8e 2026-03-07 15:14:49,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:14:49,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99dd57ee78ae610caef8e HTTP/1.1" 200 None 2026-03-07 15:14:49,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:14:49,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a93c777ee78ae610caa696 HTTP/1.1" 200 None 2026-03-07 15:14:49,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:14:49,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99dd57ee78ae610caef8e HTTP/1.1" 200 None 2026-03-07 15:14:49,882 - lava_callback - ERROR - Error processing callback for node 69a99dd57ee78ae610caef8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:50342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49756 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41892 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54290 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49950 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49980 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34998 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56008 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:19:01,434 - lava_callback - INFO - Received callback for node 69a99ed57ee78ae610caeff5 INFO: 172.19.0.1:35346 - "POST /node/69a99ed57ee78ae610caeff5 HTTP/1.0" 202 Accepted 2026-03-07 15:19:01,442 - lava_callback - INFO - Starting async job submit for node 69a99ed57ee78ae610caeff5 2026-03-07 15:19:01,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:19:01,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99ed57ee78ae610caeff5 HTTP/1.1" 200 None 2026-03-07 15:19:01,458 - lava_callback - DEBUG - Processing node 69a99ed57ee78ae610caeff5: baseline-arm64-baylibre 2026-03-07 15:19:01,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99ed57ee78ae610caeff5 2026-03-07 15:19:01,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:19:01,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99ed57ee78ae610caeff5 HTTP/1.1" 200 None 2026-03-07 15:19:01,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:19:01,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6edb32da7ccec10683eaa HTTP/1.1" 200 None 2026-03-07 15:19:01,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:19:01,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99ed57ee78ae610caeff5 HTTP/1.1" 200 None 2026-03-07 15:19:01,516 - lava_callback - ERROR - Error processing callback for node 69a99ed57ee78ae610caeff5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:35362 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37112 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.19.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46270 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41952 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41956 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:20:21,481 - lava_callback - INFO - Received callback for node 69a99f2a7ee78ae610caf027 INFO: 172.19.0.1:58092 - "POST /node/69a99f2a7ee78ae610caf027 HTTP/1.0" 202 Accepted 2026-03-07 15:20:21,486 - lava_callback - INFO - Starting async job submit for node 69a99f2a7ee78ae610caf027 2026-03-07 15:20:21,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:20:21,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99f2a7ee78ae610caf027 HTTP/1.1" 200 None 2026-03-07 15:20:21,507 - lava_callback - DEBUG - Processing node 69a99f2a7ee78ae610caf027: baseline-arm64-baylibre 2026-03-07 15:20:21,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99f2a7ee78ae610caf027 2026-03-07 15:20:21,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:20:21,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99f2a7ee78ae610caf027 HTTP/1.1" 200 None 2026-03-07 15:20:21,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:20:21,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6edb32da7ccec10683eaa HTTP/1.1" 200 None 2026-03-07 15:20:21,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:20:21,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99f2a7ee78ae610caf027 HTTP/1.1" 200 None 2026-03-07 15:20:21,566 - lava_callback - ERROR - Error processing callback for node 69a99f2a7ee78ae610caf027: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44900 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38268 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51624 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:23:21,573 - lava_callback - INFO - Received callback for node 69a99fd47ee78ae610caf078 INFO: 172.19.0.1:36464 - "POST /node/69a99fd47ee78ae610caf078 HTTP/1.0" 202 Accepted 2026-03-07 15:23:21,578 - lava_callback - INFO - Starting async job submit for node 69a99fd47ee78ae610caf078 2026-03-07 15:23:21,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:23:21,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99fd47ee78ae610caf078 HTTP/1.1" 200 None 2026-03-07 15:23:21,594 - lava_callback - DEBUG - Processing node 69a99fd47ee78ae610caf078: baseline-arm64-baylibre 2026-03-07 15:23:21,594 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a99fd47ee78ae610caf078 2026-03-07 15:23:21,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:23:21,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a99fd47ee78ae610caf078 HTTP/1.1" 200 None 2026-03-07 15:23:21,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:23:21,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a6edb32da7ccec10683eaa HTTP/1.1" 200 None 2026-03-07 15:23:21,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:23:21,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a99fd47ee78ae610caf078 HTTP/1.1" 200 None 2026-03-07 15:23:21,664 - lava_callback - ERROR - Error processing callback for node 69a99fd47ee78ae610caf078: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51082 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:37178 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:24:21,623 - lava_callback - INFO - Received callback for node 69a9a01b7ee78ae610caf099 INFO: 172.19.0.1:45464 - "POST /node/69a9a01b7ee78ae610caf099 HTTP/1.0" 202 Accepted 2026-03-07 15:24:21,629 - lava_callback - INFO - Starting async job submit for node 69a9a01b7ee78ae610caf099 2026-03-07 15:24:21,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:24:21,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a01b7ee78ae610caf099 HTTP/1.1" 200 None 2026-03-07 15:24:21,644 - lava_callback - DEBUG - Processing node 69a9a01b7ee78ae610caf099: baseline-arm-baylibre 2026-03-07 15:24:21,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a01b7ee78ae610caf099 2026-03-07 15:24:21,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:24:21,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a01b7ee78ae610caf099 HTTP/1.1" 200 None 2026-03-07 15:24:21,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:24:21,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:24:21,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:24:21,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a01b7ee78ae610caf099 HTTP/1.1" 200 None 2026-03-07 15:24:21,711 - lava_callback - ERROR - Error processing callback for node 69a9a01b7ee78ae610caf099: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57682 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:25:01,662 - lava_callback - INFO - Received callback for node 69a9a0467ee78ae610caf0bb INFO: 172.19.0.1:39720 - "POST /node/69a9a0467ee78ae610caf0bb HTTP/1.0" 202 Accepted 2026-03-07 15:25:01,668 - lava_callback - INFO - Starting async job submit for node 69a9a0467ee78ae610caf0bb 2026-03-07 15:25:01,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:01,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0467ee78ae610caf0bb HTTP/1.1" 200 None 2026-03-07 15:25:01,693 - lava_callback - DEBUG - Processing node 69a9a0467ee78ae610caf0bb: baseline-arm-baylibre 2026-03-07 15:25:01,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a0467ee78ae610caf0bb 2026-03-07 15:25:01,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:01,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0467ee78ae610caf0bb HTTP/1.1" 200 None 2026-03-07 15:25:01,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:01,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:25:01,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:01,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a0467ee78ae610caf0bb HTTP/1.1" 200 None 2026-03-07 15:25:01,752 - lava_callback - ERROR - Error processing callback for node 69a9a0467ee78ae610caf0bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39732 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50116 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33970 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39552 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:25:41,685 - lava_callback - INFO - Received callback for node 69a9a0727ee78ae610caf0c7 INFO: 172.19.0.1:58670 - "POST /node/69a9a0727ee78ae610caf0c7 HTTP/1.0" 202 Accepted 2026-03-07 15:25:41,690 - lava_callback - INFO - Starting async job submit for node 69a9a0727ee78ae610caf0c7 2026-03-07 15:25:41,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:41,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0727ee78ae610caf0c7 HTTP/1.1" 200 None 2026-03-07 15:25:41,706 - lava_callback - DEBUG - Processing node 69a9a0727ee78ae610caf0c7: baseline-arm-baylibre 2026-03-07 15:25:41,707 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a0727ee78ae610caf0c7 2026-03-07 15:25:41,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:41,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0727ee78ae610caf0c7 HTTP/1.1" 200 None 2026-03-07 15:25:41,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:41,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:25:41,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:25:41,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a0727ee78ae610caf0c7 HTTP/1.1" 200 None 2026-03-07 15:25:41,795 - lava_callback - ERROR - Error processing callback for node 69a9a0727ee78ae610caf0c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:58674 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:38406 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34282 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:26:41,773 - lava_callback - INFO - Received callback for node 69a9a09f7ee78ae610caf0d9 INFO: 172.19.0.1:39540 - "POST /node/69a9a09f7ee78ae610caf0d9 HTTP/1.0" 202 Accepted 2026-03-07 15:26:41,779 - lava_callback - INFO - Starting async job submit for node 69a9a09f7ee78ae610caf0d9 2026-03-07 15:26:41,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:26:41,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a09f7ee78ae610caf0d9 HTTP/1.1" 200 None 2026-03-07 15:26:41,800 - lava_callback - DEBUG - Processing node 69a9a09f7ee78ae610caf0d9: baseline-arm-baylibre 2026-03-07 15:26:41,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a09f7ee78ae610caf0d9 2026-03-07 15:26:41,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:26:41,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a09f7ee78ae610caf0d9 HTTP/1.1" 200 None 2026-03-07 15:26:41,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:26:41,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:26:41,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:26:41,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a09f7ee78ae610caf0d9 HTTP/1.1" 200 None 2026-03-07 15:26:41,874 - lava_callback - ERROR - Error processing callback for node 69a9a09f7ee78ae610caf0d9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:53288 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:27:21,758 - lava_callback - INFO - Received callback for node 69a9a0c97ee78ae610caf0ed INFO: 172.19.0.1:43204 - "POST /node/69a9a0c97ee78ae610caf0ed HTTP/1.0" 202 Accepted 2026-03-07 15:27:21,764 - lava_callback - INFO - Starting async job submit for node 69a9a0c97ee78ae610caf0ed 2026-03-07 15:27:21,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:27:21,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0c97ee78ae610caf0ed HTTP/1.1" 200 None 2026-03-07 15:27:21,785 - lava_callback - DEBUG - Processing node 69a9a0c97ee78ae610caf0ed: baseline-arm-baylibre 2026-03-07 15:27:21,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a0c97ee78ae610caf0ed 2026-03-07 15:27:21,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:27:21,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0c97ee78ae610caf0ed HTTP/1.1" 200 None 2026-03-07 15:27:21,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:27:21,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:27:21,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:27:21,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a0c97ee78ae610caf0ed HTTP/1.1" 200 None 2026-03-07 15:27:21,840 - lava_callback - ERROR - Error processing callback for node 69a9a0c97ee78ae610caf0ed: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:43218 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52316 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:28:01,861 - lava_callback - INFO - Received callback for node 69a9a0f57ee78ae610caf116 INFO: 172.19.0.1:52322 - "POST /node/69a9a0f57ee78ae610caf116 HTTP/1.0" 202 Accepted 2026-03-07 15:28:01,867 - lava_callback - INFO - Starting async job submit for node 69a9a0f57ee78ae610caf116 2026-03-07 15:28:01,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:28:01,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0f57ee78ae610caf116 HTTP/1.1" 200 None 2026-03-07 15:28:01,883 - lava_callback - DEBUG - Processing node 69a9a0f57ee78ae610caf116: baseline-arm-baylibre 2026-03-07 15:28:01,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a0f57ee78ae610caf116 2026-03-07 15:28:01,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:28:01,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a0f57ee78ae610caf116 HTTP/1.1" 200 None 2026-03-07 15:28:01,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:28:01,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696ec3d518458fb33ea0f HTTP/1.1" 200 None 2026-03-07 15:28:01,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:28:01,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a0f57ee78ae610caf116 HTTP/1.1" 200 None 2026-03-07 15:28:01,935 - lava_callback - ERROR - Error processing callback for node 69a9a0f57ee78ae610caf116: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59206 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59230 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52806 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47534 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54852 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45894 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46688 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59850 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45196 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59502 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60352 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43830 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43844 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57166 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:35:22,220 - lava_callback - INFO - Received callback for node 69a9a2b67ee78ae610caf1c9 INFO: 172.19.0.1:42198 - "POST /node/69a9a2b67ee78ae610caf1c9 HTTP/1.0" 202 Accepted 2026-03-07 15:35:22,227 - lava_callback - INFO - Starting async job submit for node 69a9a2b67ee78ae610caf1c9 2026-03-07 15:35:22,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:35:22,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a2b67ee78ae610caf1c9 HTTP/1.1" 200 None 2026-03-07 15:35:22,243 - lava_callback - DEBUG - Processing node 69a9a2b67ee78ae610caf1c9: baseline-arm64-baylibre 2026-03-07 15:35:22,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a2b67ee78ae610caf1c9 2026-03-07 15:35:22,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:35:22,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a2b67ee78ae610caf1c9 HTTP/1.1" 200 None 2026-03-07 15:35:22,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:35:22,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 15:35:22,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:35:22,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a2b67ee78ae610caf1c9 HTTP/1.1" 200 None 2026-03-07 15:35:22,297 - lava_callback - ERROR - Error processing callback for node 69a9a2b67ee78ae610caf1c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52580 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34740 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33618 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57802 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59644 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50182 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56430 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44478 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:50886 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:38:22,382 - lava_callback - INFO - Received callback for node 69a9a3627ee78ae610caf208 INFO: 172.19.0.1:42906 - "POST /node/69a9a3627ee78ae610caf208 HTTP/1.0" 202 Accepted 2026-03-07 15:38:22,387 - lava_callback - INFO - Starting async job submit for node 69a9a3627ee78ae610caf208 2026-03-07 15:38:22,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:38:22,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a3627ee78ae610caf208 HTTP/1.1" 200 None 2026-03-07 15:38:22,403 - lava_callback - DEBUG - Processing node 69a9a3627ee78ae610caf208: baseline-arm64-baylibre 2026-03-07 15:38:22,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a3627ee78ae610caf208 2026-03-07 15:38:22,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:38:22,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a3627ee78ae610caf208 HTTP/1.1" 200 None 2026-03-07 15:38:22,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:38:22,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a696fc3d518458fb33ea24 HTTP/1.1" 200 None 2026-03-07 15:38:22,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:38:22,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a3627ee78ae610caf208 HTTP/1.1" 200 None 2026-03-07 15:38:22,498 - lava_callback - ERROR - Error processing callback for node 69a9a3627ee78ae610caf208: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:42908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48034 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51064 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41180 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45854 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34624 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47402 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47628 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40902 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40244 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51776 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46052 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48746 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48766 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53146 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60990 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60962 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35494 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48938 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49316 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53396 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60198 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60374 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37720 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59924 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60278 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:43300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58470 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59464 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:55308 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47822 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:39840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:39850 - "GET / HTTP/1.0" 200 OK 2026-03-07 15:50:23,072 - lava_callback - INFO - Received callback for node 69a9a6297ee78ae610caf2f0 INFO: 172.19.0.1:56604 - "POST /node/69a9a6297ee78ae610caf2f0 HTTP/1.0" 202 Accepted 2026-03-07 15:50:23,077 - lava_callback - INFO - Starting async job submit for node 69a9a6297ee78ae610caf2f0 2026-03-07 15:50:23,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:50:23,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a6297ee78ae610caf2f0 HTTP/1.1" 200 None 2026-03-07 15:50:23,093 - lava_callback - DEBUG - Processing node 69a9a6297ee78ae610caf2f0: baseline-arm64-baylibre 2026-03-07 15:50:23,094 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69a9a6297ee78ae610caf2f0 2026-03-07 15:50:23,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:50:23,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a9a6297ee78ae610caf2f0 HTTP/1.1" 200 None 2026-03-07 15:50:23,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:50:23,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69a3f62b6ebb1cc56c1de8d7 HTTP/1.1" 200 None 2026-03-07 15:50:23,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 15:50:23,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69a9a6297ee78ae610caf2f0 HTTP/1.1" 200 None 2026-03-07 15:50:23,150 - lava_callback - ERROR - Error processing callback for node 69a9a6297ee78ae610caf2f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.19.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33026 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33038 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35216 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37706 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55212 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43452 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60118 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59594 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44498 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:44516 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45054 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41556 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46280 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42160 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45014 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:50002 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53804 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52816 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:52838 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44868 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43012 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38220 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52530 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33490 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56140 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:56158 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37208 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40660 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33982 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60790 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:60812 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52304 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49110 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:57388 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48868 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:02:40,398 - lava_callback - INFO - Received callback for node 69abe9d040deb775998f445c INFO: 172.19.0.1:32878 - "POST /node/69abe9d040deb775998f445c HTTP/1.0" 202 Accepted 2026-03-07 16:02:40,404 - lava_callback - INFO - Starting async job submit for node 69abe9d040deb775998f445c 2026-03-07 16:02:40,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:40,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9d040deb775998f445c HTTP/1.1" 200 None 2026-03-07 16:02:40,424 - lava_callback - DEBUG - Processing node 69abe9d040deb775998f445c: baseline-arm64-foundriesio 2026-03-07 16:02:40,432 - lava_callback - WARNING - Failed to upload log 2026-03-07 16:02:40,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:02:40,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:02:40,642 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69abe9d040deb775998f445c/lava-logs.yaml 2026-03-07 16:02:40,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:02:40,794 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:02:40,796 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69abe9d040deb775998f445c/lava_callback.json.gz 2026-03-07 16:02:40,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:40,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9d040deb775998f445c HTTP/1.1" 200 None 2026-03-07 16:02:40,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:40,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 16:02:40,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:40,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9d040deb775998f445c HTTP/1.1" 200 None 2026-03-07 16:02:40,859 - lava_callback - INFO - Completed processing callback for node 69abe9d040deb775998f445c INFO: 172.19.0.1:32888 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:02:52,087 - lava_callback - INFO - Received callback for node 69abe9cf40deb775998f4455 INFO: 172.19.0.1:45158 - "POST /node/69abe9cf40deb775998f4455 HTTP/1.0" 202 Accepted 2026-03-07 16:02:52,092 - lava_callback - INFO - Starting async job submit for node 69abe9cf40deb775998f4455 2026-03-07 16:02:52,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:52,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cf40deb775998f4455 HTTP/1.1" 200 None 2026-03-07 16:02:52,111 - lava_callback - DEBUG - Processing node 69abe9cf40deb775998f4455: baseline-arm64-foundriesio 2026-03-07 16:02:52,118 - lava_callback - WARNING - Failed to upload log 2026-03-07 16:02:52,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:02:52,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:02:52,292 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69abe9cf40deb775998f4455/lava-logs.yaml 2026-03-07 16:02:52,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:02:52,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:02:52,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69abe9cf40deb775998f4455/lava_callback.json.gz 2026-03-07 16:02:52,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:52,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abe9cf40deb775998f4455 HTTP/1.1" 200 None 2026-03-07 16:02:52,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:52,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 16:02:52,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:02:52,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69abe9cf40deb775998f4455 HTTP/1.1" 200 None 2026-03-07 16:02:52,565 - lava_callback - INFO - Completed processing callback for node 69abe9cf40deb775998f4455 INFO: 172.19.0.1:45160 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:03:01,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:03:01,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32968 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:32980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43744 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57336 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52536 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42920 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36702 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:54504 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59028 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40566 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34472 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47988 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:48004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:48018 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58364 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:47096 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:53758 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41778 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60976 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:59496 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:47780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:42726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:42734 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43908 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:57062 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:34250 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41842 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:43236 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:36542 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55170 - "GET /node/698c536b755d7811a4141690%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.19.0.1:55172 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49068 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:49070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.19.0.1:49086 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:33510 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:11:32,907 - lava_callback - INFO - Received callback for node 69ac432140deb775998f5ed9 INFO: 172.19.0.1:35768 - "POST /node/69ac432140deb775998f5ed9 HTTP/1.0" 202 Accepted 2026-03-07 16:11:32,917 - lava_callback - INFO - Starting async job submit for node 69ac432140deb775998f5ed9 2026-03-07 16:11:32,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:32,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac432140deb775998f5ed9 HTTP/1.1" 200 None 2026-03-07 16:11:32,945 - lava_callback - DEBUG - Processing node 69ac432140deb775998f5ed9: baseline-arm64-foundriesio 2026-03-07 16:11:32,957 - lava_callback - WARNING - Failed to upload log 2026-03-07 16:11:32,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:11:33,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:11:33,159 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ac432140deb775998f5ed9/lava-logs.yaml 2026-03-07 16:11:33,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:11:33,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:11:33,390 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ac432140deb775998f5ed9/lava_callback.json.gz 2026-03-07 16:11:33,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:33,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac432140deb775998f5ed9 HTTP/1.1" 200 None 2026-03-07 16:11:33,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:33,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 16:11:33,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:33,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac432140deb775998f5ed9 HTTP/1.1" 200 None 2026-03-07 16:11:33,481 - lava_callback - INFO - Completed processing callback for node 69ac432140deb775998f5ed9 INFO: 172.19.0.1:35780 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:41094 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:11:48,315 - lava_callback - INFO - Received callback for node 69ac42da40deb775998f5ebd INFO: 172.19.0.1:41106 - "POST /node/69ac42da40deb775998f5ebd HTTP/1.0" 202 Accepted 2026-03-07 16:11:48,323 - lava_callback - INFO - Starting async job submit for node 69ac42da40deb775998f5ebd 2026-03-07 16:11:48,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:48,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac42da40deb775998f5ebd HTTP/1.1" 200 None 2026-03-07 16:11:48,348 - lava_callback - DEBUG - Processing node 69ac42da40deb775998f5ebd: baseline-arm64-foundriesio 2026-03-07 16:11:48,362 - lava_callback - WARNING - Failed to upload log 2026-03-07 16:11:48,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:11:48,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:11:48,540 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ac42da40deb775998f5ebd/lava-logs.yaml 2026-03-07 16:11:48,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-07 16:11:48,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-07 16:11:48,714 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ac42da40deb775998f5ebd/lava_callback.json.gz 2026-03-07 16:11:48,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:48,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ac42da40deb775998f5ebd HTTP/1.1" 200 None 2026-03-07 16:11:48,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:48,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69abdf3340deb775998f3bb5 HTTP/1.1" 200 None 2026-03-07 16:11:48,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:11:48,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ac42da40deb775998f5ebd HTTP/1.1" 200 None 2026-03-07 16:11:48,809 - lava_callback - INFO - Completed processing callback for node 69ac42da40deb775998f5ebd INFO: 172.19.0.1:51966 - "GET / HTTP/1.0" 200 OK 2026-03-07 16:12:01,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-07 16:12:01,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.19.0.1:38598 - "GET / HTTP/1.0" 200 OK INFO: 172.19.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]