INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:13:46,890 - lava_callback - INFO - Received callback for node 69ca30b43c3aafdab4beb269 2026-04-01 08:13:46,896 - lava_callback - INFO - Starting async job submit for node 69ca30b43c3aafdab4beb269 INFO: 172.21.0.1:60672 - "POST /node/69ca30b43c3aafdab4beb269 HTTP/1.0" 202 Accepted 2026-04-01 08:13:46,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:13:46,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca30b43c3aafdab4beb269 HTTP/1.1" 200 None 2026-04-01 08:13:46,917 - lava_callback - DEBUG - Processing node 69ca30b43c3aafdab4beb269: baseline-arm64-clabbe 2026-04-01 08:13:46,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca30b43c3aafdab4beb269 2026-04-01 08:13:46,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:13:46,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca30b43c3aafdab4beb269 HTTP/1.1" 200 None 2026-04-01 08:13:46,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:13:46,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c47b4a590270ad7b6d699d HTTP/1.1" 200 None 2026-04-01 08:13:46,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:13:47,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca30b43c3aafdab4beb269 HTTP/1.1" 200 None 2026-04-01 08:13:47,019 - lava_callback - ERROR - Error processing callback for node 69ca30b43c3aafdab4beb269: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57620 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:29:11,128 - lava_callback - INFO - Received callback for node 69ccd6d774bda3ec93a414c6 INFO: 172.21.0.1:46500 - "POST /node/69ccd6d774bda3ec93a414c6 HTTP/1.0" 202 Accepted 2026-04-01 08:29:11,177 - lava_callback - INFO - Starting async job submit for node 69ccd6d774bda3ec93a414c6 2026-04-01 08:29:11,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:29:11,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd6d774bda3ec93a414c6 HTTP/1.1" 200 None 2026-04-01 08:29:11,222 - lava_callback - DEBUG - Processing node 69ccd6d774bda3ec93a414c6: baseline-arm 2026-04-01 08:29:11,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:29:11,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:29:11,605 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd6d774bda3ec93a414c6/log.txt.gz 2026-04-01 08:29:11,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:29:11,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:29:11,922 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd6d774bda3ec93a414c6/lava-logs.yaml 2026-04-01 08:29:11,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:29:12,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:29:12,097 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd6d774bda3ec93a414c6/lava_callback.json.gz 2026-04-01 08:29:12,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:29:12,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd6d774bda3ec93a414c6 HTTP/1.1" 200 None 2026-04-01 08:29:12,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:29:12,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48874bda3ec93a4126c HTTP/1.1" 200 None 2026-04-01 08:29:12,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:29:12,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd6d774bda3ec93a414c6 HTTP/1.1" 200 None 2026-04-01 08:29:12,194 - lava_callback - INFO - Completed processing callback for node 69ccd6d774bda3ec93a414c6 INFO: 172.21.0.1:46506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46508 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:29:17,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:29:17,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:37:51,383 - lava_callback - INFO - Received callback for node 69ccd95074bda3ec93a414f3 INFO: 172.21.0.1:36200 - "POST /node/69ccd95074bda3ec93a414f3 HTTP/1.0" 202 Accepted 2026-04-01 08:37:51,395 - lava_callback - INFO - Starting async job submit for node 69ccd95074bda3ec93a414f3 2026-04-01 08:37:51,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:37:51,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95074bda3ec93a414f3 HTTP/1.1" 200 None 2026-04-01 08:37:51,422 - lava_callback - DEBUG - Processing node 69ccd95074bda3ec93a414f3: baseline-arm 2026-04-01 08:37:51,427 - lava_callback - WARNING - Failed to upload log 2026-04-01 08:37:51,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:37:51,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:37:51,572 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95074bda3ec93a414f3/lava-logs.yaml 2026-04-01 08:37:51,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:37:51,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:37:51,709 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95074bda3ec93a414f3/lava_callback.json.gz 2026-04-01 08:37:51,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:37:51,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95074bda3ec93a414f3 HTTP/1.1" 200 None 2026-04-01 08:37:51,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:37:51,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:37:51,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:37:51,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd95074bda3ec93a414f3 HTTP/1.1" 200 None 2026-04-01 08:37:51,836 - lava_callback - INFO - Completed processing callback for node 69ccd95074bda3ec93a414f3 INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:38:07,524 - lava_callback - INFO - Received callback for node 69ccd95074bda3ec93a414f6 INFO: 172.21.0.1:57888 - "POST /node/69ccd95074bda3ec93a414f6 HTTP/1.0" 202 Accepted 2026-04-01 08:38:07,590 - lava_callback - INFO - Starting async job submit for node 69ccd95074bda3ec93a414f6 2026-04-01 08:38:07,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:07,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95074bda3ec93a414f6 HTTP/1.1" 200 None 2026-04-01 08:38:07,663 - lava_callback - DEBUG - Processing node 69ccd95074bda3ec93a414f6: baseline-arm 2026-04-01 08:38:07,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:38:07,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:38:07,914 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95074bda3ec93a414f6/log.txt.gz 2026-04-01 08:38:07,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:38:08,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:38:08,245 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95074bda3ec93a414f6/lava-logs.yaml 2026-04-01 08:38:08,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:38:08,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:38:08,429 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95074bda3ec93a414f6/lava_callback.json.gz 2026-04-01 08:38:08,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:08,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95074bda3ec93a414f6 HTTP/1.1" 200 None 2026-04-01 08:38:08,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:08,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:38:08,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:08,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd95074bda3ec93a414f6 HTTP/1.1" 200 None 2026-04-01 08:38:08,514 - lava_callback - INFO - Completed processing callback for node 69ccd95074bda3ec93a414f6 INFO: 172.21.0.1:57894 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:38:14,006 - lava_callback - INFO - Received callback for node 69ccd95374bda3ec93a414ff INFO: 172.21.0.1:36920 - "POST /node/69ccd95374bda3ec93a414ff HTTP/1.0" 202 Accepted 2026-04-01 08:38:14,054 - lava_callback - INFO - Starting async job submit for node 69ccd95374bda3ec93a414ff 2026-04-01 08:38:14,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:14,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95374bda3ec93a414ff HTTP/1.1" 200 None 2026-04-01 08:38:14,087 - lava_callback - DEBUG - Processing node 69ccd95374bda3ec93a414ff: baseline-arm 2026-04-01 08:38:14,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:38:14,389 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:38:14,390 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95374bda3ec93a414ff/log.txt.gz 2026-04-01 08:38:14,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:38:14,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:38:14,664 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95374bda3ec93a414ff/lava-logs.yaml 2026-04-01 08:38:14,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:38:14,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:38:14,837 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95374bda3ec93a414ff/lava_callback.json.gz 2026-04-01 08:38:14,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:14,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95374bda3ec93a414ff HTTP/1.1" 200 None 2026-04-01 08:38:14,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:14,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:38:14,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:14,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd95374bda3ec93a414ff HTTP/1.1" 200 None 2026-04-01 08:38:14,933 - lava_callback - INFO - Completed processing callback for node 69ccd95374bda3ec93a414ff INFO: 172.21.0.1:36930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36942 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:38:17,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:17,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32806 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:38:52,423 - lava_callback - INFO - Received callback for node 69ccd95274bda3ec93a414fc INFO: 172.21.0.1:54440 - "POST /node/69ccd95274bda3ec93a414fc HTTP/1.0" 202 Accepted 2026-04-01 08:38:52,430 - lava_callback - INFO - Starting async job submit for node 69ccd95274bda3ec93a414fc 2026-04-01 08:38:52,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:52,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95274bda3ec93a414fc HTTP/1.1" 200 None 2026-04-01 08:38:52,476 - lava_callback - DEBUG - Processing node 69ccd95274bda3ec93a414fc: baseline-arm 2026-04-01 08:38:52,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:38:52,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:38:52,875 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95274bda3ec93a414fc/log.txt.gz 2026-04-01 08:38:53,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:38:53,423 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:38:53,425 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95274bda3ec93a414fc/lava-logs.yaml 2026-04-01 08:38:53,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:38:53,612 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:38:53,614 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95274bda3ec93a414fc/lava_callback.json.gz 2026-04-01 08:38:53,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:53,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95274bda3ec93a414fc HTTP/1.1" 200 None 2026-04-01 08:38:53,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:53,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:38:53,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:38:53,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd95274bda3ec93a414fc HTTP/1.1" 200 None 2026-04-01 08:38:53,725 - lava_callback - INFO - Completed processing callback for node 69ccd95274bda3ec93a414fc INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:39:02,331 - lava_callback - INFO - Received callback for node 69ccd96f74bda3ec93a4156f INFO: 172.21.0.1:40450 - "POST /node/69ccd96f74bda3ec93a4156f HTTP/1.0" 202 Accepted 2026-04-01 08:39:02,337 - lava_callback - INFO - Starting async job submit for node 69ccd96f74bda3ec93a4156f 2026-04-01 08:39:02,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:02,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd96f74bda3ec93a4156f HTTP/1.1" 200 None 2026-04-01 08:39:02,380 - lava_callback - DEBUG - Processing node 69ccd96f74bda3ec93a4156f: baseline-arm-pengutronix 2026-04-01 08:39:02,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:02,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:02,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd96f74bda3ec93a4156f/log.txt.gz 2026-04-01 08:39:02,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:02,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:02,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd96f74bda3ec93a4156f/lava-logs.yaml 2026-04-01 08:39:02,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:03,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:03,026 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd96f74bda3ec93a4156f/lava_callback.json.gz 2026-04-01 08:39:03,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:03,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd96f74bda3ec93a4156f HTTP/1.1" 200 None 2026-04-01 08:39:03,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:03,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:39:03,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:03,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd96f74bda3ec93a4156f HTTP/1.1" 200 None 2026-04-01 08:39:03,107 - lava_callback - INFO - Completed processing callback for node 69ccd96f74bda3ec93a4156f INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:39:08,622 - lava_callback - INFO - Received callback for node 69ccd94f74bda3ec93a414f0 INFO: 172.21.0.1:40482 - "POST /node/69ccd94f74bda3ec93a414f0 HTTP/1.0" 202 Accepted 2026-04-01 08:39:08,628 - lava_callback - INFO - Starting async job submit for node 69ccd94f74bda3ec93a414f0 2026-04-01 08:39:08,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:08,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd94f74bda3ec93a414f0 HTTP/1.1" 200 None INFO: 172.21.0.1:40492 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:39:08,673 - lava_callback - DEBUG - Processing node 69ccd94f74bda3ec93a414f0: baseline-arm 2026-04-01 08:39:08,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:08,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:08,990 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd94f74bda3ec93a414f0/log.txt.gz 2026-04-01 08:39:09,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:09,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:09,307 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd94f74bda3ec93a414f0/lava-logs.yaml 2026-04-01 08:39:09,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:09,451 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:09,453 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd94f74bda3ec93a414f0/lava_callback.json.gz 2026-04-01 08:39:09,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:09,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd94f74bda3ec93a414f0 HTTP/1.1" 200 None 2026-04-01 08:39:09,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:09,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:39:09,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:09,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd94f74bda3ec93a414f0 HTTP/1.1" 200 None 2026-04-01 08:39:09,547 - lava_callback - INFO - Completed processing callback for node 69ccd94f74bda3ec93a414f0 2026-04-01 08:39:09,779 - lava_callback - INFO - Received callback for node 69ccd95e74bda3ec93a41516 INFO: 172.21.0.1:57828 - "POST /node/69ccd95e74bda3ec93a41516 HTTP/1.0" 202 Accepted 2026-04-01 08:39:09,786 - lava_callback - INFO - Starting async job submit for node 69ccd95e74bda3ec93a41516 2026-04-01 08:39:09,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:09,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95e74bda3ec93a41516 HTTP/1.1" 200 None 2026-04-01 08:39:09,836 - lava_callback - DEBUG - Processing node 69ccd95e74bda3ec93a41516: baseline-arm-broonie 2026-04-01 08:39:10,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:10,183 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:10,185 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd95e74bda3ec93a41516/log.txt.gz 2026-04-01 08:39:10,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:10,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:10,515 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd95e74bda3ec93a41516/lava-logs.yaml 2026-04-01 08:39:10,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:10,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:10,723 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd95e74bda3ec93a41516/lava_callback.json.gz 2026-04-01 08:39:10,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:10,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95e74bda3ec93a41516 HTTP/1.1" 200 None 2026-04-01 08:39:10,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:10,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:39:10,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:10,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd95e74bda3ec93a41516 HTTP/1.1" 200 None 2026-04-01 08:39:10,807 - lava_callback - INFO - Completed processing callback for node 69ccd95e74bda3ec93a41516 2026-04-01 08:39:11,312 - lava_callback - INFO - Received callback for node 69ccd95f74bda3ec93a4151f INFO: 172.21.0.1:57832 - "POST /node/69ccd95f74bda3ec93a4151f HTTP/1.0" 202 Accepted 2026-04-01 08:39:11,318 - lava_callback - INFO - Starting async job submit for node 69ccd95f74bda3ec93a4151f 2026-04-01 08:39:11,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:11,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95f74bda3ec93a4151f HTTP/1.1" 200 None 2026-04-01 08:39:11,355 - lava_callback - DEBUG - Processing node 69ccd95f74bda3ec93a4151f: baseline-arm-broonie 2026-04-01 08:39:11,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:11,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:11,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd95f74bda3ec93a4151f/log.txt.gz 2026-04-01 08:39:11,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:11,930 - lava_callback - INFO - Received callback for node 69ccd97374bda3ec93a4157c 2026-04-01 08:39:11,977 - lava_callback - INFO - Starting async job submit for node 69ccd97374bda3ec93a4157c INFO: 172.21.0.1:57842 - "POST /node/69ccd97374bda3ec93a4157c HTTP/1.0" 202 Accepted 2026-04-01 08:39:11,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:11,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:12,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd95f74bda3ec93a4151f/lava-logs.yaml 2026-04-01 08:39:12,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:12,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd97374bda3ec93a4157c HTTP/1.1" 200 None 2026-04-01 08:39:12,017 - lava_callback - DEBUG - Processing node 69ccd97374bda3ec93a4157c: baseline-arm-pengutronix 2026-04-01 08:39:12,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:12,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:12,169 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd95f74bda3ec93a4151f/lava_callback.json.gz 2026-04-01 08:39:12,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:12,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95f74bda3ec93a4151f HTTP/1.1" 200 None 2026-04-01 08:39:12,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:12,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:39:12,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:12,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd95f74bda3ec93a4151f HTTP/1.1" 200 None 2026-04-01 08:39:12,260 - lava_callback - INFO - Completed processing callback for node 69ccd95f74bda3ec93a4151f 2026-04-01 08:39:12,317 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:12,319 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd97374bda3ec93a4157c/log.txt.gz 2026-04-01 08:39:12,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:12,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:12,602 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd97374bda3ec93a4157c/lava-logs.yaml 2026-04-01 08:39:12,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:12,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:12,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd97374bda3ec93a4157c/lava_callback.json.gz 2026-04-01 08:39:12,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:12,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd97374bda3ec93a4157c HTTP/1.1" 200 None 2026-04-01 08:39:12,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:12,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:39:12,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:12,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd97374bda3ec93a4157c HTTP/1.1" 200 None 2026-04-01 08:39:12,853 - lava_callback - INFO - Completed processing callback for node 69ccd97374bda3ec93a4157c INFO: 172.21.0.1:57856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:39:17,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:17,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:39:33,350 - lava_callback - INFO - Received callback for node 69ccd96174bda3ec93a4153f INFO: 172.21.0.1:36542 - "POST /node/69ccd96174bda3ec93a4153f HTTP/1.0" 202 Accepted 2026-04-01 08:39:33,356 - lava_callback - INFO - Starting async job submit for node 69ccd96174bda3ec93a4153f 2026-04-01 08:39:33,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:33,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd96174bda3ec93a4153f HTTP/1.1" 200 None 2026-04-01 08:39:33,392 - lava_callback - DEBUG - Processing node 69ccd96174bda3ec93a4153f: baseline-arm-broonie 2026-04-01 08:39:33,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:33,746 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:33,748 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd96174bda3ec93a4153f/log.txt.gz 2026-04-01 08:39:33,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:34,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:34,154 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd96174bda3ec93a4153f/lava-logs.yaml 2026-04-01 08:39:34,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:34,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:34,301 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd96174bda3ec93a4153f/lava_callback.json.gz 2026-04-01 08:39:34,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:34,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd96174bda3ec93a4153f HTTP/1.1" 200 None 2026-04-01 08:39:34,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:34,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:39:34,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:34,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd96174bda3ec93a4153f HTTP/1.1" 200 None 2026-04-01 08:39:34,385 - lava_callback - INFO - Completed processing callback for node 69ccd96174bda3ec93a4153f INFO: 172.21.0.1:36554 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:39:43,347 - lava_callback - INFO - Received callback for node 69ccd96674bda3ec93a41552 INFO: 172.21.0.1:45664 - "POST /node/69ccd96674bda3ec93a41552 HTTP/1.0" 202 Accepted 2026-04-01 08:39:43,353 - lava_callback - INFO - Starting async job submit for node 69ccd96674bda3ec93a41552 2026-04-01 08:39:43,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:43,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd96674bda3ec93a41552 HTTP/1.1" 200 None 2026-04-01 08:39:43,422 - lava_callback - DEBUG - Processing node 69ccd96674bda3ec93a41552: baseline-arm-clabbe 2026-04-01 08:39:43,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:43,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:43,758 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ccd96674bda3ec93a41552/log.txt.gz 2026-04-01 08:39:43,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:44,068 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:44,070 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ccd96674bda3ec93a41552/lava-logs.yaml 2026-04-01 08:39:44,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:44,236 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:44,238 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ccd96674bda3ec93a41552/lava_callback.json.gz 2026-04-01 08:39:44,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:44,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd96674bda3ec93a41552 HTTP/1.1" 200 None 2026-04-01 08:39:44,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:44,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:39:44,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:44,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd96674bda3ec93a41552 HTTP/1.1" 200 None 2026-04-01 08:39:44,326 - lava_callback - INFO - Completed processing callback for node 69ccd96674bda3ec93a41552 INFO: 172.21.0.1:45680 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:39:47,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:47,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:39:55,291 - lava_callback - INFO - Received callback for node 69ccd95d74bda3ec93a41513 INFO: 172.21.0.1:58602 - "POST /node/69ccd95d74bda3ec93a41513 HTTP/1.0" 202 Accepted 2026-04-01 08:39:55,301 - lava_callback - INFO - Starting async job submit for node 69ccd95d74bda3ec93a41513 2026-04-01 08:39:55,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:55,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95d74bda3ec93a41513 HTTP/1.1" 200 None 2026-04-01 08:39:55,350 - lava_callback - DEBUG - Processing node 69ccd95d74bda3ec93a41513: baseline-arm-broonie 2026-04-01 08:39:55,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:55,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:55,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd95d74bda3ec93a41513/log.txt.gz 2026-04-01 08:39:55,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:56,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:56,010 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd95d74bda3ec93a41513/lava-logs.yaml 2026-04-01 08:39:56,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:56,152 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:56,154 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ccd95d74bda3ec93a41513/lava_callback.json.gz 2026-04-01 08:39:56,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:56,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95d74bda3ec93a41513 HTTP/1.1" 200 None 2026-04-01 08:39:56,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:56,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:39:56,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:56,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd95d74bda3ec93a41513 HTTP/1.1" 200 None 2026-04-01 08:39:56,246 - lava_callback - INFO - Completed processing callback for node 69ccd95d74bda3ec93a41513 INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:39:58,533 - lava_callback - INFO - Received callback for node 69ccd9cb74bda3ec93a4163f INFO: 172.21.0.1:58620 - "POST /node/69ccd9cb74bda3ec93a4163f HTTP/1.0" 202 Accepted 2026-04-01 08:39:58,539 - lava_callback - INFO - Starting async job submit for node 69ccd9cb74bda3ec93a4163f 2026-04-01 08:39:58,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:58,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd9cb74bda3ec93a4163f HTTP/1.1" 200 None 2026-04-01 08:39:58,561 - lava_callback - DEBUG - Processing node 69ccd9cb74bda3ec93a4163f: baseline-arm 2026-04-01 08:39:58,567 - lava_callback - WARNING - Failed to upload log 2026-04-01 08:39:58,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:58,696 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:58,698 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd9cb74bda3ec93a4163f/lava-logs.yaml 2026-04-01 08:39:58,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:39:58,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:39:58,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd9cb74bda3ec93a4163f/lava_callback.json.gz 2026-04-01 08:39:58,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:58,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd9cb74bda3ec93a4163f HTTP/1.1" 200 None 2026-04-01 08:39:58,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:58,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:39:58,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:39:58,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd9cb74bda3ec93a4163f HTTP/1.1" 200 None 2026-04-01 08:39:58,908 - lava_callback - INFO - Completed processing callback for node 69ccd9cb74bda3ec93a4163f 2026-04-01 08:40:01,475 - lava_callback - INFO - Received callback for node 69ccd97074bda3ec93a41576 INFO: 172.21.0.1:52820 - "POST /node/69ccd97074bda3ec93a41576 HTTP/1.0" 202 Accepted 2026-04-01 08:40:01,481 - lava_callback - INFO - Starting async job submit for node 69ccd97074bda3ec93a41576 2026-04-01 08:40:01,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:01,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd97074bda3ec93a41576 HTTP/1.1" 200 None 2026-04-01 08:40:01,522 - lava_callback - DEBUG - Processing node 69ccd97074bda3ec93a41576: baseline-arm-pengutronix 2026-04-01 08:40:01,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:40:01,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:40:01,937 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd97074bda3ec93a41576/log.txt.gz 2026-04-01 08:40:02,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:40:02,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:40:02,398 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd97074bda3ec93a41576/lava-logs.yaml 2026-04-01 08:40:02,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:40:02,544 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:40:02,546 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd97074bda3ec93a41576/lava_callback.json.gz 2026-04-01 08:40:02,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:02,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd97074bda3ec93a41576 HTTP/1.1" 200 None 2026-04-01 08:40:02,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:02,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:40:02,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:02,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd97074bda3ec93a41576 HTTP/1.1" 200 None 2026-04-01 08:40:02,697 - lava_callback - INFO - Completed processing callback for node 69ccd97074bda3ec93a41576 INFO: 172.21.0.1:52828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43420 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:40:17,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:17,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:40:19,287 - lava_callback - INFO - Received callback for node 69ccd98974bda3ec93a415bc INFO: 172.21.0.1:43436 - "POST /node/69ccd98974bda3ec93a415bc HTTP/1.0" 202 Accepted 2026-04-01 08:40:19,293 - lava_callback - INFO - Starting async job submit for node 69ccd98974bda3ec93a415bc 2026-04-01 08:40:19,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:19,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98974bda3ec93a415bc HTTP/1.1" 200 None 2026-04-01 08:40:19,332 - lava_callback - DEBUG - Processing node 69ccd98974bda3ec93a415bc: ltp-dio 2026-04-01 08:40:19,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:40:19,860 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:40:19,862 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69ccd98974bda3ec93a415bc/log.txt.gz 2026-04-01 08:40:20,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:40:20,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:40:20,289 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69ccd98974bda3ec93a415bc/lava-logs.yaml 2026-04-01 08:40:20,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:40:20,447 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:40:20,449 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69ccd98974bda3ec93a415bc/lava_callback.json.gz 2026-04-01 08:40:20,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:20,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98974bda3ec93a415bc HTTP/1.1" 200 None 2026-04-01 08:40:20,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:20,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:40:20,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:20,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd98974bda3ec93a415bc HTTP/1.1" 200 None 2026-04-01 08:40:20,567 - lava_callback - INFO - Completed processing callback for node 69ccd98974bda3ec93a415bc INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:40:27,966 - lava_callback - INFO - Received callback for node 69ca36ed0e33d030878a88a6 INFO: 172.21.0.1:50940 - "POST /node/69ca36ed0e33d030878a88a6 HTTP/1.0" 202 Accepted 2026-04-01 08:40:27,975 - lava_callback - INFO - Starting async job submit for node 69ca36ed0e33d030878a88a6 2026-04-01 08:40:27,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:27,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca36ed0e33d030878a88a6 HTTP/1.1" 200 None 2026-04-01 08:40:28,000 - lava_callback - DEBUG - Processing node 69ca36ed0e33d030878a88a6: baseline-arm-clabbe 2026-04-01 08:40:28,000 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca36ed0e33d030878a88a6 2026-04-01 08:40:28,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:28,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca36ed0e33d030878a88a6 HTTP/1.1" 200 None 2026-04-01 08:40:28,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:28,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 08:40:28,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:28,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca36ed0e33d030878a88a6 HTTP/1.1" 200 None 2026-04-01 08:40:28,089 - lava_callback - ERROR - Error processing callback for node 69ca36ed0e33d030878a88a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:40:47,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:40:47,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44396 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:41:07,957 - lava_callback - INFO - Received callback for node 69ca37120e33d030878a88b7 INFO: 172.21.0.1:44412 - "POST /node/69ca37120e33d030878a88b7 HTTP/1.0" 202 Accepted 2026-04-01 08:41:07,966 - lava_callback - INFO - Starting async job submit for node 69ca37120e33d030878a88b7 2026-04-01 08:41:07,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:07,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37120e33d030878a88b7 HTTP/1.1" 200 None 2026-04-01 08:41:07,984 - lava_callback - DEBUG - Processing node 69ca37120e33d030878a88b7: baseline-arm-clabbe 2026-04-01 08:41:07,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca37120e33d030878a88b7 2026-04-01 08:41:07,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:07,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37120e33d030878a88b7 HTTP/1.1" 200 None 2026-04-01 08:41:08,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:08,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 08:41:08,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:08,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca37120e33d030878a88b7 HTTP/1.1" 200 None 2026-04-01 08:41:08,045 - lava_callback - ERROR - Error processing callback for node 69ca37120e33d030878a88b7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37014 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:41:30,365 - lava_callback - INFO - Received callback for node 69ccd96974bda3ec93a4155e INFO: 172.21.0.1:43194 - "POST /node/69ccd96974bda3ec93a4155e HTTP/1.0" 202 Accepted 2026-04-01 08:41:30,375 - lava_callback - INFO - Starting async job submit for node 69ccd96974bda3ec93a4155e 2026-04-01 08:41:30,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:30,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd96974bda3ec93a4155e HTTP/1.1" 200 None 2026-04-01 08:41:30,451 - lava_callback - DEBUG - Processing node 69ccd96974bda3ec93a4155e: baseline-arm-clabbe 2026-04-01 08:41:30,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:41:30,883 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:41:30,885 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ccd96974bda3ec93a4155e/log.txt.gz 2026-04-01 08:41:31,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:41:31,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:41:31,400 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ccd96974bda3ec93a4155e/lava-logs.yaml 2026-04-01 08:41:31,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:41:31,600 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:41:31,601 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ccd96974bda3ec93a4155e/lava_callback.json.gz 2026-04-01 08:41:31,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:31,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd96974bda3ec93a4155e HTTP/1.1" 200 None 2026-04-01 08:41:31,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:31,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:41:31,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:31,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd96974bda3ec93a4155e HTTP/1.1" 200 None 2026-04-01 08:41:31,705 - lava_callback - INFO - Completed processing callback for node 69ccd96974bda3ec93a4155e INFO: 172.21.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:41:47,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:47,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:41:48,166 - lava_callback - INFO - Received callback for node 69ca373a0e33d030878a88c4 INFO: 172.21.0.1:37268 - "POST /node/69ca373a0e33d030878a88c4 HTTP/1.0" 202 Accepted 2026-04-01 08:41:48,176 - lava_callback - INFO - Starting async job submit for node 69ca373a0e33d030878a88c4 2026-04-01 08:41:48,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:48,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca373a0e33d030878a88c4 HTTP/1.1" 200 None 2026-04-01 08:41:48,205 - lava_callback - DEBUG - Processing node 69ca373a0e33d030878a88c4: baseline-arm-clabbe 2026-04-01 08:41:48,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca373a0e33d030878a88c4 2026-04-01 08:41:48,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:48,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca373a0e33d030878a88c4 HTTP/1.1" 200 None 2026-04-01 08:41:48,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:48,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 08:41:48,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:41:48,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca373a0e33d030878a88c4 HTTP/1.1" 200 None 2026-04-01 08:41:48,321 - lava_callback - ERROR - Error processing callback for node 69ca373a0e33d030878a88c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49246 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:42:24,826 - lava_callback - INFO - Received callback for node 69ca376e0e33d030878a88f9 INFO: 172.21.0.1:49902 - "POST /node/69ca376e0e33d030878a88f9 HTTP/1.0" 202 Accepted 2026-04-01 08:42:24,837 - lava_callback - INFO - Starting async job submit for node 69ca376e0e33d030878a88f9 2026-04-01 08:42:24,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:24,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca376e0e33d030878a88f9 HTTP/1.1" 200 None 2026-04-01 08:42:24,870 - lava_callback - DEBUG - Processing node 69ca376e0e33d030878a88f9: baseline-arm-baylibre 2026-04-01 08:42:24,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca376e0e33d030878a88f9 2026-04-01 08:42:24,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:24,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca376e0e33d030878a88f9 HTTP/1.1" 200 None 2026-04-01 08:42:24,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:24,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 08:42:24,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:24,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca376e0e33d030878a88f9 HTTP/1.1" 200 None 2026-04-01 08:42:24,985 - lava_callback - ERROR - Error processing callback for node 69ca376e0e33d030878a88f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49904 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:42:28,064 - lava_callback - INFO - Received callback for node 69ca37620e33d030878a88d3 INFO: 172.21.0.1:49912 - "POST /node/69ca37620e33d030878a88d3 HTTP/1.0" 202 Accepted 2026-04-01 08:42:28,072 - lava_callback - INFO - Starting async job submit for node 69ca37620e33d030878a88d3 2026-04-01 08:42:28,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:28,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37620e33d030878a88d3 HTTP/1.1" 200 None 2026-04-01 08:42:28,104 - lava_callback - DEBUG - Processing node 69ca37620e33d030878a88d3: baseline-arm-clabbe 2026-04-01 08:42:28,104 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca37620e33d030878a88d3 2026-04-01 08:42:28,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:28,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37620e33d030878a88d3 HTTP/1.1" 200 None 2026-04-01 08:42:28,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:28,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 08:42:28,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:28,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca37620e33d030878a88d3 HTTP/1.1" 200 None 2026-04-01 08:42:28,212 - lava_callback - ERROR - Error processing callback for node 69ca37620e33d030878a88d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:42:30,499 - lava_callback - INFO - Received callback for node 69ccd98374bda3ec93a415ac INFO: 172.21.0.1:41640 - "POST /node/69ccd98374bda3ec93a415ac HTTP/1.0" 202 Accepted 2026-04-01 08:42:30,510 - lava_callback - INFO - Starting async job submit for node 69ccd98374bda3ec93a415ac 2026-04-01 08:42:30,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:30,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98374bda3ec93a415ac HTTP/1.1" 200 None 2026-04-01 08:42:30,604 - lava_callback - DEBUG - Processing node 69ccd98374bda3ec93a415ac: ltp-cap_bounds 2026-04-01 08:42:31,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:42:31,722 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:42:31,724 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ccd98374bda3ec93a415ac/log.txt.gz 2026-04-01 08:42:32,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:42:33,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:42:33,151 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ccd98374bda3ec93a415ac/lava-logs.yaml 2026-04-01 08:42:33,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:42:33,693 - lava_callback - INFO - Received callback for node 69ccd98674bda3ec93a415b6 INFO: 172.21.0.1:41642 - "POST /node/69ccd98674bda3ec93a415b6 HTTP/1.0" 202 Accepted 2026-04-01 08:42:33,707 - lava_callback - INFO - Starting async job submit for node 69ccd98674bda3ec93a415b6 2026-04-01 08:42:33,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:33,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98674bda3ec93a415b6 HTTP/1.1" 200 None 2026-04-01 08:42:33,787 - lava_callback - DEBUG - Processing node 69ccd98674bda3ec93a415b6: ltp-controllers 2026-04-01 08:42:34,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:42:34,131 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ccd98374bda3ec93a415ac/lava_callback.json.gz 2026-04-01 08:42:34,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:34,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98374bda3ec93a415ac HTTP/1.1" 200 None 2026-04-01 08:42:34,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:34,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:42:34,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:34,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd98374bda3ec93a415ac HTTP/1.1" 200 None 2026-04-01 08:42:34,491 - lava_callback - INFO - Completed processing callback for node 69ccd98374bda3ec93a415ac 2026-04-01 08:42:34,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:42:35,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:42:35,739 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69ccd98674bda3ec93a415b6/log.txt.gz 2026-04-01 08:42:36,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:41648 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:42:37,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:42:37,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69ccd98674bda3ec93a415b6/lava-logs.yaml 2026-04-01 08:42:37,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:42:38,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:42:38,022 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69ccd98674bda3ec93a415b6/lava_callback.json.gz 2026-04-01 08:42:38,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:38,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98674bda3ec93a415b6 HTTP/1.1" 200 None 2026-04-01 08:42:38,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:38,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:42:38,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:38,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd98674bda3ec93a415b6 HTTP/1.1" 200 None 2026-04-01 08:42:38,176 - lava_callback - INFO - Completed processing callback for node 69ccd98674bda3ec93a415b6 2026-04-01 08:42:44,805 - lava_callback - INFO - Received callback for node 69ca37720e33d030878a8904 INFO: 172.21.0.1:38794 - "POST /node/69ca37720e33d030878a8904 HTTP/1.0" 202 Accepted 2026-04-01 08:42:44,817 - lava_callback - INFO - Starting async job submit for node 69ca37720e33d030878a8904 2026-04-01 08:42:44,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:44,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37720e33d030878a8904 HTTP/1.1" 200 None 2026-04-01 08:42:44,849 - lava_callback - DEBUG - Processing node 69ca37720e33d030878a8904: baseline-arm-baylibre 2026-04-01 08:42:44,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca37720e33d030878a8904 2026-04-01 08:42:44,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:44,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37720e33d030878a8904 HTTP/1.1" 200 None 2026-04-01 08:42:44,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:44,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 08:42:44,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:44,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca37720e33d030878a8904 HTTP/1.1" 200 None 2026-04-01 08:42:44,934 - lava_callback - ERROR - Error processing callback for node 69ca37720e33d030878a8904: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:42:45,480 - lava_callback - INFO - Received callback for node 69ca37730e33d030878a8907 INFO: 172.21.0.1:38802 - "POST /node/69ca37730e33d030878a8907 HTTP/1.0" 202 Accepted 2026-04-01 08:42:45,491 - lava_callback - INFO - Starting async job submit for node 69ca37730e33d030878a8907 2026-04-01 08:42:45,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:45,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37730e33d030878a8907 HTTP/1.1" 200 None 2026-04-01 08:42:45,521 - lava_callback - DEBUG - Processing node 69ca37730e33d030878a8907: baseline-arm-baylibre 2026-04-01 08:42:45,521 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca37730e33d030878a8907 2026-04-01 08:42:45,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:45,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37730e33d030878a8907 HTTP/1.1" 200 None 2026-04-01 08:42:45,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:45,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 08:42:45,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:45,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca37730e33d030878a8907 HTTP/1.1" 200 None 2026-04-01 08:42:45,639 - lava_callback - ERROR - Error processing callback for node 69ca37730e33d030878a8907: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:42:47,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:47,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:42:48,016 - lava_callback - INFO - Received callback for node 69ca377b0e33d030878a891c INFO: 172.21.0.1:38828 - "POST /node/69ca377b0e33d030878a891c HTTP/1.0" 202 Accepted 2026-04-01 08:42:48,036 - lava_callback - INFO - Starting async job submit for node 69ca377b0e33d030878a891c 2026-04-01 08:42:48,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:48,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca377b0e33d030878a891c HTTP/1.1" 200 None 2026-04-01 08:42:48,075 - lava_callback - DEBUG - Processing node 69ca377b0e33d030878a891c: baseline-arm-clabbe 2026-04-01 08:42:48,075 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca377b0e33d030878a891c 2026-04-01 08:42:48,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:48,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca377b0e33d030878a891c HTTP/1.1" 200 None 2026-04-01 08:42:48,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:48,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 08:42:48,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:48,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca377b0e33d030878a891c HTTP/1.1" 200 None 2026-04-01 08:42:48,190 - lava_callback - ERROR - Error processing callback for node 69ca377b0e33d030878a891c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:42:48,704 - lava_callback - INFO - Received callback for node 69ca377f0e33d030878a892c INFO: 172.21.0.1:38832 - "POST /node/69ca377f0e33d030878a892c HTTP/1.0" 202 Accepted 2026-04-01 08:42:48,713 - lava_callback - INFO - Starting async job submit for node 69ca377f0e33d030878a892c 2026-04-01 08:42:48,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:48,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca377f0e33d030878a892c HTTP/1.1" 200 None 2026-04-01 08:42:48,743 - lava_callback - DEBUG - Processing node 69ca377f0e33d030878a892c: baseline-arm-clabbe 2026-04-01 08:42:48,743 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca377f0e33d030878a892c 2026-04-01 08:42:48,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:48,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca377f0e33d030878a892c HTTP/1.1" 200 None 2026-04-01 08:42:48,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:48,806 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 08:42:48,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:48,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca377f0e33d030878a892c HTTP/1.1" 200 None 2026-04-01 08:42:48,847 - lava_callback - ERROR - Error processing callback for node 69ca377f0e33d030878a892c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:42:49,367 - lava_callback - INFO - Received callback for node 69ca37800e33d030878a892f INFO: 172.21.0.1:38836 - "POST /node/69ca37800e33d030878a892f HTTP/1.0" 202 Accepted 2026-04-01 08:42:49,376 - lava_callback - INFO - Starting async job submit for node 69ca37800e33d030878a892f 2026-04-01 08:42:49,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:49,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37800e33d030878a892f HTTP/1.1" 200 None 2026-04-01 08:42:49,406 - lava_callback - DEBUG - Processing node 69ca37800e33d030878a892f: baseline-arm-clabbe 2026-04-01 08:42:49,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca37800e33d030878a892f 2026-04-01 08:42:49,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:49,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37800e33d030878a892f HTTP/1.1" 200 None 2026-04-01 08:42:49,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:49,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 08:42:49,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:49,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca37800e33d030878a892f HTTP/1.1" 200 None 2026-04-01 08:42:49,502 - lava_callback - ERROR - Error processing callback for node 69ca37800e33d030878a892f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:42:50,749 - lava_callback - INFO - Received callback for node 69ca37810e33d030878a8932 INFO: 172.21.0.1:51538 - "POST /node/69ca37810e33d030878a8932 HTTP/1.0" 202 Accepted 2026-04-01 08:42:50,758 - lava_callback - INFO - Starting async job submit for node 69ca37810e33d030878a8932 2026-04-01 08:42:50,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:50,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37810e33d030878a8932 HTTP/1.1" 200 None 2026-04-01 08:42:50,789 - lava_callback - DEBUG - Processing node 69ca37810e33d030878a8932: baseline-arm-clabbe 2026-04-01 08:42:50,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca37810e33d030878a8932 2026-04-01 08:42:50,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:50,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37810e33d030878a8932 HTTP/1.1" 200 None 2026-04-01 08:42:50,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:50,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 08:42:50,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:50,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca37810e33d030878a8932 HTTP/1.1" 200 None 2026-04-01 08:42:50,887 - lava_callback - ERROR - Error processing callback for node 69ca37810e33d030878a8932: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:42:52,580 - lava_callback - INFO - Received callback for node 69ca37830e33d030878a895f INFO: 172.21.0.1:51542 - "POST /node/69ca37830e33d030878a895f HTTP/1.0" 202 Accepted 2026-04-01 08:42:52,589 - lava_callback - INFO - Starting async job submit for node 69ca37830e33d030878a895f 2026-04-01 08:42:52,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:52,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37830e33d030878a895f HTTP/1.1" 200 None 2026-04-01 08:42:52,618 - lava_callback - DEBUG - Processing node 69ca37830e33d030878a895f: baseline-arm-clabbe 2026-04-01 08:42:52,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca37830e33d030878a895f 2026-04-01 08:42:52,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:52,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37830e33d030878a895f HTTP/1.1" 200 None 2026-04-01 08:42:52,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:52,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 08:42:52,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:52,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca37830e33d030878a895f HTTP/1.1" 200 None 2026-04-01 08:42:52,719 - lava_callback - ERROR - Error processing callback for node 69ca37830e33d030878a895f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:42:53,944 - lava_callback - INFO - Received callback for node 69ccd98474bda3ec93a415af INFO: 172.21.0.1:51554 - "POST /node/69ccd98474bda3ec93a415af HTTP/1.0" 202 Accepted 2026-04-01 08:42:53,954 - lava_callback - INFO - Starting async job submit for node 69ccd98474bda3ec93a415af 2026-04-01 08:42:54,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:54,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98474bda3ec93a415af HTTP/1.1" 200 None 2026-04-01 08:42:54,041 - lava_callback - DEBUG - Processing node 69ccd98474bda3ec93a415af: ltp-containers 2026-04-01 08:42:54,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:42:55,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:42:55,337 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69ccd98474bda3ec93a415af/log.txt.gz 2026-04-01 08:42:55,591 - lava_callback - INFO - Received callback for node 69ccd99674bda3ec93a415d4 INFO: 172.21.0.1:51560 - "POST /node/69ccd99674bda3ec93a415d4 HTTP/1.0" 202 Accepted 2026-04-01 08:42:55,607 - lava_callback - INFO - Starting async job submit for node 69ccd99674bda3ec93a415d4 2026-04-01 08:42:55,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:55,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99674bda3ec93a415d4 HTTP/1.1" 200 None 2026-04-01 08:42:55,774 - lava_callback - DEBUG - Processing node 69ccd99674bda3ec93a415d4: ltp-syscalls 2026-04-01 08:42:56,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51582 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:42:57,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:42:57,330 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69ccd98474bda3ec93a415af/lava-logs.yaml 2026-04-01 08:42:57,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:42:57,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:42:58,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:42:58,054 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ccd99674bda3ec93a415d4/log.txt.gz 2026-04-01 08:42:58,210 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:42:58,212 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69ccd98474bda3ec93a415af/lava_callback.json.gz 2026-04-01 08:42:58,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:58,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98474bda3ec93a415af HTTP/1.1" 200 None 2026-04-01 08:42:58,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:58,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:42:58,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:42:58,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd98474bda3ec93a415af HTTP/1.1" 200 None 2026-04-01 08:42:58,550 - lava_callback - INFO - Completed processing callback for node 69ccd98474bda3ec93a415af 2026-04-01 08:42:58,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:43:00,142 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:43:00,145 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ccd99674bda3ec93a415d4/lava-logs.yaml 2026-04-01 08:43:00,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:43:00,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:43:00,962 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ccd99674bda3ec93a415d4/lava_callback.json.gz 2026-04-01 08:43:01,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:01,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99674bda3ec93a415d4 HTTP/1.1" 200 None 2026-04-01 08:43:01,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:01,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:43:01,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:01,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd99674bda3ec93a415d4 HTTP/1.1" 200 None 2026-04-01 08:43:01,119 - lava_callback - INFO - Completed processing callback for node 69ccd99674bda3ec93a415d4 INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:43:08,093 - lava_callback - INFO - Received callback for node 69ca37890e33d030878a8972 INFO: 172.21.0.1:35388 - "POST /node/69ca37890e33d030878a8972 HTTP/1.0" 202 Accepted 2026-04-01 08:43:08,102 - lava_callback - INFO - Starting async job submit for node 69ca37890e33d030878a8972 2026-04-01 08:43:08,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:08,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37890e33d030878a8972 HTTP/1.1" 200 None 2026-04-01 08:43:08,130 - lava_callback - DEBUG - Processing node 69ca37890e33d030878a8972: baseline-arm-clabbe 2026-04-01 08:43:08,130 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca37890e33d030878a8972 2026-04-01 08:43:08,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:08,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca37890e33d030878a8972 HTTP/1.1" 200 None 2026-04-01 08:43:08,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:08,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 08:43:08,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:08,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca37890e33d030878a8972 HTTP/1.1" 200 None 2026-04-01 08:43:08,249 - lava_callback - ERROR - Error processing callback for node 69ca37890e33d030878a8972: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40214 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:43:17,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:17,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51530 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:43:29,474 - lava_callback - INFO - Received callback for node 69ccd96a74bda3ec93a41561 INFO: 172.21.0.1:51544 - "POST /node/69ccd96a74bda3ec93a41561 HTTP/1.0" 202 Accepted 2026-04-01 08:43:29,482 - lava_callback - INFO - Starting async job submit for node 69ccd96a74bda3ec93a41561 2026-04-01 08:43:29,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:29,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd96a74bda3ec93a41561 HTTP/1.1" 200 None 2026-04-01 08:43:29,531 - lava_callback - DEBUG - Processing node 69ccd96a74bda3ec93a41561: baseline-arm-clabbe 2026-04-01 08:43:29,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:43:30,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:43:30,127 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ccd96a74bda3ec93a41561/log.txt.gz 2026-04-01 08:43:30,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:43:30,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:43:30,773 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ccd96a74bda3ec93a41561/lava-logs.yaml 2026-04-01 08:43:30,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:43:31,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:43:31,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ccd96a74bda3ec93a41561/lava_callback.json.gz 2026-04-01 08:43:31,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:31,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd96a74bda3ec93a41561 HTTP/1.1" 200 None 2026-04-01 08:43:31,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:31,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:43:31,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:31,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd96a74bda3ec93a41561 HTTP/1.1" 200 None 2026-04-01 08:43:31,151 - lava_callback - INFO - Completed processing callback for node 69ccd96a74bda3ec93a41561 INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42516 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:43:47,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:47,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:43:53,774 - lava_callback - INFO - Received callback for node 69ccd98874bda3ec93a415b9 INFO: 172.21.0.1:59770 - "POST /node/69ccd98874bda3ec93a415b9 HTTP/1.0" 202 Accepted 2026-04-01 08:43:53,782 - lava_callback - INFO - Starting async job submit for node 69ccd98874bda3ec93a415b9 2026-04-01 08:43:53,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:53,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98874bda3ec93a415b9 HTTP/1.1" 200 None 2026-04-01 08:43:53,835 - lava_callback - DEBUG - Processing node 69ccd98874bda3ec93a415b9: ltp-cve 2026-04-01 08:43:54,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:43:54,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:43:54,540 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69ccd98874bda3ec93a415b9/log.txt.gz 2026-04-01 08:43:54,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:43:55,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:43:55,224 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69ccd98874bda3ec93a415b9/lava-logs.yaml 2026-04-01 08:43:55,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:43:55,642 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:43:55,644 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69ccd98874bda3ec93a415b9/lava_callback.json.gz 2026-04-01 08:43:55,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:55,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98874bda3ec93a415b9 HTTP/1.1" 200 None 2026-04-01 08:43:55,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:55,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:43:55,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:43:55,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd98874bda3ec93a415b9 HTTP/1.1" 200 None 2026-04-01 08:43:55,781 - lava_callback - INFO - Completed processing callback for node 69ccd98874bda3ec93a415b9 INFO: 172.21.0.1:59776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52292 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:44:17,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:44:17,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43838 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:44:40,383 - lava_callback - INFO - Received callback for node 69ccdad974bda3ec93a41726 INFO: 172.21.0.1:37590 - "POST /node/69ccdad974bda3ec93a41726 HTTP/1.0" 202 Accepted 2026-04-01 08:44:40,388 - lava_callback - INFO - Starting async job submit for node 69ccdad974bda3ec93a41726 2026-04-01 08:44:40,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:44:40,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdad974bda3ec93a41726 HTTP/1.1" 200 None 2026-04-01 08:44:40,407 - lava_callback - DEBUG - Processing node 69ccdad974bda3ec93a41726: baseline-arm 2026-04-01 08:44:40,412 - lava_callback - WARNING - Failed to upload log 2026-04-01 08:44:40,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:44:40,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:44:40,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccdad974bda3ec93a41726/lava-logs.yaml 2026-04-01 08:44:40,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:44:40,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:44:40,736 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccdad974bda3ec93a41726/lava_callback.json.gz 2026-04-01 08:44:40,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:44:40,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdad974bda3ec93a41726 HTTP/1.1" 200 None 2026-04-01 08:44:40,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:44:40,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:44:40,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:44:40,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdad974bda3ec93a41726 HTTP/1.1" 200 None 2026-04-01 08:44:40,803 - lava_callback - INFO - Completed processing callback for node 69ccdad974bda3ec93a41726 INFO: 172.21.0.1:37596 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:44:47,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:44:47,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50414 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:45:57,085 - lava_callback - INFO - Received callback for node 69ccdb0874bda3ec93a4173e INFO: 172.21.0.1:50418 - "POST /node/69ccdb0874bda3ec93a4173e HTTP/1.0" 202 Accepted 2026-04-01 08:45:57,092 - lava_callback - INFO - Starting async job submit for node 69ccdb0874bda3ec93a4173e 2026-04-01 08:45:57,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:45:57,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb0874bda3ec93a4173e HTTP/1.1" 200 None 2026-04-01 08:45:57,133 - lava_callback - DEBUG - Processing node 69ccdb0874bda3ec93a4173e: baseline-arm-pengutronix 2026-04-01 08:45:57,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:45:57,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:45:57,422 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccdb0874bda3ec93a4173e/log.txt.gz 2026-04-01 08:45:57,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:45:57,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:45:57,755 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccdb0874bda3ec93a4173e/lava-logs.yaml 2026-04-01 08:45:57,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:45:57,934 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:45:57,936 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccdb0874bda3ec93a4173e/lava_callback.json.gz 2026-04-01 08:45:57,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:45:57,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb0874bda3ec93a4173e HTTP/1.1" 200 None 2026-04-01 08:45:57,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:45:57,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:45:57,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:45:58,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdb0874bda3ec93a4173e HTTP/1.1" 200 None 2026-04-01 08:45:58,013 - lava_callback - INFO - Completed processing callback for node 69ccdb0874bda3ec93a4173e INFO: 172.21.0.1:55570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46610 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:46:17,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:17,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38732 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:46:30,228 - lava_callback - INFO - Received callback for node 69ccd98d74bda3ec93a415c2 INFO: 172.21.0.1:35892 - "POST /node/69ccd98d74bda3ec93a415c2 HTTP/1.0" 202 Accepted 2026-04-01 08:46:30,235 - lava_callback - INFO - Starting async job submit for node 69ccd98d74bda3ec93a415c2 2026-04-01 08:46:30,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:30,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98d74bda3ec93a415c2 HTTP/1.1" 200 None 2026-04-01 08:46:30,278 - lava_callback - DEBUG - Processing node 69ccd98d74bda3ec93a415c2: ltp-fsx 2026-04-01 08:46:30,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:46:30,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:46:30,990 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69ccd98d74bda3ec93a415c2/log.txt.gz 2026-04-01 08:46:31,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:46:31,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:46:31,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69ccd98d74bda3ec93a415c2/lava-logs.yaml 2026-04-01 08:46:31,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:46:31,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:46:31,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69ccd98d74bda3ec93a415c2/lava_callback.json.gz 2026-04-01 08:46:31,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:31,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98d74bda3ec93a415c2 HTTP/1.1" 200 None 2026-04-01 08:46:31,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:31,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:46:31,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:31,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd98d74bda3ec93a415c2 HTTP/1.1" 200 None 2026-04-01 08:46:31,704 - lava_callback - INFO - Completed processing callback for node 69ccd98d74bda3ec93a415c2 2026-04-01 08:46:33,768 - lava_callback - INFO - Received callback for node 69ccd98b74bda3ec93a415bf INFO: 172.21.0.1:35894 - "POST /node/69ccd98b74bda3ec93a415bf HTTP/1.0" 202 Accepted 2026-04-01 08:46:33,775 - lava_callback - INFO - Starting async job submit for node 69ccd98b74bda3ec93a415bf 2026-04-01 08:46:33,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:33,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98b74bda3ec93a415bf HTTP/1.1" 200 None 2026-04-01 08:46:33,815 - lava_callback - DEBUG - Processing node 69ccd98b74bda3ec93a415bf: ltp-fs_bind 2026-04-01 08:46:34,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:46:34,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:46:34,352 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ccd98b74bda3ec93a415bf/log.txt.gz 2026-04-01 08:46:34,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:46:34,833 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:46:34,835 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ccd98b74bda3ec93a415bf/lava-logs.yaml 2026-04-01 08:46:34,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:46:35,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:46:35,002 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ccd98b74bda3ec93a415bf/lava_callback.json.gz 2026-04-01 08:46:35,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:35,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98b74bda3ec93a415bf HTTP/1.1" 200 None 2026-04-01 08:46:35,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:35,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:46:35,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:35,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd98b74bda3ec93a415bf HTTP/1.1" 200 None 2026-04-01 08:46:35,098 - lava_callback - INFO - Completed processing callback for node 69ccd98b74bda3ec93a415bf INFO: 172.21.0.1:35906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53048 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:46:47,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:47,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:46:51,166 - lava_callback - INFO - Received callback for node 69ccd6d874bda3ec93a414c9 INFO: 172.21.0.1:54220 - "POST /node/69ccd6d874bda3ec93a414c9 HTTP/1.0" 202 Accepted 2026-04-01 08:46:51,173 - lava_callback - INFO - Starting async job submit for node 69ccd6d874bda3ec93a414c9 2026-04-01 08:46:51,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:51,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd6d874bda3ec93a414c9 HTTP/1.1" 200 None 2026-04-01 08:46:51,277 - lava_callback - DEBUG - Processing node 69ccd6d874bda3ec93a414c9: ltp-smoke 2026-04-01 08:46:51,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:46:51,904 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:46:51,906 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccd6d874bda3ec93a414c9/log.txt.gz 2026-04-01 08:46:52,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:46:52,578 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:46:52,580 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccd6d874bda3ec93a414c9/lava-logs.yaml 2026-04-01 08:46:52,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:46:52,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:46:52,792 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccd6d874bda3ec93a414c9/lava_callback.json.gz 2026-04-01 08:46:52,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:52,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd6d874bda3ec93a414c9 HTTP/1.1" 200 None 2026-04-01 08:46:52,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:52,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48874bda3ec93a4126c HTTP/1.1" 200 None 2026-04-01 08:46:52,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:46:52,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd6d874bda3ec93a414c9 HTTP/1.1" 200 None 2026-04-01 08:46:53,107 - lava_callback - INFO - Completed processing callback for node 69ccd6d874bda3ec93a414c9 INFO: 172.21.0.1:54228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39288 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:47:10,037 - lava_callback - INFO - Received callback for node 69ccdb6374bda3ec93a4176f INFO: 172.21.0.1:45938 - "POST /node/69ccdb6374bda3ec93a4176f HTTP/1.0" 202 Accepted 2026-04-01 08:47:10,043 - lava_callback - INFO - Starting async job submit for node 69ccdb6374bda3ec93a4176f 2026-04-01 08:47:10,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:10,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb6374bda3ec93a4176f HTTP/1.1" 200 None 2026-04-01 08:47:10,095 - lava_callback - DEBUG - Processing node 69ccdb6374bda3ec93a4176f: baseline-x86 2026-04-01 08:47:10,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:10,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:10,400 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6374bda3ec93a4176f/log.txt.gz 2026-04-01 08:47:10,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:10,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:10,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6374bda3ec93a4176f/lava-logs.yaml 2026-04-01 08:47:10,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:10,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:10,859 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6374bda3ec93a4176f/lava_callback.json.gz 2026-04-01 08:47:10,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:10,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb6374bda3ec93a4176f HTTP/1.1" 200 None 2026-04-01 08:47:10,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:10,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd4a474bda3ec93a41299 HTTP/1.1" 200 None 2026-04-01 08:47:10,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:10,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdb6374bda3ec93a4176f HTTP/1.1" 200 None 2026-04-01 08:47:10,939 - lava_callback - INFO - Completed processing callback for node 69ccdb6374bda3ec93a4176f 2026-04-01 08:47:13,893 - lava_callback - INFO - Received callback for node 69ccd98e74bda3ec93a415c5 INFO: 172.21.0.1:45946 - "POST /node/69ccd98e74bda3ec93a415c5 HTTP/1.0" 202 Accepted 2026-04-01 08:47:13,899 - lava_callback - INFO - Starting async job submit for node 69ccd98e74bda3ec93a415c5 2026-04-01 08:47:13,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:13,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98e74bda3ec93a415c5 HTTP/1.1" 200 None 2026-04-01 08:47:13,939 - lava_callback - DEBUG - Processing node 69ccd98e74bda3ec93a415c5: ltp-input 2026-04-01 08:47:14,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:14,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:14,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69ccd98e74bda3ec93a415c5/log.txt.gz 2026-04-01 08:47:14,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:14,884 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:14,886 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69ccd98e74bda3ec93a415c5/lava-logs.yaml 2026-04-01 08:47:14,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:15,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 INFO: 172.21.0.1:45954 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-01 08:47:15,158 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69ccd98e74bda3ec93a415c5/lava_callback.json.gz 2026-04-01 08:47:15,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:15,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98e74bda3ec93a415c5 HTTP/1.1" 200 None 2026-04-01 08:47:15,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:15,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:47:15,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:15,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd98e74bda3ec93a415c5 HTTP/1.1" 200 None 2026-04-01 08:47:15,256 - lava_callback - INFO - Completed processing callback for node 69ccd98e74bda3ec93a415c5 INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:47:17,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:17,418 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:47:23,229 - lava_callback - INFO - Received callback for node 69ccdb6574bda3ec93a41778 INFO: 172.21.0.1:52608 - "POST /node/69ccdb6574bda3ec93a41778 HTTP/1.0" 202 Accepted 2026-04-01 08:47:23,235 - lava_callback - INFO - Starting async job submit for node 69ccdb6574bda3ec93a41778 2026-04-01 08:47:23,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:23,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb6574bda3ec93a41778 HTTP/1.1" 200 None 2026-04-01 08:47:23,275 - lava_callback - DEBUG - Processing node 69ccdb6574bda3ec93a41778: baseline-x86 2026-04-01 08:47:23,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:23,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:23,581 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6574bda3ec93a41778/log.txt.gz 2026-04-01 08:47:23,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:23,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:23,920 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6574bda3ec93a41778/lava-logs.yaml 2026-04-01 08:47:23,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:24,059 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:24,061 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6574bda3ec93a41778/lava_callback.json.gz 2026-04-01 08:47:24,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:24,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb6574bda3ec93a41778 HTTP/1.1" 200 None 2026-04-01 08:47:24,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:24,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd4a474bda3ec93a41299 HTTP/1.1" 200 None 2026-04-01 08:47:24,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:24,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdb6574bda3ec93a41778 HTTP/1.1" 200 None 2026-04-01 08:47:24,140 - lava_callback - INFO - Completed processing callback for node 69ccdb6574bda3ec93a41778 INFO: 172.21.0.1:52612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44056 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:44062 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:47:47,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:47,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:47:54,065 - lava_callback - INFO - Received callback for node 69ccd98f74bda3ec93a415c8 INFO: 172.21.0.1:42094 - "POST /node/69ccd98f74bda3ec93a415c8 HTTP/1.0" 202 Accepted 2026-04-01 08:47:54,071 - lava_callback - INFO - Starting async job submit for node 69ccd98f74bda3ec93a415c8 2026-04-01 08:47:54,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:54,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98f74bda3ec93a415c8 HTTP/1.1" 200 None 2026-04-01 08:47:54,120 - lava_callback - DEBUG - Processing node 69ccd98f74bda3ec93a415c8: ltp-ipc 2026-04-01 08:47:54,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:54,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:54,607 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69ccd98f74bda3ec93a415c8/log.txt.gz 2026-04-01 08:47:54,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:55,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:55,044 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69ccd98f74bda3ec93a415c8/lava-logs.yaml 2026-04-01 08:47:55,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:55,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:55,216 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69ccd98f74bda3ec93a415c8/lava_callback.json.gz 2026-04-01 08:47:55,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:55,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd98f74bda3ec93a415c8 HTTP/1.1" 200 None 2026-04-01 08:47:55,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:55,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:47:55,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:55,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd98f74bda3ec93a415c8 HTTP/1.1" 200 None 2026-04-01 08:47:55,298 - lava_callback - INFO - Completed processing callback for node 69ccd98f74bda3ec93a415c8 2026-04-01 08:47:55,356 - lava_callback - INFO - Received callback for node 69ccdb6474bda3ec93a41772 INFO: 172.21.0.1:42106 - "POST /node/69ccdb6474bda3ec93a41772 HTTP/1.0" 202 Accepted 2026-04-01 08:47:55,368 - lava_callback - INFO - Starting async job submit for node 69ccdb6474bda3ec93a41772 2026-04-01 08:47:55,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:55,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb6474bda3ec93a41772 HTTP/1.1" 200 None 2026-04-01 08:47:55,407 - lava_callback - DEBUG - Processing node 69ccdb6474bda3ec93a41772: baseline-x86 2026-04-01 08:47:55,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:55,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:55,853 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6474bda3ec93a41772/log.txt.gz 2026-04-01 08:47:56,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:56,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:56,222 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6474bda3ec93a41772/lava-logs.yaml 2026-04-01 08:47:56,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:47:56,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:47:56,362 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6474bda3ec93a41772/lava_callback.json.gz 2026-04-01 08:47:56,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:56,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb6474bda3ec93a41772 HTTP/1.1" 200 None 2026-04-01 08:47:56,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:56,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd4a474bda3ec93a41299 HTTP/1.1" 200 None 2026-04-01 08:47:56,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:47:56,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdb6474bda3ec93a41772 HTTP/1.1" 200 None 2026-04-01 08:47:56,445 - lava_callback - INFO - Completed processing callback for node 69ccdb6474bda3ec93a41772 INFO: 172.21.0.1:42114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET /.well-known/security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:48:17,044 - lava_callback - INFO - Received callback for node 69ccdb6574bda3ec93a41775 INFO: 172.21.0.1:47820 - "POST /node/69ccdb6574bda3ec93a41775 HTTP/1.0" 202 Accepted 2026-04-01 08:48:17,050 - lava_callback - INFO - Starting async job submit for node 69ccdb6574bda3ec93a41775 2026-04-01 08:48:17,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:48:17,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb6574bda3ec93a41775 HTTP/1.1" 200 None 2026-04-01 08:48:17,085 - lava_callback - DEBUG - Processing node 69ccdb6574bda3ec93a41775: baseline-x86 2026-04-01 08:48:17,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:48:17,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:48:17,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:48:17,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:48:17,468 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6574bda3ec93a41775/log.txt.gz 2026-04-01 08:48:17,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:48:17,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:48:17,842 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6574bda3ec93a41775/lava-logs.yaml 2026-04-01 08:48:17,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:48:18,019 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:48:18,021 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ccdb6574bda3ec93a41775/lava_callback.json.gz 2026-04-01 08:48:18,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:48:18,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdb6574bda3ec93a41775 HTTP/1.1" 200 None 2026-04-01 08:48:18,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:48:18,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd4a474bda3ec93a41299 HTTP/1.1" 200 None 2026-04-01 08:48:18,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:48:18,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdb6574bda3ec93a41775 HTTP/1.1" 200 None 2026-04-01 08:48:18,110 - lava_callback - INFO - Completed processing callback for node 69ccdb6574bda3ec93a41775 INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50772 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:48:47,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:48:47,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43520 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:50:25,244 - lava_callback - INFO - Received callback for node 69ca393d0e33d030878a8b69 INFO: 172.21.0.1:41668 - "POST /node/69ca393d0e33d030878a8b69 HTTP/1.0" 202 Accepted 2026-04-01 08:50:25,253 - lava_callback - INFO - Starting async job submit for node 69ca393d0e33d030878a8b69 2026-04-01 08:50:25,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:25,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca393d0e33d030878a8b69 HTTP/1.1" 200 None 2026-04-01 08:50:25,286 - lava_callback - DEBUG - Processing node 69ca393d0e33d030878a8b69: baseline-arm64-baylibre 2026-04-01 08:50:25,286 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca393d0e33d030878a8b69 2026-04-01 08:50:25,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:25,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca393d0e33d030878a8b69 HTTP/1.1" 200 None 2026-04-01 08:50:25,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:25,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 08:50:25,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:25,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca393d0e33d030878a8b69 HTTP/1.1" 200 None 2026-04-01 08:50:25,357 - lava_callback - ERROR - Error processing callback for node 69ca393d0e33d030878a8b69: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:50:25,910 - lava_callback - INFO - Received callback for node 69ca393b0e33d030878a8b64 INFO: 172.21.0.1:41682 - "POST /node/69ca393b0e33d030878a8b64 HTTP/1.0" 202 Accepted 2026-04-01 08:50:25,916 - lava_callback - INFO - Starting async job submit for node 69ca393b0e33d030878a8b64 2026-04-01 08:50:25,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:25,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca393b0e33d030878a8b64 HTTP/1.1" 200 None 2026-04-01 08:50:25,932 - lava_callback - DEBUG - Processing node 69ca393b0e33d030878a8b64: baseline-arm64-baylibre 2026-04-01 08:50:25,932 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca393b0e33d030878a8b64 2026-04-01 08:50:25,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:25,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca393b0e33d030878a8b64 HTTP/1.1" 200 None 2026-04-01 08:50:25,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:25,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 08:50:25,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:25,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca393b0e33d030878a8b64 HTTP/1.1" 200 None 2026-04-01 08:50:25,989 - lava_callback - ERROR - Error processing callback for node 69ca393b0e33d030878a8b64: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41698 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:50:26,604 - lava_callback - INFO - Received callback for node 69ca393f0e33d030878a8b72 INFO: 172.21.0.1:41702 - "POST /node/69ca393f0e33d030878a8b72 HTTP/1.0" 202 Accepted 2026-04-01 08:50:26,610 - lava_callback - INFO - Starting async job submit for node 69ca393f0e33d030878a8b72 2026-04-01 08:50:26,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:26,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca393f0e33d030878a8b72 HTTP/1.1" 200 None 2026-04-01 08:50:26,626 - lava_callback - DEBUG - Processing node 69ca393f0e33d030878a8b72: baseline-arm64-baylibre 2026-04-01 08:50:26,626 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca393f0e33d030878a8b72 2026-04-01 08:50:26,627 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:26,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca393f0e33d030878a8b72 HTTP/1.1" 200 None 2026-04-01 08:50:26,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:26,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 08:50:26,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:26,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca393f0e33d030878a8b72 HTTP/1.1" 200 None 2026-04-01 08:50:26,692 - lava_callback - ERROR - Error processing callback for node 69ca393f0e33d030878a8b72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:50:27,262 - lava_callback - INFO - Received callback for node 69ca39410e33d030878a8b75 INFO: 172.21.0.1:41708 - "POST /node/69ca39410e33d030878a8b75 HTTP/1.0" 202 Accepted 2026-04-01 08:50:27,269 - lava_callback - INFO - Starting async job submit for node 69ca39410e33d030878a8b75 2026-04-01 08:50:27,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:27,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39410e33d030878a8b75 HTTP/1.1" 200 None 2026-04-01 08:50:27,289 - lava_callback - DEBUG - Processing node 69ca39410e33d030878a8b75: baseline-arm64-baylibre 2026-04-01 08:50:27,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca39410e33d030878a8b75 2026-04-01 08:50:27,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:27,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39410e33d030878a8b75 HTTP/1.1" 200 None 2026-04-01 08:50:27,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:27,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 08:50:27,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:27,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca39410e33d030878a8b75 HTTP/1.1" 200 None 2026-04-01 08:50:27,343 - lava_callback - ERROR - Error processing callback for node 69ca39410e33d030878a8b75: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:50:27,926 - lava_callback - INFO - Received callback for node 69ca39420e33d030878a8b7c INFO: 172.21.0.1:41710 - "POST /node/69ca39420e33d030878a8b7c HTTP/1.0" 202 Accepted 2026-04-01 08:50:27,935 - lava_callback - INFO - Starting async job submit for node 69ca39420e33d030878a8b7c 2026-04-01 08:50:27,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:27,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39420e33d030878a8b7c HTTP/1.1" 200 None 2026-04-01 08:50:27,957 - lava_callback - DEBUG - Processing node 69ca39420e33d030878a8b7c: baseline-arm64-baylibre 2026-04-01 08:50:27,957 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca39420e33d030878a8b7c 2026-04-01 08:50:27,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:27,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39420e33d030878a8b7c HTTP/1.1" 200 None 2026-04-01 08:50:27,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:27,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 08:50:27,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:28,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca39420e33d030878a8b7c HTTP/1.1" 200 None 2026-04-01 08:50:28,029 - lava_callback - ERROR - Error processing callback for node 69ca39420e33d030878a8b7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:50:31,356 - lava_callback - INFO - Received callback for node 69ccd99174bda3ec93a415cb INFO: 172.21.0.1:51884 - "POST /node/69ccd99174bda3ec93a415cb HTTP/1.0" 202 Accepted 2026-04-01 08:50:31,362 - lava_callback - INFO - Starting async job submit for node 69ccd99174bda3ec93a415cb 2026-04-01 08:50:31,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:31,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99174bda3ec93a415cb HTTP/1.1" 200 None 2026-04-01 08:50:31,402 - lava_callback - DEBUG - Processing node 69ccd99174bda3ec93a415cb: ltp-pty 2026-04-01 08:50:31,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:50:31,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:50:31,882 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69ccd99174bda3ec93a415cb/log.txt.gz 2026-04-01 08:50:32,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:50:32,369 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:50:32,372 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69ccd99174bda3ec93a415cb/lava-logs.yaml 2026-04-01 08:50:32,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:50:32,545 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:50:32,547 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69ccd99174bda3ec93a415cb/lava_callback.json.gz 2026-04-01 08:50:32,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:32,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99174bda3ec93a415cb HTTP/1.1" 200 None 2026-04-01 08:50:32,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:32,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:50:32,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:32,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd99174bda3ec93a415cb HTTP/1.1" 200 None 2026-04-01 08:50:32,645 - lava_callback - INFO - Completed processing callback for node 69ccd99174bda3ec93a415cb 2026-04-01 08:50:34,217 - lava_callback - INFO - Received callback for node 69ccd99274bda3ec93a415ce INFO: 172.21.0.1:51898 - "POST /node/69ccd99274bda3ec93a415ce HTTP/1.0" 202 Accepted 2026-04-01 08:50:34,224 - lava_callback - INFO - Starting async job submit for node 69ccd99274bda3ec93a415ce 2026-04-01 08:50:34,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:34,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99274bda3ec93a415ce HTTP/1.1" 200 None 2026-04-01 08:50:34,263 - lava_callback - DEBUG - Processing node 69ccd99274bda3ec93a415ce: ltp-sched 2026-04-01 08:50:34,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:50:34,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:50:34,709 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69ccd99274bda3ec93a415ce/log.txt.gz 2026-04-01 08:50:34,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:50:35,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:50:35,179 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69ccd99274bda3ec93a415ce/lava-logs.yaml 2026-04-01 08:50:35,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:50:35,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:50:35,359 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69ccd99274bda3ec93a415ce/lava_callback.json.gz 2026-04-01 08:50:35,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:35,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99274bda3ec93a415ce HTTP/1.1" 200 None 2026-04-01 08:50:35,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:35,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:50:35,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:35,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd99274bda3ec93a415ce HTTP/1.1" 200 None 2026-04-01 08:50:35,459 - lava_callback - INFO - Completed processing callback for node 69ccd99274bda3ec93a415ce INFO: 172.21.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43628 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:50:47,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:47,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:50:48,464 - lava_callback - INFO - Received callback for node 69ca39520e33d030878a8bc5 INFO: 172.21.0.1:43638 - "POST /node/69ca39520e33d030878a8bc5 HTTP/1.0" 202 Accepted 2026-04-01 08:50:48,473 - lava_callback - INFO - Starting async job submit for node 69ca39520e33d030878a8bc5 2026-04-01 08:50:48,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:48,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39520e33d030878a8bc5 HTTP/1.1" 200 None 2026-04-01 08:50:48,490 - lava_callback - DEBUG - Processing node 69ca39520e33d030878a8bc5: baseline-arm64-clabbe 2026-04-01 08:50:48,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca39520e33d030878a8bc5 2026-04-01 08:50:48,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:48,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39520e33d030878a8bc5 HTTP/1.1" 200 None 2026-04-01 08:50:48,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:48,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 08:50:48,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:48,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca39520e33d030878a8bc5 HTTP/1.1" 200 None 2026-04-01 08:50:48,569 - lava_callback - ERROR - Error processing callback for node 69ca39520e33d030878a8bc5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:50:49,146 - lava_callback - INFO - Received callback for node 69ca39540e33d030878a8bc8 INFO: 172.21.0.1:43654 - "POST /node/69ca39540e33d030878a8bc8 HTTP/1.0" 202 Accepted 2026-04-01 08:50:49,152 - lava_callback - INFO - Starting async job submit for node 69ca39540e33d030878a8bc8 2026-04-01 08:50:49,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:49,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39540e33d030878a8bc8 HTTP/1.1" 200 None 2026-04-01 08:50:49,169 - lava_callback - DEBUG - Processing node 69ca39540e33d030878a8bc8: baseline-arm64-clabbe 2026-04-01 08:50:49,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca39540e33d030878a8bc8 2026-04-01 08:50:49,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:49,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39540e33d030878a8bc8 HTTP/1.1" 200 None 2026-04-01 08:50:49,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:49,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 08:50:49,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:49,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca39540e33d030878a8bc8 HTTP/1.1" 200 None 2026-04-01 08:50:49,219 - lava_callback - ERROR - Error processing callback for node 69ca39540e33d030878a8bc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:50:49,792 - lava_callback - INFO - Received callback for node 69ca39550e33d030878a8bcb INFO: 172.21.0.1:46534 - "POST /node/69ca39550e33d030878a8bcb HTTP/1.0" 202 Accepted 2026-04-01 08:50:49,797 - lava_callback - INFO - Starting async job submit for node 69ca39550e33d030878a8bcb 2026-04-01 08:50:49,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:49,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39550e33d030878a8bcb HTTP/1.1" 200 None 2026-04-01 08:50:49,813 - lava_callback - DEBUG - Processing node 69ca39550e33d030878a8bcb: baseline-arm64-clabbe 2026-04-01 08:50:49,813 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca39550e33d030878a8bcb 2026-04-01 08:50:49,814 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:49,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39550e33d030878a8bcb HTTP/1.1" 200 None 2026-04-01 08:50:49,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:49,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 08:50:49,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:49,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca39550e33d030878a8bcb HTTP/1.1" 200 None 2026-04-01 08:50:49,870 - lava_callback - ERROR - Error processing callback for node 69ca39550e33d030878a8bcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:50:50,467 - lava_callback - INFO - Received callback for node 69ca39550e33d030878a8bce INFO: 172.21.0.1:46546 - "POST /node/69ca39550e33d030878a8bce HTTP/1.0" 202 Accepted 2026-04-01 08:50:50,476 - lava_callback - INFO - Starting async job submit for node 69ca39550e33d030878a8bce 2026-04-01 08:50:50,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:50,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39550e33d030878a8bce HTTP/1.1" 200 None 2026-04-01 08:50:50,499 - lava_callback - DEBUG - Processing node 69ca39550e33d030878a8bce: baseline-arm64-clabbe 2026-04-01 08:50:50,499 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca39550e33d030878a8bce 2026-04-01 08:50:50,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:50,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39550e33d030878a8bce HTTP/1.1" 200 None 2026-04-01 08:50:50,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:50,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 08:50:50,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:50,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca39550e33d030878a8bce HTTP/1.1" 200 None 2026-04-01 08:50:50,565 - lava_callback - ERROR - Error processing callback for node 69ca39550e33d030878a8bce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:50:51,124 - lava_callback - INFO - Received callback for node 69ca39580e33d030878a8bdb INFO: 172.21.0.1:46550 - "POST /node/69ca39580e33d030878a8bdb HTTP/1.0" 202 Accepted 2026-04-01 08:50:51,130 - lava_callback - INFO - Starting async job submit for node 69ca39580e33d030878a8bdb 2026-04-01 08:50:51,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:51,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39580e33d030878a8bdb HTTP/1.1" 200 None 2026-04-01 08:50:51,147 - lava_callback - DEBUG - Processing node 69ca39580e33d030878a8bdb: baseline-arm64-clabbe 2026-04-01 08:50:51,147 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca39580e33d030878a8bdb 2026-04-01 08:50:51,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:51,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39580e33d030878a8bdb HTTP/1.1" 200 None 2026-04-01 08:50:51,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:51,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 08:50:51,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:51,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca39580e33d030878a8bdb HTTP/1.1" 200 None 2026-04-01 08:50:51,215 - lava_callback - ERROR - Error processing callback for node 69ca39580e33d030878a8bdb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 08:50:51,843 - lava_callback - INFO - Received callback for node 69ca39570e33d030878a8bd8 INFO: 172.21.0.1:46562 - "POST /node/69ca39570e33d030878a8bd8 HTTP/1.0" 202 Accepted 2026-04-01 08:50:51,849 - lava_callback - INFO - Starting async job submit for node 69ca39570e33d030878a8bd8 2026-04-01 08:50:51,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:51,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39570e33d030878a8bd8 HTTP/1.1" 200 None 2026-04-01 08:50:51,868 - lava_callback - DEBUG - Processing node 69ca39570e33d030878a8bd8: baseline-arm64-clabbe 2026-04-01 08:50:51,868 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca39570e33d030878a8bd8 2026-04-01 08:50:51,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:51,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39570e33d030878a8bd8 HTTP/1.1" 200 None 2026-04-01 08:50:51,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:51,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 08:50:51,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:50:51,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca39570e33d030878a8bd8 HTTP/1.1" 200 None 2026-04-01 08:50:51,929 - lava_callback - ERROR - Error processing callback for node 69ca39570e33d030878a8bd8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46576 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:51:05,214 - lava_callback - INFO - Received callback for node 69ca39670e33d030878a8c0f INFO: 172.21.0.1:43286 - "POST /node/69ca39670e33d030878a8c0f HTTP/1.0" 202 Accepted 2026-04-01 08:51:05,219 - lava_callback - INFO - Starting async job submit for node 69ca39670e33d030878a8c0f 2026-04-01 08:51:05,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:05,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39670e33d030878a8c0f HTTP/1.1" 200 None 2026-04-01 08:51:05,240 - lava_callback - DEBUG - Processing node 69ca39670e33d030878a8c0f: baseline-arm-baylibre 2026-04-01 08:51:05,240 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca39670e33d030878a8c0f 2026-04-01 08:51:05,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:05,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39670e33d030878a8c0f HTTP/1.1" 200 None 2026-04-01 08:51:05,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:05,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 08:51:05,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:05,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca39670e33d030878a8c0f HTTP/1.1" 200 None 2026-04-01 08:51:05,294 - lava_callback - ERROR - Error processing callback for node 69ca39670e33d030878a8c0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43286 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:51:34,010 - lava_callback - INFO - Received callback for node 69ccd99474bda3ec93a415d1 INFO: 172.21.0.1:48140 - "POST /node/69ccd99474bda3ec93a415d1 HTTP/1.0" 202 Accepted 2026-04-01 08:51:34,017 - lava_callback - INFO - Starting async job submit for node 69ccd99474bda3ec93a415d1 2026-04-01 08:51:34,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:34,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99474bda3ec93a415d1 HTTP/1.1" 200 None 2026-04-01 08:51:34,060 - lava_callback - DEBUG - Processing node 69ccd99474bda3ec93a415d1: ltp-smoke 2026-04-01 08:51:34,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:51:35,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:51:35,113 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccd99474bda3ec93a415d1/log.txt.gz 2026-04-01 08:51:35,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:51:36,071 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:51:36,074 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccd99474bda3ec93a415d1/lava-logs.yaml 2026-04-01 08:51:36,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:51:36,241 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:51:36,243 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccd99474bda3ec93a415d1/lava_callback.json.gz 2026-04-01 08:51:36,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:36,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99474bda3ec93a415d1 HTTP/1.1" 200 None 2026-04-01 08:51:36,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:36,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:51:36,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:36,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd99474bda3ec93a415d1 HTTP/1.1" 200 None 2026-04-01 08:51:36,382 - lava_callback - INFO - Completed processing callback for node 69ccd99474bda3ec93a415d1 INFO: 172.21.0.1:48152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39538 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:51:47,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:47,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:51:53,942 - lava_callback - INFO - Received callback for node 69ccd99974bda3ec93a415da INFO: 172.21.0.1:37590 - "POST /node/69ccd99974bda3ec93a415da HTTP/1.0" 202 Accepted 2026-04-01 08:51:53,953 - lava_callback - INFO - Starting async job submit for node 69ccd99974bda3ec93a415da 2026-04-01 08:51:53,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:54,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99974bda3ec93a415da HTTP/1.1" 200 None 2026-04-01 08:51:54,016 - lava_callback - DEBUG - Processing node 69ccd99974bda3ec93a415da: ltp-timers 2026-04-01 08:51:54,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:51:54,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:51:54,814 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69ccd99974bda3ec93a415da/log.txt.gz 2026-04-01 08:51:55,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:51:55,589 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:51:55,593 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69ccd99974bda3ec93a415da/lava-logs.yaml 2026-04-01 08:51:55,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:51:56,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:51:56,084 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69ccd99974bda3ec93a415da/lava_callback.json.gz 2026-04-01 08:51:56,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:56,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99974bda3ec93a415da HTTP/1.1" 200 None 2026-04-01 08:51:56,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:56,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:51:56,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:51:56,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd99974bda3ec93a415da HTTP/1.1" 200 None 2026-04-01 08:51:56,301 - lava_callback - INFO - Completed processing callback for node 69ccd99974bda3ec93a415da INFO: 172.21.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60248 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:52:17,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:52:17,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44522 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:52:28,565 - lava_callback - INFO - Received callback for node 69ca39b70e33d030878a9276 INFO: 172.21.0.1:44538 - "POST /node/69ca39b70e33d030878a9276 HTTP/1.0" 202 Accepted 2026-04-01 08:52:28,574 - lava_callback - INFO - Starting async job submit for node 69ca39b70e33d030878a9276 2026-04-01 08:52:28,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:52:28,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39b70e33d030878a9276 HTTP/1.1" 200 None 2026-04-01 08:52:28,592 - lava_callback - DEBUG - Processing node 69ca39b70e33d030878a9276: baseline-arm-clabbe 2026-04-01 08:52:28,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca39b70e33d030878a9276 2026-04-01 08:52:28,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:52:28,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca39b70e33d030878a9276 HTTP/1.1" 200 None 2026-04-01 08:52:28,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:52:28,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 08:52:28,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:52:28,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca39b70e33d030878a9276 HTTP/1.1" 200 None 2026-04-01 08:52:28,684 - lava_callback - ERROR - Error processing callback for node 69ca39b70e33d030878a9276: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37168 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:53:28,577 - lava_callback - INFO - Received callback for node 69ca3a040e33d030878a92cf INFO: 172.21.0.1:37178 - "POST /node/69ca3a040e33d030878a92cf HTTP/1.0" 202 Accepted 2026-04-01 08:53:28,582 - lava_callback - INFO - Starting async job submit for node 69ca3a040e33d030878a92cf 2026-04-01 08:53:28,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:53:28,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3a040e33d030878a92cf HTTP/1.1" 200 None 2026-04-01 08:53:28,602 - lava_callback - DEBUG - Processing node 69ca3a040e33d030878a92cf: baseline-arm-clabbe 2026-04-01 08:53:28,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3a040e33d030878a92cf 2026-04-01 08:53:28,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:53:28,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3a040e33d030878a92cf HTTP/1.1" 200 None 2026-04-01 08:53:28,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:53:28,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 08:53:28,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:53:28,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3a040e33d030878a92cf HTTP/1.1" 200 None 2026-04-01 08:53:28,674 - lava_callback - ERROR - Error processing callback for node 69ca3a040e33d030878a92cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:54:34,413 - lava_callback - INFO - Received callback for node 69ccd99a74bda3ec93a415dd INFO: 172.21.0.1:35288 - "POST /node/69ccd99a74bda3ec93a415dd HTTP/1.0" 202 Accepted 2026-04-01 08:54:34,421 - lava_callback - INFO - Starting async job submit for node 69ccd99a74bda3ec93a415dd 2026-04-01 08:54:34,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:54:34,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99a74bda3ec93a415dd HTTP/1.1" 200 None 2026-04-01 08:54:34,477 - lava_callback - DEBUG - Processing node 69ccd99a74bda3ec93a415dd: ltp-watchqueue 2026-04-01 08:54:35,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:54:35,586 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:54:35,588 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ccd99a74bda3ec93a415dd/log.txt.gz 2026-04-01 08:54:35,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35294 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:54:36,518 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:54:36,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ccd99a74bda3ec93a415dd/lava-logs.yaml 2026-04-01 08:54:36,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:54:37,164 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:54:37,166 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ccd99a74bda3ec93a415dd/lava_callback.json.gz 2026-04-01 08:54:37,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:54:37,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99a74bda3ec93a415dd HTTP/1.1" 200 None 2026-04-01 08:54:37,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:54:37,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:54:37,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:54:37,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd99a74bda3ec93a415dd HTTP/1.1" 200 None 2026-04-01 08:54:37,279 - lava_callback - INFO - Completed processing callback for node 69ccd99a74bda3ec93a415dd INFO: 172.21.0.1:58572 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:54:47,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:54:47,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 08:54:48,664 - lava_callback - INFO - Received callback for node 69ca3a4e0e33d030878a931d INFO: 172.21.0.1:58584 - "POST /node/69ca3a4e0e33d030878a931d HTTP/1.0" 202 Accepted 2026-04-01 08:54:48,672 - lava_callback - INFO - Starting async job submit for node 69ca3a4e0e33d030878a931d 2026-04-01 08:54:48,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:54:48,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3a4e0e33d030878a931d HTTP/1.1" 200 None 2026-04-01 08:54:48,693 - lava_callback - DEBUG - Processing node 69ca3a4e0e33d030878a931d: baseline-arm-clabbe 2026-04-01 08:54:48,693 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3a4e0e33d030878a931d 2026-04-01 08:54:48,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:54:48,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3a4e0e33d030878a931d HTTP/1.1" 200 None 2026-04-01 08:54:48,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:54:48,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 08:54:48,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:54:48,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3a4e0e33d030878a931d HTTP/1.1" 200 None 2026-04-01 08:54:48,955 - lava_callback - ERROR - Error processing callback for node 69ca3a4e0e33d030878a931d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40538 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:55:46,681 - lava_callback - INFO - Received callback for node 69ccd95174bda3ec93a414f9 INFO: 172.21.0.1:40542 - "POST /node/69ccd95174bda3ec93a414f9 HTTP/1.0" 202 Accepted 2026-04-01 08:55:46,688 - lava_callback - INFO - Starting async job submit for node 69ccd95174bda3ec93a414f9 2026-04-01 08:55:46,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:55:46,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95174bda3ec93a414f9 HTTP/1.1" 200 None 2026-04-01 08:55:46,756 - lava_callback - DEBUG - Processing node 69ccd95174bda3ec93a414f9: baseline-arm 2026-04-01 08:55:47,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:55:47,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:55:47,485 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95174bda3ec93a414f9/log.txt.gz 2026-04-01 08:55:47,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:55:48,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:55:48,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95174bda3ec93a414f9/lava-logs.yaml 2026-04-01 08:55:48,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:55:48,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:55:48,287 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccd95174bda3ec93a414f9/lava_callback.json.gz DEBUG: Setup failed for 69ccd95174bda3ec93a414f9. Transitting job node result: incomplete -> fail 2026-04-01 08:55:48,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:55:48,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd95174bda3ec93a414f9 HTTP/1.1" 200 None 2026-04-01 08:55:48,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:55:48,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:55:48,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:55:48,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd95174bda3ec93a414f9 HTTP/1.1" 200 None 2026-04-01 08:55:48,597 - lava_callback - INFO - Completed processing callback for node 69ccd95174bda3ec93a414f9 INFO: 172.21.0.1:50736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38652 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:56:08,729 - lava_callback - INFO - Received callback for node 69ca3a9a0e33d030878a935a INFO: 172.21.0.1:38664 - "POST /node/69ca3a9a0e33d030878a935a HTTP/1.0" 202 Accepted 2026-04-01 08:56:08,734 - lava_callback - INFO - Starting async job submit for node 69ca3a9a0e33d030878a935a 2026-04-01 08:56:08,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:56:08,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3a9a0e33d030878a935a HTTP/1.1" 200 None 2026-04-01 08:56:08,761 - lava_callback - DEBUG - Processing node 69ca3a9a0e33d030878a935a: baseline-arm-clabbe 2026-04-01 08:56:08,762 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3a9a0e33d030878a935a 2026-04-01 08:56:08,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:56:08,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3a9a0e33d030878a935a HTTP/1.1" 200 None 2026-04-01 08:56:08,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:56:08,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 08:56:08,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:56:08,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3a9a0e33d030878a935a HTTP/1.1" 200 None 2026-04-01 08:56:08,814 - lava_callback - ERROR - Error processing callback for node 69ca3a9a0e33d030878a935a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50050 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:56:17,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:56:17,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60894 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:57:12,229 - lava_callback - INFO - Received callback for node 69ccddd274bda3ec93a41913 INFO: 172.21.0.1:52378 - "POST /node/69ccddd274bda3ec93a41913 HTTP/1.0" 202 Accepted 2026-04-01 08:57:12,235 - lava_callback - INFO - Starting async job submit for node 69ccddd274bda3ec93a41913 2026-04-01 08:57:12,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:57:12,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccddd274bda3ec93a41913 HTTP/1.1" 200 None 2026-04-01 08:57:12,253 - lava_callback - DEBUG - Processing node 69ccddd274bda3ec93a41913: baseline-arm 2026-04-01 08:57:12,258 - lava_callback - WARNING - Failed to upload log 2026-04-01 08:57:12,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:57:12,519 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:57:12,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccddd274bda3ec93a41913/lava-logs.yaml 2026-04-01 08:57:12,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:57:12,689 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:57:12,691 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccddd274bda3ec93a41913/lava_callback.json.gz 2026-04-01 08:57:12,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:57:12,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccddd274bda3ec93a41913 HTTP/1.1" 200 None 2026-04-01 08:57:12,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:57:12,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:57:12,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:57:12,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccddd274bda3ec93a41913 HTTP/1.1" 200 None 2026-04-01 08:57:12,753 - lava_callback - INFO - Completed processing callback for node 69ccddd274bda3ec93a41913 INFO: 172.21.0.1:52392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52406 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:57:17,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:57:17,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40946 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:57:41,071 - lava_callback - INFO - Received callback for node 69ccd97274bda3ec93a41579 INFO: 172.21.0.1:51792 - "POST /node/69ccd97274bda3ec93a41579 HTTP/1.0" 202 Accepted 2026-04-01 08:57:41,117 - lava_callback - INFO - Starting async job submit for node 69ccd97274bda3ec93a41579 2026-04-01 08:57:41,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:57:41,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd97274bda3ec93a41579 HTTP/1.1" 200 None 2026-04-01 08:57:41,156 - lava_callback - DEBUG - Processing node 69ccd97274bda3ec93a41579: baseline-arm-pengutronix 2026-04-01 08:57:41,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:57:41,412 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:57:41,413 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd97274bda3ec93a41579/log.txt.gz 2026-04-01 08:57:41,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:57:41,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:57:41,664 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd97274bda3ec93a41579/lava-logs.yaml 2026-04-01 08:57:41,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 08:57:41,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 08:57:41,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccd97274bda3ec93a41579/lava_callback.json.gz DEBUG: Setup failed for 69ccd97274bda3ec93a41579. Transitting job node result: incomplete -> fail 2026-04-01 08:57:41,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:57:41,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd97274bda3ec93a41579 HTTP/1.1" 200 None 2026-04-01 08:57:41,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:57:41,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 08:57:41,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:57:41,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd97274bda3ec93a41579 HTTP/1.1" 200 None 2026-04-01 08:57:41,972 - lava_callback - INFO - Completed processing callback for node 69ccd97274bda3ec93a41579 INFO: 172.21.0.1:51808 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:57:47,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:57:47,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37412 - "GET / HTTP/1.0" 200 OK 2026-04-01 08:58:08,988 - lava_callback - INFO - Received callback for node 69ca3b0b0e33d030878a9393 INFO: 172.21.0.1:37424 - "POST /node/69ca3b0b0e33d030878a9393 HTTP/1.0" 202 Accepted 2026-04-01 08:58:08,996 - lava_callback - INFO - Starting async job submit for node 69ca3b0b0e33d030878a9393 2026-04-01 08:58:08,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:58:09,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3b0b0e33d030878a9393 HTTP/1.1" 200 None 2026-04-01 08:58:09,013 - lava_callback - DEBUG - Processing node 69ca3b0b0e33d030878a9393: baseline-arm-clabbe 2026-04-01 08:58:09,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3b0b0e33d030878a9393 2026-04-01 08:58:09,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:58:09,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3b0b0e33d030878a9393 HTTP/1.1" 200 None 2026-04-01 08:58:09,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:58:09,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 08:58:09,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 08:58:09,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3b0b0e33d030878a9393 HTTP/1.1" 200 None 2026-04-01 08:58:09,082 - lava_callback - ERROR - Error processing callback for node 69ca3b0b0e33d030878a9393: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58814 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:01:07,044 - lava_callback - INFO - Received callback for node 69ccdeb874bda3ec93a4197a INFO: 172.21.0.1:58828 - "POST /node/69ccdeb874bda3ec93a4197a HTTP/1.0" 202 Accepted 2026-04-01 09:01:07,050 - lava_callback - INFO - Starting async job submit for node 69ccdeb874bda3ec93a4197a 2026-04-01 09:01:07,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:07,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeb874bda3ec93a4197a HTTP/1.1" 200 None 2026-04-01 09:01:07,085 - lava_callback - DEBUG - Processing node 69ccdeb874bda3ec93a4197a: baseline-arm64 2026-04-01 09:01:07,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:01:07,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:01:07,423 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdeb874bda3ec93a4197a/log.txt.gz 2026-04-01 09:01:07,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:01:07,733 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:01:07,734 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdeb874bda3ec93a4197a/lava-logs.yaml 2026-04-01 09:01:07,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:01:07,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:01:07,911 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdeb874bda3ec93a4197a/lava_callback.json.gz 2026-04-01 09:01:07,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:07,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeb874bda3ec93a4197a HTTP/1.1" 200 None 2026-04-01 09:01:07,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:07,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:01:07,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:08,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdeb874bda3ec93a4197a HTTP/1.1" 200 None 2026-04-01 09:01:08,030 - lava_callback - INFO - Completed processing callback for node 69ccdeb874bda3ec93a4197a INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:01:17,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:17,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:01:26,853 - lava_callback - INFO - Received callback for node 69ccded674bda3ec93a419e3 INFO: 172.21.0.1:37092 - "POST /node/69ccded674bda3ec93a419e3 HTTP/1.0" 202 Accepted 2026-04-01 09:01:26,859 - lava_callback - INFO - Starting async job submit for node 69ccded674bda3ec93a419e3 2026-04-01 09:01:26,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:26,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded674bda3ec93a419e3 HTTP/1.1" 200 None 2026-04-01 09:01:26,882 - lava_callback - DEBUG - Processing node 69ccded674bda3ec93a419e3: baseline-nfs-arm64 2026-04-01 09:01:26,884 - lava_callback - WARNING - Failed to upload log 2026-04-01 09:01:26,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:01:27,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:01:27,050 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded674bda3ec93a419e3/lava-logs.yaml 2026-04-01 09:01:27,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:01:27,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:01:27,197 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded674bda3ec93a419e3/lava_callback.json.gz 2026-04-01 09:01:27,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:27,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded674bda3ec93a419e3 HTTP/1.1" 200 None 2026-04-01 09:01:27,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:27,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:01:27,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:27,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccded674bda3ec93a419e3 HTTP/1.1" 200 None 2026-04-01 09:01:27,270 - lava_callback - INFO - Completed processing callback for node 69ccded674bda3ec93a419e3 INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:01:42,347 - lava_callback - INFO - Received callback for node 69ccdec574bda3ec93a4199b INFO: 172.21.0.1:43184 - "POST /node/69ccdec574bda3ec93a4199b HTTP/1.0" 202 Accepted 2026-04-01 09:01:42,353 - lava_callback - INFO - Starting async job submit for node 69ccdec574bda3ec93a4199b 2026-04-01 09:01:42,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:42,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec574bda3ec93a4199b HTTP/1.1" 200 None 2026-04-01 09:01:42,387 - lava_callback - DEBUG - Processing node 69ccdec574bda3ec93a4199b: baseline-arm64 2026-04-01 09:01:42,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:01:42,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:01:42,752 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec574bda3ec93a4199b/log.txt.gz 2026-04-01 09:01:42,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:01:43,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:01:43,260 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec574bda3ec93a4199b/lava-logs.yaml 2026-04-01 09:01:43,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:01:43,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:01:43,471 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec574bda3ec93a4199b/lava_callback.json.gz 2026-04-01 09:01:43,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:43,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec574bda3ec93a4199b HTTP/1.1" 200 None 2026-04-01 09:01:43,516 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:43,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:01:43,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:43,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdec574bda3ec93a4199b HTTP/1.1" 200 None 2026-04-01 09:01:43,565 - lava_callback - INFO - Completed processing callback for node 69ccdec574bda3ec93a4199b INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:01:47,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:47,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 09:01:51,916 - lava_callback - INFO - Received callback for node 69ccdeba74bda3ec93a41980 INFO: 172.21.0.1:44114 - "POST /node/69ccdeba74bda3ec93a41980 HTTP/1.0" 202 Accepted 2026-04-01 09:01:51,922 - lava_callback - INFO - Starting async job submit for node 69ccdeba74bda3ec93a41980 2026-04-01 09:01:51,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:51,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeba74bda3ec93a41980 HTTP/1.1" 200 None 2026-04-01 09:01:51,969 - lava_callback - DEBUG - Processing node 69ccdeba74bda3ec93a41980: baseline-arm64 2026-04-01 09:01:52,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:01:52,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:01:52,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdeba74bda3ec93a41980/log.txt.gz 2026-04-01 09:01:52,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:01:52,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:01:52,982 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdeba74bda3ec93a41980/lava-logs.yaml 2026-04-01 09:01:52,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:01:53,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:01:53,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdeba74bda3ec93a41980/lava_callback.json.gz 2026-04-01 09:01:53,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:53,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeba74bda3ec93a41980 HTTP/1.1" 200 None 2026-04-01 09:01:53,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:53,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:01:53,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:01:53,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdeba74bda3ec93a41980 HTTP/1.1" 200 None 2026-04-01 09:01:53,233 - lava_callback - INFO - Completed processing callback for node 69ccdeba74bda3ec93a41980 INFO: 172.21.0.1:44122 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:02:06,493 - lava_callback - INFO - Received callback for node 69ccdec274bda3ec93a41992 INFO: 172.21.0.1:41490 - "POST /node/69ccdec274bda3ec93a41992 HTTP/1.0" 202 Accepted 2026-04-01 09:02:06,500 - lava_callback - INFO - Starting async job submit for node 69ccdec274bda3ec93a41992 2026-04-01 09:02:06,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:41504 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:02:06,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec274bda3ec93a41992 HTTP/1.1" 200 None 2026-04-01 09:02:06,538 - lava_callback - DEBUG - Processing node 69ccdec274bda3ec93a41992: baseline-arm64 2026-04-01 09:02:06,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:06,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:06,990 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec274bda3ec93a41992/log.txt.gz 2026-04-01 09:02:07,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:07,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:07,395 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec274bda3ec93a41992/lava-logs.yaml 2026-04-01 09:02:07,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:07,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:07,548 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec274bda3ec93a41992/lava_callback.json.gz 2026-04-01 09:02:07,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:07,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec274bda3ec93a41992 HTTP/1.1" 200 None 2026-04-01 09:02:07,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:07,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:07,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:07,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdec274bda3ec93a41992 HTTP/1.1" 200 None 2026-04-01 09:02:07,637 - lava_callback - INFO - Completed processing callback for node 69ccdec274bda3ec93a41992 INFO: 172.21.0.1:41508 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:02:12,361 - lava_callback - INFO - Received callback for node 69ccdec474bda3ec93a41998 INFO: 172.21.0.1:56858 - "POST /node/69ccdec474bda3ec93a41998 HTTP/1.0" 202 Accepted 2026-04-01 09:02:12,371 - lava_callback - INFO - Starting async job submit for node 69ccdec474bda3ec93a41998 2026-04-01 09:02:12,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:12,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec474bda3ec93a41998 HTTP/1.1" 200 None 2026-04-01 09:02:12,408 - lava_callback - DEBUG - Processing node 69ccdec474bda3ec93a41998: baseline-arm64 2026-04-01 09:02:12,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:12,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:12,923 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec474bda3ec93a41998/log.txt.gz 2026-04-01 09:02:13,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:13,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:13,368 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec474bda3ec93a41998/lava-logs.yaml 2026-04-01 09:02:13,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:13,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:13,542 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec474bda3ec93a41998/lava_callback.json.gz 2026-04-01 09:02:13,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:13,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec474bda3ec93a41998 HTTP/1.1" 200 None 2026-04-01 09:02:13,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:13,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:13,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:13,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdec474bda3ec93a41998 HTTP/1.1" 200 None 2026-04-01 09:02:13,637 - lava_callback - INFO - Completed processing callback for node 69ccdec474bda3ec93a41998 INFO: 172.21.0.1:56870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:02:17,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:17,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 09:02:17,920 - lava_callback - INFO - Received callback for node 69ccdeb974bda3ec93a4197d INFO: 172.21.0.1:56888 - "POST /node/69ccdeb974bda3ec93a4197d HTTP/1.0" 202 Accepted 2026-04-01 09:02:17,926 - lava_callback - INFO - Starting async job submit for node 69ccdeb974bda3ec93a4197d 2026-04-01 09:02:17,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:17,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeb974bda3ec93a4197d HTTP/1.1" 200 None 2026-04-01 09:02:17,963 - lava_callback - DEBUG - Processing node 69ccdeb974bda3ec93a4197d: baseline-arm64 2026-04-01 09:02:18,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:18,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:18,300 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdeb974bda3ec93a4197d/log.txt.gz 2026-04-01 09:02:18,363 - lava_callback - INFO - Received callback for node 69ccdebe74bda3ec93a41989 INFO: 172.21.0.1:56892 - "POST /node/69ccdebe74bda3ec93a41989 HTTP/1.0" 202 Accepted 2026-04-01 09:02:18,382 - lava_callback - INFO - Starting async job submit for node 69ccdebe74bda3ec93a41989 2026-04-01 09:02:18,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:18,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:18,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdebe74bda3ec93a41989 HTTP/1.1" 200 None 2026-04-01 09:02:18,496 - lava_callback - DEBUG - Processing node 69ccdebe74bda3ec93a41989: baseline-arm64 2026-04-01 09:02:18,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:18,784 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:18,786 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdeb974bda3ec93a4197d/lava-logs.yaml 2026-04-01 09:02:18,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:18,821 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:18,823 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdebe74bda3ec93a41989/log.txt.gz 2026-04-01 09:02:18,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:18,945 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:18,947 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdeb974bda3ec93a4197d/lava_callback.json.gz 2026-04-01 09:02:18,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:18,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeb974bda3ec93a4197d HTTP/1.1" 200 None 2026-04-01 09:02:18,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:19,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:19,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:19,062 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdeb974bda3ec93a4197d HTTP/1.1" 200 None 2026-04-01 09:02:19,074 - lava_callback - INFO - Completed processing callback for node 69ccdeb974bda3ec93a4197d 2026-04-01 09:02:19,171 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:19,174 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdebe74bda3ec93a41989/lava-logs.yaml 2026-04-01 09:02:19,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:19,326 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:19,328 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdebe74bda3ec93a41989/lava_callback.json.gz 2026-04-01 09:02:19,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:19,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdebe74bda3ec93a41989 HTTP/1.1" 200 None 2026-04-01 09:02:19,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:19,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:19,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:19,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdebe74bda3ec93a41989 HTTP/1.1" 200 None 2026-04-01 09:02:19,499 - lava_callback - INFO - Completed processing callback for node 69ccdebe74bda3ec93a41989 2026-04-01 09:02:21,262 - lava_callback - INFO - Received callback for node 69ccdecb74bda3ec93a419c7 INFO: 172.21.0.1:36366 - "POST /node/69ccdecb74bda3ec93a419c7 HTTP/1.0" 202 Accepted 2026-04-01 09:02:21,269 - lava_callback - INFO - Starting async job submit for node 69ccdecb74bda3ec93a419c7 2026-04-01 09:02:21,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:21,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdecb74bda3ec93a419c7 HTTP/1.1" 200 None 2026-04-01 09:02:21,312 - lava_callback - DEBUG - Processing node 69ccdecb74bda3ec93a419c7: baseline-arm64 2026-04-01 09:02:21,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:21,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:21,871 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdecb74bda3ec93a419c7/log.txt.gz 2026-04-01 09:02:22,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:22,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:22,297 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdecb74bda3ec93a419c7/lava-logs.yaml 2026-04-01 09:02:22,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:22,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:22,500 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdecb74bda3ec93a419c7/lava_callback.json.gz 2026-04-01 09:02:22,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:22,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdecb74bda3ec93a419c7 HTTP/1.1" 200 None 2026-04-01 09:02:22,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:22,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:22,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:22,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdecb74bda3ec93a419c7 HTTP/1.1" 200 None 2026-04-01 09:02:22,591 - lava_callback - INFO - Completed processing callback for node 69ccdecb74bda3ec93a419c7 2026-04-01 09:02:22,727 - lava_callback - INFO - Received callback for node 69ccdec974bda3ec93a419c0 INFO: 172.21.0.1:36370 - "POST /node/69ccdec974bda3ec93a419c0 HTTP/1.0" 202 Accepted 2026-04-01 09:02:22,736 - lava_callback - INFO - Starting async job submit for node 69ccdec974bda3ec93a419c0 2026-04-01 09:02:22,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:22,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec974bda3ec93a419c0 HTTP/1.1" 200 None 2026-04-01 09:02:22,783 - lava_callback - DEBUG - Processing node 69ccdec974bda3ec93a419c0: baseline-arm64 2026-04-01 09:02:23,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:23,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:23,491 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec974bda3ec93a419c0/log.txt.gz 2026-04-01 09:02:23,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:23,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:23,878 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec974bda3ec93a419c0/lava-logs.yaml 2026-04-01 09:02:23,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:24,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:24,039 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec974bda3ec93a419c0/lava_callback.json.gz 2026-04-01 09:02:24,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:24,096 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec974bda3ec93a419c0 HTTP/1.1" 200 None 2026-04-01 09:02:24,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:24,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:24,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:24,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdec974bda3ec93a419c0 HTTP/1.1" 200 None 2026-04-01 09:02:24,160 - lava_callback - INFO - Completed processing callback for node 69ccdec974bda3ec93a419c0 INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:02:34,659 - lava_callback - INFO - Received callback for node 69ccded474bda3ec93a419dd INFO: 172.21.0.1:42368 - "POST /node/69ccded474bda3ec93a419dd HTTP/1.0" 202 Accepted 2026-04-01 09:02:34,666 - lava_callback - INFO - Starting async job submit for node 69ccded474bda3ec93a419dd 2026-04-01 09:02:34,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:34,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded474bda3ec93a419dd HTTP/1.1" 200 None 2026-04-01 09:02:34,705 - lava_callback - DEBUG - Processing node 69ccded474bda3ec93a419dd: baseline-nfs-arm64 2026-04-01 09:02:35,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:35,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:35,294 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded474bda3ec93a419dd/log.txt.gz 2026-04-01 09:02:35,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:35,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:35,767 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded474bda3ec93a419dd/lava-logs.yaml 2026-04-01 09:02:35,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:35,925 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:35,926 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded474bda3ec93a419dd/lava_callback.json.gz 2026-04-01 09:02:35,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:35,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded474bda3ec93a419dd HTTP/1.1" 200 None 2026-04-01 09:02:35,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:35,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:35,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:36,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccded474bda3ec93a419dd HTTP/1.1" 200 None 2026-04-01 09:02:36,007 - lava_callback - INFO - Completed processing callback for node 69ccded474bda3ec93a419dd INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:02:37,969 - lava_callback - INFO - Received callback for node 69ccdec774bda3ec93a419ba INFO: 172.21.0.1:42376 - "POST /node/69ccdec774bda3ec93a419ba HTTP/1.0" 202 Accepted 2026-04-01 09:02:37,975 - lava_callback - INFO - Starting async job submit for node 69ccdec774bda3ec93a419ba 2026-04-01 09:02:37,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:38,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec774bda3ec93a419ba HTTP/1.1" 200 None 2026-04-01 09:02:38,011 - lava_callback - DEBUG - Processing node 69ccdec774bda3ec93a419ba: baseline-arm64 2026-04-01 09:02:38,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:38,378 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:38,379 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec774bda3ec93a419ba/log.txt.gz 2026-04-01 09:02:38,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:38,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:38,714 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec774bda3ec93a419ba/lava-logs.yaml 2026-04-01 09:02:38,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:38,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:38,889 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec774bda3ec93a419ba/lava_callback.json.gz 2026-04-01 09:02:38,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:38,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec774bda3ec93a419ba HTTP/1.1" 200 None 2026-04-01 09:02:38,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:38,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:38,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:39,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdec774bda3ec93a419ba HTTP/1.1" 200 None 2026-04-01 09:02:39,006 - lava_callback - INFO - Completed processing callback for node 69ccdec774bda3ec93a419ba 2026-04-01 09:02:39,101 - lava_callback - INFO - Received callback for node 69ccdec374bda3ec93a41995 INFO: 172.21.0.1:42384 - "POST /node/69ccdec374bda3ec93a41995 HTTP/1.0" 202 Accepted 2026-04-01 09:02:39,110 - lava_callback - INFO - Starting async job submit for node 69ccdec374bda3ec93a41995 2026-04-01 09:02:39,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:39,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec374bda3ec93a41995 HTTP/1.1" 200 None 2026-04-01 09:02:39,199 - lava_callback - DEBUG - Processing node 69ccdec374bda3ec93a41995: baseline-arm64 2026-04-01 09:02:39,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:39,952 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:39,954 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec374bda3ec93a41995/log.txt.gz 2026-04-01 09:02:40,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:40,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:40,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec374bda3ec93a41995/lava-logs.yaml 2026-04-01 09:02:40,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:40,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:40,578 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec374bda3ec93a41995/lava_callback.json.gz 2026-04-01 09:02:40,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:40,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec374bda3ec93a41995 HTTP/1.1" 200 None 2026-04-01 09:02:40,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:40,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:40,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:40,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdec374bda3ec93a41995 HTTP/1.1" 200 None 2026-04-01 09:02:40,680 - lava_callback - INFO - Completed processing callback for node 69ccdec374bda3ec93a41995 2026-04-01 09:02:45,875 - lava_callback - INFO - Received callback for node 69ccdec074bda3ec93a4198f INFO: 172.21.0.1:41556 - "POST /node/69ccdec074bda3ec93a4198f HTTP/1.0" 202 Accepted 2026-04-01 09:02:45,881 - lava_callback - INFO - Starting async job submit for node 69ccdec074bda3ec93a4198f 2026-04-01 09:02:45,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:45,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec074bda3ec93a4198f HTTP/1.1" 200 None 2026-04-01 09:02:45,921 - lava_callback - DEBUG - Processing node 69ccdec074bda3ec93a4198f: baseline-arm64 2026-04-01 09:02:46,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:46,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:46,325 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec074bda3ec93a4198f/log.txt.gz INFO: 172.21.0.1:41572 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:02:46,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:46,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:46,741 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec074bda3ec93a4198f/lava-logs.yaml 2026-04-01 09:02:46,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:46,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:46,911 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec074bda3ec93a4198f/lava_callback.json.gz 2026-04-01 09:02:46,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:46,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec074bda3ec93a4198f HTTP/1.1" 200 None 2026-04-01 09:02:46,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:46,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:46,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:47,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdec074bda3ec93a4198f HTTP/1.1" 200 None 2026-04-01 09:02:47,007 - lava_callback - INFO - Completed processing callback for node 69ccdec074bda3ec93a4198f 2026-04-01 09:02:47,043 - lava_callback - INFO - Received callback for node 69ccdebc74bda3ec93a41986 INFO: 172.21.0.1:41582 - "POST /node/69ccdebc74bda3ec93a41986 HTTP/1.0" 202 Accepted 2026-04-01 09:02:47,056 - lava_callback - INFO - Starting async job submit for node 69ccdebc74bda3ec93a41986 2026-04-01 09:02:47,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:47,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdebc74bda3ec93a41986 HTTP/1.1" 200 None 2026-04-01 09:02:47,124 - lava_callback - DEBUG - Processing node 69ccdebc74bda3ec93a41986: baseline-arm64 2026-04-01 09:02:47,296 - lava_callback - WARNING - Failed to upload log 2026-04-01 09:02:47,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:47,581 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:47,583 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdebc74bda3ec93a41986/lava-logs.yaml 2026-04-01 09:02:47,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:47,698 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:47,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdebc74bda3ec93a41986/lava_callback.json.gz 2026-04-01 09:02:47,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:47,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdebc74bda3ec93a41986 HTTP/1.1" 200 None 2026-04-01 09:02:47,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:47,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:47,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:47,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:47,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-01 09:02:47,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdebc74bda3ec93a41986 HTTP/1.1" 200 None 2026-04-01 09:02:47,870 - lava_callback - INFO - Completed processing callback for node 69ccdebc74bda3ec93a41986 2026-04-01 09:02:50,356 - lava_callback - INFO - Received callback for node 69ccdef074bda3ec93a41a3a INFO: 172.21.0.1:58550 - "POST /node/69ccdef074bda3ec93a41a3a HTTP/1.0" 202 Accepted 2026-04-01 09:02:50,362 - lava_callback - INFO - Starting async job submit for node 69ccdef074bda3ec93a41a3a 2026-04-01 09:02:50,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:50,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdef074bda3ec93a41a3a HTTP/1.1" 200 None 2026-04-01 09:02:50,402 - lava_callback - DEBUG - Processing node 69ccdef074bda3ec93a41a3a: baseline-arm64-broonie 2026-04-01 09:02:50,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:50,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:50,795 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef074bda3ec93a41a3a/log.txt.gz 2026-04-01 09:02:50,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:51,159 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:51,160 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef074bda3ec93a41a3a/lava-logs.yaml 2026-04-01 09:02:51,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:51,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:51,307 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef074bda3ec93a41a3a/lava_callback.json.gz 2026-04-01 09:02:51,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:51,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdef074bda3ec93a41a3a HTTP/1.1" 200 None 2026-04-01 09:02:51,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:51,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:51,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:51,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdef074bda3ec93a41a3a HTTP/1.1" 200 None 2026-04-01 09:02:51,411 - lava_callback - INFO - Completed processing callback for node 69ccdef074bda3ec93a41a3a INFO: 172.21.0.1:58556 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:02:56,750 - lava_callback - INFO - Received callback for node 69ccded174bda3ec93a419d3 INFO: 172.21.0.1:58572 - "POST /node/69ccded174bda3ec93a419d3 HTTP/1.0" 202 Accepted 2026-04-01 09:02:56,759 - lava_callback - INFO - Starting async job submit for node 69ccded174bda3ec93a419d3 2026-04-01 09:02:56,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:56,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded174bda3ec93a419d3 HTTP/1.1" 200 None 2026-04-01 09:02:56,823 - lava_callback - DEBUG - Processing node 69ccded174bda3ec93a419d3: baseline-nfs-arm64 2026-04-01 09:02:57,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:57,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:57,428 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded174bda3ec93a419d3/log.txt.gz 2026-04-01 09:02:57,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:57,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:57,909 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded174bda3ec93a419d3/lava-logs.yaml 2026-04-01 09:02:57,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:58,085 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:58,087 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded174bda3ec93a419d3/lava_callback.json.gz 2026-04-01 09:02:58,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:58,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded174bda3ec93a419d3 HTTP/1.1" 200 None 2026-04-01 09:02:58,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:58,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:58,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:58,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccded174bda3ec93a419d3 HTTP/1.1" 200 None 2026-04-01 09:02:58,170 - lava_callback - INFO - Completed processing callback for node 69ccded174bda3ec93a419d3 2026-04-01 09:02:58,437 - lava_callback - INFO - Received callback for node 69ccdeff74bda3ec93a41a63 INFO: 172.21.0.1:58584 - "POST /node/69ccdeff74bda3ec93a41a63 HTTP/1.0" 202 Accepted 2026-04-01 09:02:58,444 - lava_callback - INFO - Starting async job submit for node 69ccdeff74bda3ec93a41a63 2026-04-01 09:02:58,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:58,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeff74bda3ec93a41a63 HTTP/1.1" 200 None 2026-04-01 09:02:58,479 - lava_callback - DEBUG - Processing node 69ccdeff74bda3ec93a41a63: baseline-arm64-pengutronix 2026-04-01 09:02:58,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:58,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:58,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ccdeff74bda3ec93a41a63/log.txt.gz 2026-04-01 09:02:58,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:59,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:59,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ccdeff74bda3ec93a41a63/lava-logs.yaml 2026-04-01 09:02:59,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:02:59,206 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:02:59,208 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ccdeff74bda3ec93a41a63/lava_callback.json.gz 2026-04-01 09:02:59,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:59,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeff74bda3ec93a41a63 HTTP/1.1" 200 None 2026-04-01 09:02:59,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:59,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:02:59,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:02:59,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdeff74bda3ec93a41a63 HTTP/1.1" 200 None 2026-04-01 09:02:59,303 - lava_callback - INFO - Completed processing callback for node 69ccdeff74bda3ec93a41a63 2026-04-01 09:03:01,616 - lava_callback - INFO - Received callback for node 69ccdf0374bda3ec93a41a8a INFO: 172.21.0.1:57010 - "POST /node/69ccdf0374bda3ec93a41a8a HTTP/1.0" 202 Accepted 2026-04-01 09:03:01,626 - lava_callback - INFO - Starting async job submit for node 69ccdf0374bda3ec93a41a8a 2026-04-01 09:03:01,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:01,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdf0374bda3ec93a41a8a HTTP/1.1" 200 None 2026-04-01 09:03:01,685 - lava_callback - DEBUG - Processing node 69ccdf0374bda3ec93a41a8a: baseline-arm64-foundriesio 2026-04-01 09:03:02,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:02,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:02,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ccdf0374bda3ec93a41a8a/log.txt.gz 2026-04-01 09:03:02,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:02,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:02,633 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ccdf0374bda3ec93a41a8a/lava-logs.yaml 2026-04-01 09:03:02,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:02,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:02,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ccdf0374bda3ec93a41a8a/lava_callback.json.gz 2026-04-01 09:03:02,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:02,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdf0374bda3ec93a41a8a HTTP/1.1" 200 None 2026-04-01 09:03:02,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:02,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:03:02,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:02,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdf0374bda3ec93a41a8a HTTP/1.1" 200 None 2026-04-01 09:03:02,927 - lava_callback - INFO - Completed processing callback for node 69ccdf0374bda3ec93a41a8a 2026-04-01 09:03:03,114 - lava_callback - INFO - Received callback for node 69ccdeda74bda3ec93a419ec INFO: 172.21.0.1:57024 - "POST /node/69ccdeda74bda3ec93a419ec HTTP/1.0" 202 Accepted 2026-04-01 09:03:03,123 - lava_callback - INFO - Starting async job submit for node 69ccdeda74bda3ec93a419ec 2026-04-01 09:03:03,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:03,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeda74bda3ec93a419ec HTTP/1.1" 200 None 2026-04-01 09:03:03,176 - lava_callback - DEBUG - Processing node 69ccdeda74bda3ec93a419ec: baseline-nfs-arm64 2026-04-01 09:03:03,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:03,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:03,678 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccdeda74bda3ec93a419ec/log.txt.gz 2026-04-01 09:03:03,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:04,093 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:04,095 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccdeda74bda3ec93a419ec/lava-logs.yaml 2026-04-01 09:03:04,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:04,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:04,256 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccdeda74bda3ec93a419ec/lava_callback.json.gz 2026-04-01 09:03:04,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:04,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeda74bda3ec93a419ec HTTP/1.1" 200 None 2026-04-01 09:03:04,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:04,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:03:04,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:04,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdeda74bda3ec93a419ec HTTP/1.1" 200 None 2026-04-01 09:03:04,347 - lava_callback - INFO - Completed processing callback for node 69ccdeda74bda3ec93a419ec INFO: 172.21.0.1:57040 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:03:08,796 - lava_callback - INFO - Received callback for node 69ccdf0074bda3ec93a41a66 INFO: 172.21.0.1:57044 - "POST /node/69ccdf0074bda3ec93a41a66 HTTP/1.0" 202 Accepted 2026-04-01 09:03:08,802 - lava_callback - INFO - Starting async job submit for node 69ccdf0074bda3ec93a41a66 2026-04-01 09:03:08,818 - lava_callback - INFO - Received callback for node 69ccded874bda3ec93a419e6 INFO: 172.21.0.1:57052 - "POST /node/69ccded874bda3ec93a419e6 HTTP/1.0" 202 Accepted 2026-04-01 09:03:08,828 - lava_callback - INFO - Starting async job submit for node 69ccded874bda3ec93a419e6 2026-04-01 09:03:08,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:08,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:08,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdf0074bda3ec93a41a66 HTTP/1.1" 200 None 2026-04-01 09:03:08,867 - lava_callback - DEBUG - Processing node 69ccdf0074bda3ec93a41a66: baseline-arm64-pengutronix 2026-04-01 09:03:08,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded874bda3ec93a419e6 HTTP/1.1" 200 None 2026-04-01 09:03:08,894 - lava_callback - DEBUG - Processing node 69ccded874bda3ec93a419e6: baseline-nfs-arm64 INFO: 172.21.0.1:57054 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:03:09,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:09,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:09,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:09,558 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ccdf0074bda3ec93a41a66/log.txt.gz 2026-04-01 09:03:09,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:09,632 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded874bda3ec93a419e6/log.txt.gz 2026-04-01 09:03:09,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:09,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:10,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:10,129 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded874bda3ec93a419e6/lava-logs.yaml 2026-04-01 09:03:10,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:10,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:10,171 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ccdf0074bda3ec93a41a66/lava-logs.yaml 2026-04-01 09:03:10,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:10,333 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:10,336 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded874bda3ec93a419e6/lava_callback.json.gz 2026-04-01 09:03:10,367 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:10,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:10,376 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ccdf0074bda3ec93a41a66/lava_callback.json.gz 2026-04-01 09:03:10,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:10,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded874bda3ec93a419e6 HTTP/1.1" 200 None 2026-04-01 09:03:10,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:10,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdf0074bda3ec93a41a66 HTTP/1.1" 200 None 2026-04-01 09:03:10,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:10,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:03:10,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:10,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:03:10,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:10,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccded874bda3ec93a419e6 HTTP/1.1" 200 None 2026-04-01 09:03:10,484 - lava_callback - INFO - Completed processing callback for node 69ccded874bda3ec93a419e6 2026-04-01 09:03:10,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdf0074bda3ec93a41a66 HTTP/1.1" 200 None 2026-04-01 09:03:10,578 - lava_callback - INFO - Completed processing callback for node 69ccdf0074bda3ec93a41a66 2026-04-01 09:03:11,147 - lava_callback - INFO - Received callback for node 69ccdf0374bda3ec93a41a8d INFO: 172.21.0.1:33110 - "POST /node/69ccdf0374bda3ec93a41a8d HTTP/1.0" 202 Accepted 2026-04-01 09:03:11,158 - lava_callback - INFO - Starting async job submit for node 69ccdf0374bda3ec93a41a8d 2026-04-01 09:03:11,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:11,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdf0374bda3ec93a41a8d HTTP/1.1" 200 None 2026-04-01 09:03:11,207 - lava_callback - DEBUG - Processing node 69ccdf0374bda3ec93a41a8d: baseline-arm64-foundriesio 2026-04-01 09:03:11,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:11,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:11,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ccdf0374bda3ec93a41a8d/log.txt.gz 2026-04-01 09:03:11,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:12,163 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:12,166 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ccdf0374bda3ec93a41a8d/lava-logs.yaml 2026-04-01 09:03:12,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:12,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:12,608 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ccdf0374bda3ec93a41a8d/lava_callback.json.gz 2026-04-01 09:03:12,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:12,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdf0374bda3ec93a41a8d HTTP/1.1" 200 None 2026-04-01 09:03:12,678 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:12,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:03:12,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:12,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdf0374bda3ec93a41a8d HTTP/1.1" 200 None 2026-04-01 09:03:12,731 - lava_callback - INFO - Completed processing callback for node 69ccdf0374bda3ec93a41a8d 2026-04-01 09:03:14,253 - lava_callback - INFO - Received callback for node 69ccdef474bda3ec93a41a40 INFO: 172.21.0.1:33116 - "POST /node/69ccdef474bda3ec93a41a40 HTTP/1.0" 202 Accepted 2026-04-01 09:03:14,260 - lava_callback - INFO - Starting async job submit for node 69ccdef474bda3ec93a41a40 2026-04-01 09:03:14,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:14,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdef474bda3ec93a41a40 HTTP/1.1" 200 None 2026-04-01 09:03:14,298 - lava_callback - DEBUG - Processing node 69ccdef474bda3ec93a41a40: baseline-arm64-broonie 2026-04-01 09:03:14,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:14,685 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:14,687 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef474bda3ec93a41a40/log.txt.gz 2026-04-01 09:03:14,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:15,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:15,016 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef474bda3ec93a41a40/lava-logs.yaml 2026-04-01 09:03:15,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:15,110 - lava_callback - INFO - Received callback for node 69ccdf0274bda3ec93a41a87 INFO: 172.21.0.1:33132 - "POST /node/69ccdf0274bda3ec93a41a87 HTTP/1.0" 202 Accepted 2026-04-01 09:03:15,120 - lava_callback - INFO - Starting async job submit for node 69ccdf0274bda3ec93a41a87 2026-04-01 09:03:15,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33140 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-01 09:03:15,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdf0274bda3ec93a41a87 HTTP/1.1" 200 None 2026-04-01 09:03:15,168 - lava_callback - DEBUG - Processing node 69ccdf0274bda3ec93a41a87: baseline-arm64-pengutronix 2026-04-01 09:03:15,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:15,235 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef474bda3ec93a41a40/lava_callback.json.gz 2026-04-01 09:03:15,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:15,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdef474bda3ec93a41a40 HTTP/1.1" 200 None 2026-04-01 09:03:15,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:15,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:03:15,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:15,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:15,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdef474bda3ec93a41a40 HTTP/1.1" 200 None 2026-04-01 09:03:15,518 - lava_callback - INFO - Completed processing callback for node 69ccdef474bda3ec93a41a40 2026-04-01 09:03:15,681 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:15,683 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ccdf0274bda3ec93a41a87/log.txt.gz 2026-04-01 09:03:15,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:16,024 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:16,026 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ccdf0274bda3ec93a41a87/lava-logs.yaml 2026-04-01 09:03:16,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:16,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:16,185 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ccdf0274bda3ec93a41a87/lava_callback.json.gz 2026-04-01 09:03:16,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:16,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdf0274bda3ec93a41a87 HTTP/1.1" 200 None 2026-04-01 09:03:16,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:16,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:03:16,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:16,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdf0274bda3ec93a41a87 HTTP/1.1" 200 None 2026-04-01 09:03:16,278 - lava_callback - INFO - Completed processing callback for node 69ccdf0274bda3ec93a41a87 INFO: 172.21.0.1:33148 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:03:17,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:17,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-01 09:03:19,557 - lava_callback - INFO - Received callback for node 69ccdedc74bda3ec93a419f5 INFO: 172.21.0.1:33156 - "POST /node/69ccdedc74bda3ec93a419f5 HTTP/1.0" 202 Accepted 2026-04-01 09:03:19,563 - lava_callback - INFO - Starting async job submit for node 69ccdedc74bda3ec93a419f5 2026-04-01 09:03:19,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:19,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdedc74bda3ec93a419f5 HTTP/1.1" 200 None 2026-04-01 09:03:19,619 - lava_callback - DEBUG - Processing node 69ccdedc74bda3ec93a419f5: baseline-nfs-arm64 2026-04-01 09:03:19,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:20,139 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:20,140 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccdedc74bda3ec93a419f5/log.txt.gz 2026-04-01 09:03:20,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:20,598 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:20,600 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccdedc74bda3ec93a419f5/lava-logs.yaml 2026-04-01 09:03:20,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:20,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:20,811 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccdedc74bda3ec93a419f5/lava_callback.json.gz 2026-04-01 09:03:20,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:20,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdedc74bda3ec93a419f5 HTTP/1.1" 200 None 2026-04-01 09:03:20,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:20,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:03:20,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:20,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdedc74bda3ec93a419f5 HTTP/1.1" 200 None 2026-04-01 09:03:20,924 - lava_callback - INFO - Completed processing callback for node 69ccdedc74bda3ec93a419f5 INFO: 172.21.0.1:35124 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:03:29,754 - lava_callback - INFO - Received callback for node 69ccdefb74bda3ec93a41a56 INFO: 172.21.0.1:44322 - "POST /node/69ccdefb74bda3ec93a41a56 HTTP/1.0" 202 Accepted 2026-04-01 09:03:29,760 - lava_callback - INFO - Starting async job submit for node 69ccdefb74bda3ec93a41a56 2026-04-01 09:03:29,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:29,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdefb74bda3ec93a41a56 HTTP/1.1" 200 None 2026-04-01 09:03:29,802 - lava_callback - DEBUG - Processing node 69ccdefb74bda3ec93a41a56: baseline-arm64-clabbe 2026-04-01 09:03:30,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:30,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:30,155 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ccdefb74bda3ec93a41a56/log.txt.gz 2026-04-01 09:03:30,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:30,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:30,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ccdefb74bda3ec93a41a56/lava-logs.yaml 2026-04-01 09:03:30,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:30,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:30,660 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ccdefb74bda3ec93a41a56/lava_callback.json.gz 2026-04-01 09:03:30,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:30,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdefb74bda3ec93a41a56 HTTP/1.1" 200 None 2026-04-01 09:03:30,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:30,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:03:30,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:30,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdefb74bda3ec93a41a56 HTTP/1.1" 200 None 2026-04-01 09:03:30,775 - lava_callback - INFO - Completed processing callback for node 69ccdefb74bda3ec93a41a56 2026-04-01 09:03:35,612 - lava_callback - INFO - Received callback for node 69ccdeed74bda3ec93a41a34 INFO: 172.21.0.1:44328 - "POST /node/69ccdeed74bda3ec93a41a34 HTTP/1.0" 202 Accepted 2026-04-01 09:03:35,622 - lava_callback - INFO - Starting async job submit for node 69ccdeed74bda3ec93a41a34 2026-04-01 09:03:35,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:35,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeed74bda3ec93a41a34 HTTP/1.1" 200 None 2026-04-01 09:03:35,685 - lava_callback - DEBUG - Processing node 69ccdeed74bda3ec93a41a34: baseline-arm64-broonie 2026-04-01 09:03:36,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:36,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:36,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdeed74bda3ec93a41a34/log.txt.gz 2026-04-01 09:03:36,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:03:36,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:36,653 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdeed74bda3ec93a41a34/lava-logs.yaml 2026-04-01 09:03:36,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:36,839 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:36,841 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdeed74bda3ec93a41a34/lava_callback.json.gz 2026-04-01 09:03:36,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:36,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeed74bda3ec93a41a34 HTTP/1.1" 200 None 2026-04-01 09:03:36,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:36,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:03:36,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:36,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdeed74bda3ec93a41a34 HTTP/1.1" 200 None 2026-04-01 09:03:36,939 - lava_callback - INFO - Completed processing callback for node 69ccdeed74bda3ec93a41a34 INFO: 172.21.0.1:60834 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:03:47,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:47,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 09:03:51,152 - lava_callback - INFO - Received callback for node 69ccdef574bda3ec93a41a43 INFO: 172.21.0.1:50194 - "POST /node/69ccdef574bda3ec93a41a43 HTTP/1.0" 202 Accepted 2026-04-01 09:03:51,159 - lava_callback - INFO - Starting async job submit for node 69ccdef574bda3ec93a41a43 2026-04-01 09:03:51,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:51,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdef574bda3ec93a41a43 HTTP/1.1" 200 None 2026-04-01 09:03:51,215 - lava_callback - DEBUG - Processing node 69ccdef574bda3ec93a41a43: baseline-arm64-broonie 2026-04-01 09:03:51,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:51,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:51,640 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef574bda3ec93a41a43/log.txt.gz 2026-04-01 09:03:51,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:51,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:51,999 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef574bda3ec93a41a43/lava-logs.yaml 2026-04-01 09:03:52,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:03:52,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:03:52,155 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdef574bda3ec93a41a43/lava_callback.json.gz 2026-04-01 09:03:52,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:52,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdef574bda3ec93a41a43 HTTP/1.1" 200 None 2026-04-01 09:03:52,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:52,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:03:52,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:03:52,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdef574bda3ec93a41a43 HTTP/1.1" 200 None 2026-04-01 09:03:52,238 - lava_callback - INFO - Completed processing callback for node 69ccdef574bda3ec93a41a43 INFO: 172.21.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:04:17,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:04:17,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 09:04:20,557 - lava_callback - INFO - Received callback for node 69ccdebf74bda3ec93a4198c INFO: 172.21.0.1:42578 - "POST /node/69ccdebf74bda3ec93a4198c HTTP/1.0" 202 Accepted 2026-04-01 09:04:20,563 - lava_callback - INFO - Starting async job submit for node 69ccdebf74bda3ec93a4198c 2026-04-01 09:04:20,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:04:20,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdebf74bda3ec93a4198c HTTP/1.1" 200 None 2026-04-01 09:04:20,612 - lava_callback - DEBUG - Processing node 69ccdebf74bda3ec93a4198c: baseline-arm64 2026-04-01 09:04:21,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:04:21,185 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:04:21,186 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdebf74bda3ec93a4198c/log.txt.gz 2026-04-01 09:04:21,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:04:21,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:04:21,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdebf74bda3ec93a4198c/lava-logs.yaml 2026-04-01 09:04:21,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:04:21,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:04:21,821 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdebf74bda3ec93a4198c/lava_callback.json.gz 2026-04-01 09:04:21,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:04:21,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdebf74bda3ec93a4198c HTTP/1.1" 200 None 2026-04-01 09:04:21,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:04:21,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:04:21,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:04:21,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdebf74bda3ec93a4198c HTTP/1.1" 200 None 2026-04-01 09:04:21,910 - lava_callback - INFO - Completed processing callback for node 69ccdebf74bda3ec93a4198c INFO: 172.21.0.1:42586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:04:47,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:04:47,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60322 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:05:10,668 - lava_callback - INFO - Received callback for node 69ccdeee74bda3ec93a41a37 INFO: 172.21.0.1:56706 - "POST /node/69ccdeee74bda3ec93a41a37 HTTP/1.0" 202 Accepted 2026-04-01 09:05:10,674 - lava_callback - INFO - Starting async job submit for node 69ccdeee74bda3ec93a41a37 2026-04-01 09:05:10,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:05:10,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeee74bda3ec93a41a37 HTTP/1.1" 200 None 2026-04-01 09:05:10,713 - lava_callback - DEBUG - Processing node 69ccdeee74bda3ec93a41a37: baseline-arm64-broonie 2026-04-01 09:05:10,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:05:11,162 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:05:11,163 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdeee74bda3ec93a41a37/log.txt.gz 2026-04-01 09:05:11,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:05:11,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:05:11,558 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdeee74bda3ec93a41a37/lava-logs.yaml 2026-04-01 09:05:11,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:05:11,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:05:11,873 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdeee74bda3ec93a41a37/lava_callback.json.gz 2026-04-01 09:05:11,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:05:11,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeee74bda3ec93a41a37 HTTP/1.1" 200 None 2026-04-01 09:05:11,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:05:11,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:05:11,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:05:11,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdeee74bda3ec93a41a37 HTTP/1.1" 200 None 2026-04-01 09:05:11,958 - lava_callback - INFO - Completed processing callback for node 69ccdeee74bda3ec93a41a37 INFO: 172.21.0.1:56718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:05:17,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:05:17,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:05:27,353 - lava_callback - INFO - Received callback for node 69ccded074bda3ec93a419d0 INFO: 172.21.0.1:33866 - "POST /node/69ccded074bda3ec93a419d0 HTTP/1.0" 202 Accepted 2026-04-01 09:05:27,359 - lava_callback - INFO - Starting async job submit for node 69ccded074bda3ec93a419d0 2026-04-01 09:05:27,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:05:27,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded074bda3ec93a419d0 HTTP/1.1" 200 None 2026-04-01 09:05:27,397 - lava_callback - DEBUG - Processing node 69ccded074bda3ec93a419d0: baseline-nfs-arm64 2026-04-01 09:05:27,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:05:28,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:05:28,055 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded074bda3ec93a419d0/log.txt.gz 2026-04-01 09:05:28,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:05:28,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:05:28,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded074bda3ec93a419d0/lava-logs.yaml 2026-04-01 09:05:28,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:05:28,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:05:28,826 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded074bda3ec93a419d0/lava_callback.json.gz 2026-04-01 09:05:28,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:05:28,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded074bda3ec93a419d0 HTTP/1.1" 200 None 2026-04-01 09:05:28,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:05:28,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:05:28,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:05:28,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccded074bda3ec93a419d0 HTTP/1.1" 200 None 2026-04-01 09:05:28,920 - lava_callback - INFO - Completed processing callback for node 69ccded074bda3ec93a419d0 INFO: 172.21.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45566 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:05:47,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:05:47,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51858 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:09:06,368 - lava_callback - INFO - Received callback for node 69ca3da00e33d030878a9477 INFO: 172.21.0.1:50106 - "POST /node/69ca3da00e33d030878a9477 HTTP/1.0" 202 Accepted 2026-04-01 09:09:06,374 - lava_callback - INFO - Starting async job submit for node 69ca3da00e33d030878a9477 2026-04-01 09:09:06,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:06,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3da00e33d030878a9477 HTTP/1.1" 200 None 2026-04-01 09:09:06,393 - lava_callback - DEBUG - Processing node 69ca3da00e33d030878a9477: baseline-arm-baylibre 2026-04-01 09:09:06,393 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3da00e33d030878a9477 2026-04-01 09:09:06,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:06,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3da00e33d030878a9477 HTTP/1.1" 200 None 2026-04-01 09:09:06,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:06,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-04-01 09:09:06,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:06,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3da00e33d030878a9477 HTTP/1.1" 200 None 2026-04-01 09:09:06,448 - lava_callback - ERROR - Error processing callback for node 69ca3da00e33d030878a9477: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50120 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:09:09,157 - lava_callback - INFO - Received callback for node 69ccdecd74bda3ec93a419ca INFO: 172.21.0.1:50124 - "POST /node/69ccdecd74bda3ec93a419ca HTTP/1.0" 202 Accepted 2026-04-01 09:09:09,164 - lava_callback - INFO - Starting async job submit for node 69ccdecd74bda3ec93a419ca 2026-04-01 09:09:09,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:09,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdecd74bda3ec93a419ca HTTP/1.1" 200 None 2026-04-01 09:09:09,214 - lava_callback - DEBUG - Processing node 69ccdecd74bda3ec93a419ca: baseline-arm64 INFO: 172.21.0.1:50128 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:09:09,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:09:09,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:09:09,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdecd74bda3ec93a419ca/log.txt.gz 2026-04-01 09:09:09,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:09:10,245 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:09:10,247 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdecd74bda3ec93a419ca/lava-logs.yaml 2026-04-01 09:09:10,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:09:10,438 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:09:10,440 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdecd74bda3ec93a419ca/lava_callback.json.gz DEBUG: Setup failed for 69ccdecd74bda3ec93a419ca. Transitting job node result: incomplete -> fail 2026-04-01 09:09:10,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:10,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdecd74bda3ec93a419ca HTTP/1.1" 200 None 2026-04-01 09:09:10,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:10,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:09:10,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:10,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdecd74bda3ec93a419ca HTTP/1.1" 200 None 2026-04-01 09:09:10,649 - lava_callback - INFO - Completed processing callback for node 69ccdecd74bda3ec93a419ca INFO: 172.21.0.1:50666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50676 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:09:17,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:17,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34058 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:09:34,896 - lava_callback - INFO - Received callback for node 69ccd99774bda3ec93a415d7 INFO: 172.21.0.1:34800 - "POST /node/69ccd99774bda3ec93a415d7 HTTP/1.0" 202 Accepted 2026-04-01 09:09:34,945 - lava_callback - INFO - Starting async job submit for node 69ccd99774bda3ec93a415d7 2026-04-01 09:09:34,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:34,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99774bda3ec93a415d7 HTTP/1.1" 200 None 2026-04-01 09:09:34,993 - lava_callback - DEBUG - Processing node 69ccd99774bda3ec93a415d7: ltp-syscalls-ipc 2026-04-01 09:09:35,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:09:35,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:09:35,239 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ccd99774bda3ec93a415d7/log.txt.gz 2026-04-01 09:09:35,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:09:35,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:09:35,492 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ccd99774bda3ec93a415d7/lava-logs.yaml 2026-04-01 09:09:35,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:09:35,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:09:35,633 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ccd99774bda3ec93a415d7/lava_callback.json.gz 2026-04-01 09:09:35,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:35,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd99774bda3ec93a415d7 HTTP/1.1" 200 None 2026-04-01 09:09:35,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:35,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 09:09:35,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:35,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccd99774bda3ec93a415d7 HTTP/1.1" 200 None 2026-04-01 09:09:35,777 - lava_callback - INFO - Completed processing callback for node 69ccd99774bda3ec93a415d7 INFO: 172.21.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48176 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:09:47,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:09:47,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:11:46,352 - lava_callback - INFO - Received callback for node 69ca3e3d0e33d030878a94ab INFO: 172.21.0.1:43636 - "POST /node/69ca3e3d0e33d030878a94ab HTTP/1.0" 202 Accepted 2026-04-01 09:11:46,358 - lava_callback - INFO - Starting async job submit for node 69ca3e3d0e33d030878a94ab 2026-04-01 09:11:46,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:11:46,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3e3d0e33d030878a94ab HTTP/1.1" 200 None 2026-04-01 09:11:46,374 - lava_callback - DEBUG - Processing node 69ca3e3d0e33d030878a94ab: baseline-arm64-baylibre 2026-04-01 09:11:46,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3e3d0e33d030878a94ab 2026-04-01 09:11:46,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:11:46,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3e3d0e33d030878a94ab HTTP/1.1" 200 None 2026-04-01 09:11:46,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:11:46,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:11:46,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:11:46,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3e3d0e33d030878a94ab HTTP/1.1" 200 None 2026-04-01 09:11:46,428 - lava_callback - ERROR - Error processing callback for node 69ca3e3d0e33d030878a94ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43652 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:11:53,634 - lava_callback - INFO - Received callback for node 69ccdec874bda3ec93a419bd INFO: 172.21.0.1:58786 - "POST /node/69ccdec874bda3ec93a419bd HTTP/1.0" 202 Accepted 2026-04-01 09:11:53,641 - lava_callback - INFO - Starting async job submit for node 69ccdec874bda3ec93a419bd 2026-04-01 09:11:53,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:11:53,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec874bda3ec93a419bd HTTP/1.1" 200 None 2026-04-01 09:11:53,686 - lava_callback - DEBUG - Processing node 69ccdec874bda3ec93a419bd: baseline-arm64 2026-04-01 09:11:54,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:11:54,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:11:54,354 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec874bda3ec93a419bd/log.txt.gz 2026-04-01 09:11:54,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:11:54,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:11:54,840 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec874bda3ec93a419bd/lava-logs.yaml 2026-04-01 09:11:54,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:11:55,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:11:55,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdec874bda3ec93a419bd/lava_callback.json.gz 2026-04-01 09:11:55,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:11:55,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdec874bda3ec93a419bd HTTP/1.1" 200 None 2026-04-01 09:11:55,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:11:55,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:11:55,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:11:55,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdec874bda3ec93a419bd HTTP/1.1" 200 None 2026-04-01 09:11:55,202 - lava_callback - INFO - Completed processing callback for node 69ccdec874bda3ec93a419bd INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33874 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:12:17,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:12:17,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 09:12:20,529 - lava_callback - INFO - Received callback for node 69ccded974bda3ec93a419e9 INFO: 172.21.0.1:50816 - "POST /node/69ccded974bda3ec93a419e9 HTTP/1.0" 202 Accepted 2026-04-01 09:12:20,541 - lava_callback - INFO - Starting async job submit for node 69ccded974bda3ec93a419e9 2026-04-01 09:12:20,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:12:20,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded974bda3ec93a419e9 HTTP/1.1" 200 None 2026-04-01 09:12:20,585 - lava_callback - DEBUG - Processing node 69ccded974bda3ec93a419e9: baseline-nfs-arm64 2026-04-01 09:12:21,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:12:21,258 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:12:21,259 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded974bda3ec93a419e9/log.txt.gz 2026-04-01 09:12:21,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:12:21,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:12:21,894 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded974bda3ec93a419e9/lava-logs.yaml 2026-04-01 09:12:21,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:12:22,060 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:12:22,062 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded974bda3ec93a419e9/lava_callback.json.gz 2026-04-01 09:12:22,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:12:22,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded974bda3ec93a419e9 HTTP/1.1" 200 None 2026-04-01 09:12:22,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:12:22,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:12:22,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:12:22,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccded974bda3ec93a419e9 HTTP/1.1" 200 None 2026-04-01 09:12:22,226 - lava_callback - INFO - Completed processing callback for node 69ccded974bda3ec93a419e9 INFO: 172.21.0.1:50818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:12:46,372 - lava_callback - INFO - Received callback for node 69ca3e8a0e33d030878a94b6 INFO: 172.21.0.1:40444 - "POST /node/69ca3e8a0e33d030878a94b6 HTTP/1.0" 202 Accepted 2026-04-01 09:12:46,379 - lava_callback - INFO - Starting async job submit for node 69ca3e8a0e33d030878a94b6 2026-04-01 09:12:46,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:12:46,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3e8a0e33d030878a94b6 HTTP/1.1" 200 None 2026-04-01 09:12:46,398 - lava_callback - DEBUG - Processing node 69ca3e8a0e33d030878a94b6: baseline-arm64-baylibre 2026-04-01 09:12:46,398 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3e8a0e33d030878a94b6 2026-04-01 09:12:46,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:12:46,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3e8a0e33d030878a94b6 HTTP/1.1" 200 None 2026-04-01 09:12:46,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:12:46,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:12:46,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:12:46,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3e8a0e33d030878a94b6 HTTP/1.1" 200 None 2026-04-01 09:12:46,483 - lava_callback - ERROR - Error processing callback for node 69ca3e8a0e33d030878a94b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40454 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:12:47,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:12:47,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37978 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:14:06,642 - lava_callback - INFO - Received callback for node 69ca3edb0e33d030878a94c1 INFO: 172.21.0.1:37992 - "POST /node/69ca3edb0e33d030878a94c1 HTTP/1.0" 202 Accepted 2026-04-01 09:14:06,648 - lava_callback - INFO - Starting async job submit for node 69ca3edb0e33d030878a94c1 2026-04-01 09:14:06,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:14:06,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3edb0e33d030878a94c1 HTTP/1.1" 200 None 2026-04-01 09:14:06,664 - lava_callback - DEBUG - Processing node 69ca3edb0e33d030878a94c1: baseline-arm64-baylibre 2026-04-01 09:14:06,665 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3edb0e33d030878a94c1 2026-04-01 09:14:06,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:14:06,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3edb0e33d030878a94c1 HTTP/1.1" 200 None 2026-04-01 09:14:06,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:14:06,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:14:06,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:14:06,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3edb0e33d030878a94c1 HTTP/1.1" 200 None 2026-04-01 09:14:06,735 - lava_callback - ERROR - Error processing callback for node 69ca3edb0e33d030878a94c1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60478 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:15:26,742 - lava_callback - INFO - Received callback for node 69ca3f1a0e33d030878a94cc INFO: 172.21.0.1:60486 - "POST /node/69ca3f1a0e33d030878a94cc HTTP/1.0" 202 Accepted 2026-04-01 09:15:26,747 - lava_callback - INFO - Starting async job submit for node 69ca3f1a0e33d030878a94cc 2026-04-01 09:15:26,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:15:26,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3f1a0e33d030878a94cc HTTP/1.1" 200 None 2026-04-01 09:15:26,766 - lava_callback - DEBUG - Processing node 69ca3f1a0e33d030878a94cc: baseline-arm-baylibre 2026-04-01 09:15:26,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3f1a0e33d030878a94cc 2026-04-01 09:15:26,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:15:26,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3f1a0e33d030878a94cc HTTP/1.1" 200 None 2026-04-01 09:15:26,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:15:26,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-04-01 09:15:26,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:15:26,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3f1a0e33d030878a94cc HTTP/1.1" 200 None 2026-04-01 09:15:26,827 - lava_callback - ERROR - Error processing callback for node 69ca3f1a0e33d030878a94cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45924 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:16:06,590 - lava_callback - INFO - Received callback for node 69ca3f4d0e33d030878a94dc INFO: 172.21.0.1:45932 - "POST /node/69ca3f4d0e33d030878a94dc HTTP/1.0" 202 Accepted 2026-04-01 09:16:06,599 - lava_callback - INFO - Starting async job submit for node 69ca3f4d0e33d030878a94dc 2026-04-01 09:16:06,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:16:06,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3f4d0e33d030878a94dc HTTP/1.1" 200 None 2026-04-01 09:16:06,625 - lava_callback - DEBUG - Processing node 69ca3f4d0e33d030878a94dc: baseline-arm64-baylibre 2026-04-01 09:16:06,625 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3f4d0e33d030878a94dc 2026-04-01 09:16:06,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:16:06,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3f4d0e33d030878a94dc HTTP/1.1" 200 None 2026-04-01 09:16:06,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:16:06,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:16:06,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:16:06,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3f4d0e33d030878a94dc HTTP/1.1" 200 None 2026-04-01 09:16:06,705 - lava_callback - ERROR - Error processing callback for node 69ca3f4d0e33d030878a94dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49064 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:17:26,688 - lava_callback - INFO - Received callback for node 69ca3f990e33d030878a94e9 INFO: 172.21.0.1:49070 - "POST /node/69ca3f990e33d030878a94e9 HTTP/1.0" 202 Accepted 2026-04-01 09:17:26,693 - lava_callback - INFO - Starting async job submit for node 69ca3f990e33d030878a94e9 2026-04-01 09:17:26,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:17:26,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3f990e33d030878a94e9 HTTP/1.1" 200 None 2026-04-01 09:17:26,709 - lava_callback - DEBUG - Processing node 69ca3f990e33d030878a94e9: baseline-arm64-baylibre 2026-04-01 09:17:26,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3f990e33d030878a94e9 2026-04-01 09:17:26,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:17:26,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3f990e33d030878a94e9 HTTP/1.1" 200 None 2026-04-01 09:17:26,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:17:26,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:17:26,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:17:26,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3f990e33d030878a94e9 HTTP/1.1" 200 None 2026-04-01 09:17:26,761 - lava_callback - ERROR - Error processing callback for node 69ca3f990e33d030878a94e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 09:17:31,028 - lava_callback - INFO - Received callback for node 69ccde8274bda3ec93a41956 INFO: 172.21.0.1:53624 - "POST /node/69ccde8274bda3ec93a41956 HTTP/1.0" 202 Accepted 2026-04-01 09:17:31,035 - lava_callback - INFO - Starting async job submit for node 69ccde8274bda3ec93a41956 2026-04-01 09:17:31,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:17:31,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccde8274bda3ec93a41956 HTTP/1.1" 200 None 2026-04-01 09:17:31,116 - lava_callback - DEBUG - Processing node 69ccde8274bda3ec93a41956: ltp-smoke 2026-04-01 09:17:31,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:17:31,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:17:31,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccde8274bda3ec93a41956/log.txt.gz 2026-04-01 09:17:32,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:17:32,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:17:32,242 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccde8274bda3ec93a41956/lava-logs.yaml 2026-04-01 09:17:32,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:17:32,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:17:32,482 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccde8274bda3ec93a41956/lava_callback.json.gz 2026-04-01 09:17:32,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:17:32,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccde8274bda3ec93a41956 HTTP/1.1" 200 None 2026-04-01 09:17:32,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:17:32,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48874bda3ec93a4126c HTTP/1.1" 200 None 2026-04-01 09:17:32,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:17:32,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccde8274bda3ec93a41956 HTTP/1.1" 200 None 2026-04-01 09:17:32,768 - lava_callback - INFO - Completed processing callback for node 69ccde8274bda3ec93a41956 INFO: 172.21.0.1:53638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:17:47,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:17:48,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49454 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:18:46,872 - lava_callback - INFO - Received callback for node 69ca3fe50e33d030878a94fd INFO: 172.21.0.1:49456 - "POST /node/69ca3fe50e33d030878a94fd HTTP/1.0" 202 Accepted 2026-04-01 09:18:46,877 - lava_callback - INFO - Starting async job submit for node 69ca3fe50e33d030878a94fd 2026-04-01 09:18:46,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:18:46,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3fe50e33d030878a94fd HTTP/1.1" 200 None 2026-04-01 09:18:46,893 - lava_callback - DEBUG - Processing node 69ca3fe50e33d030878a94fd: baseline-arm64-baylibre 2026-04-01 09:18:46,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca3fe50e33d030878a94fd 2026-04-01 09:18:46,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:18:46,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca3fe50e33d030878a94fd HTTP/1.1" 200 None 2026-04-01 09:18:46,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:18:46,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:18:46,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:18:46,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca3fe50e33d030878a94fd HTTP/1.1" 200 None 2026-04-01 09:18:46,962 - lava_callback - ERROR - Error processing callback for node 69ca3fe50e33d030878a94fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60674 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:20:09,772 - lava_callback - INFO - Received callback for node 69ca40360e33d030878a9511 INFO: 172.21.0.1:52084 - "POST /node/69ca40360e33d030878a9511 HTTP/1.0" 202 Accepted 2026-04-01 09:20:09,778 - lava_callback - INFO - Starting async job submit for node 69ca40360e33d030878a9511 2026-04-01 09:20:09,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:20:09,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca40360e33d030878a9511 HTTP/1.1" 200 None 2026-04-01 09:20:09,802 - lava_callback - DEBUG - Processing node 69ca40360e33d030878a9511: baseline-arm64-clabbe 2026-04-01 09:20:09,803 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca40360e33d030878a9511 2026-04-01 09:20:09,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:20:09,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca40360e33d030878a9511 HTTP/1.1" 200 None 2026-04-01 09:20:09,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:20:09,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:20:09,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:20:09,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca40360e33d030878a9511 HTTP/1.1" 200 None 2026-04-01 09:20:09,856 - lava_callback - ERROR - Error processing callback for node 69ca40360e33d030878a9511: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:21:09,809 - lava_callback - INFO - Received callback for node 69ca40830e33d030878a951a INFO: 172.21.0.1:47188 - "POST /node/69ca40830e33d030878a951a HTTP/1.0" 202 Accepted 2026-04-01 09:21:09,814 - lava_callback - INFO - Starting async job submit for node 69ca40830e33d030878a951a 2026-04-01 09:21:09,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:09,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca40830e33d030878a951a HTTP/1.1" 200 None 2026-04-01 09:21:09,831 - lava_callback - DEBUG - Processing node 69ca40830e33d030878a951a: baseline-arm64-clabbe 2026-04-01 09:21:09,831 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca40830e33d030878a951a 2026-04-01 09:21:09,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:09,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca40830e33d030878a951a HTTP/1.1" 200 None 2026-04-01 09:21:09,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:09,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:21:09,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:09,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca40830e33d030878a951a HTTP/1.1" 200 None 2026-04-01 09:21:09,890 - lava_callback - ERROR - Error processing callback for node 69ca40830e33d030878a951a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:21:30,384 - lava_callback - INFO - Received callback for node 69ccded574bda3ec93a419e0 INFO: 172.21.0.1:43070 - "POST /node/69ccded574bda3ec93a419e0 HTTP/1.0" 202 Accepted 2026-04-01 09:21:30,393 - lava_callback - INFO - Starting async job submit for node 69ccded574bda3ec93a419e0 2026-04-01 09:21:30,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:30,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded574bda3ec93a419e0 HTTP/1.1" 200 None 2026-04-01 09:21:30,451 - lava_callback - DEBUG - Processing node 69ccded574bda3ec93a419e0: baseline-nfs-arm64 2026-04-01 09:21:31,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:21:32,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:21:32,094 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded574bda3ec93a419e0/log.txt.gz 2026-04-01 09:21:32,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:21:32,991 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:21:32,993 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded574bda3ec93a419e0/lava-logs.yaml 2026-04-01 09:21:33,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:21:33,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:21:33,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded574bda3ec93a419e0/lava_callback.json.gz DEBUG: Setup failed for 69ccded574bda3ec93a419e0. Transitting job node result: incomplete -> fail 2026-04-01 09:21:33,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:33,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded574bda3ec93a419e0 HTTP/1.1" 200 None 2026-04-01 09:21:33,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:33,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:21:33,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:33,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccded574bda3ec93a419e0 HTTP/1.1" 200 None 2026-04-01 09:21:33,435 - lava_callback - INFO - Completed processing callback for node 69ccded574bda3ec93a419e0 INFO: 172.21.0.1:43084 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:21:42,832 - lava_callback - INFO - Received callback for node 69ccded374bda3ec93a419d6 INFO: 172.21.0.1:41260 - "POST /node/69ccded374bda3ec93a419d6 HTTP/1.0" 202 Accepted 2026-04-01 09:21:42,840 - lava_callback - INFO - Starting async job submit for node 69ccded374bda3ec93a419d6 2026-04-01 09:21:42,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:42,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded374bda3ec93a419d6 HTTP/1.1" 200 None 2026-04-01 09:21:42,899 - lava_callback - DEBUG - Processing node 69ccded374bda3ec93a419d6: baseline-nfs-arm64 2026-04-01 09:21:43,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:21:44,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:21:44,083 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded374bda3ec93a419d6/log.txt.gz 2026-04-01 09:21:44,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:21:44,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:21:44,930 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded374bda3ec93a419d6/lava-logs.yaml 2026-04-01 09:21:44,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:21:45,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:21:45,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccded374bda3ec93a419d6/lava_callback.json.gz DEBUG: Setup failed for 69ccded374bda3ec93a419d6. Transitting job node result: incomplete -> fail 2026-04-01 09:21:45,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:45,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccded374bda3ec93a419d6 HTTP/1.1" 200 None 2026-04-01 09:21:45,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:45,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:21:45,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:45,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccded374bda3ec93a419d6 HTTP/1.1" 200 None 2026-04-01 09:21:45,421 - lava_callback - INFO - Completed processing callback for node 69ccded374bda3ec93a419d6 INFO: 172.21.0.1:41270 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:21:48,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:21:48,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55082 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:22:29,845 - lava_callback - INFO - Received callback for node 69ca40d00e33d030878a952a INFO: 172.21.0.1:35464 - "POST /node/69ca40d00e33d030878a952a HTTP/1.0" 202 Accepted 2026-04-01 09:22:29,850 - lava_callback - INFO - Starting async job submit for node 69ca40d00e33d030878a952a 2026-04-01 09:22:29,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:22:29,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca40d00e33d030878a952a HTTP/1.1" 200 None 2026-04-01 09:22:29,879 - lava_callback - DEBUG - Processing node 69ca40d00e33d030878a952a: baseline-arm64-clabbe 2026-04-01 09:22:29,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca40d00e33d030878a952a 2026-04-01 09:22:29,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:22:29,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca40d00e33d030878a952a HTTP/1.1" 200 None 2026-04-01 09:22:29,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:22:29,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:22:29,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:22:29,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca40d00e33d030878a952a HTTP/1.1" 200 None 2026-04-01 09:22:29,933 - lava_callback - ERROR - Error processing callback for node 69ca40d00e33d030878a952a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43008 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:23:49,940 - lava_callback - INFO - Received callback for node 69ca411c0e33d030878a9536 INFO: 172.21.0.1:47982 - "POST /node/69ca411c0e33d030878a9536 HTTP/1.0" 202 Accepted 2026-04-01 09:23:49,946 - lava_callback - INFO - Starting async job submit for node 69ca411c0e33d030878a9536 2026-04-01 09:23:49,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:23:49,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca411c0e33d030878a9536 HTTP/1.1" 200 None 2026-04-01 09:23:49,964 - lava_callback - DEBUG - Processing node 69ca411c0e33d030878a9536: baseline-arm64-clabbe 2026-04-01 09:23:49,964 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca411c0e33d030878a9536 2026-04-01 09:23:49,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:23:49,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca411c0e33d030878a9536 HTTP/1.1" 200 None 2026-04-01 09:23:49,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:23:50,002 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:23:50,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:23:50,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca411c0e33d030878a9536 HTTP/1.1" 200 None 2026-04-01 09:23:50,028 - lava_callback - ERROR - Error processing callback for node 69ca411c0e33d030878a9536: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45180 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:24:39,344 - lava_callback - INFO - Received callback for node 69ccdebb74bda3ec93a41983 INFO: 172.21.0.1:45186 - "POST /node/69ccdebb74bda3ec93a41983 HTTP/1.0" 202 Accepted 2026-04-01 09:24:39,350 - lava_callback - INFO - Starting async job submit for node 69ccdebb74bda3ec93a41983 2026-04-01 09:24:39,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:24:39,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdebb74bda3ec93a41983 HTTP/1.1" 200 None 2026-04-01 09:24:39,398 - lava_callback - DEBUG - Processing node 69ccdebb74bda3ec93a41983: baseline-arm64 2026-04-01 09:24:39,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:24:39,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:24:39,776 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdebb74bda3ec93a41983/log.txt.gz 2026-04-01 09:24:39,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:24:40,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:24:40,111 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdebb74bda3ec93a41983/lava-logs.yaml 2026-04-01 09:24:40,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:24:40,257 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:24:40,259 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccdebb74bda3ec93a41983/lava_callback.json.gz 2026-04-01 09:24:40,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:24:40,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdebb74bda3ec93a41983 HTTP/1.1" 200 None 2026-04-01 09:24:40,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:24:40,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:24:40,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:24:40,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdebb74bda3ec93a41983 HTTP/1.1" 200 None 2026-04-01 09:24:40,351 - lava_callback - INFO - Completed processing callback for node 69ccdebb74bda3ec93a41983 INFO: 172.21.0.1:46230 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:24:48,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:24:48,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43470 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:25:10,019 - lava_callback - INFO - Received callback for node 69ca41670e33d030878a9546 INFO: 172.21.0.1:57592 - "POST /node/69ca41670e33d030878a9546 HTTP/1.0" 202 Accepted 2026-04-01 09:25:10,024 - lava_callback - INFO - Starting async job submit for node 69ca41670e33d030878a9546 2026-04-01 09:25:10,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:25:10,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca41670e33d030878a9546 HTTP/1.1" 200 None 2026-04-01 09:25:10,042 - lava_callback - DEBUG - Processing node 69ca41670e33d030878a9546: baseline-arm64-clabbe 2026-04-01 09:25:10,042 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca41670e33d030878a9546 2026-04-01 09:25:10,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:25:10,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca41670e33d030878a9546 HTTP/1.1" 200 None 2026-04-01 09:25:10,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:25:10,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:25:10,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:25:10,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca41670e33d030878a9546 HTTP/1.1" 200 None 2026-04-01 09:25:10,097 - lava_callback - ERROR - Error processing callback for node 69ca41670e33d030878a9546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40090 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:26:23,716 - lava_callback - INFO - Received callback for node 69ccdece74bda3ec93a419cd INFO: 172.21.0.1:51576 - "POST /node/69ccdece74bda3ec93a419cd HTTP/1.0" 202 Accepted 2026-04-01 09:26:23,722 - lava_callback - INFO - Starting async job submit for node 69ccdece74bda3ec93a419cd 2026-04-01 09:26:23,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:26:23,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdece74bda3ec93a419cd HTTP/1.1" 200 None 2026-04-01 09:26:23,764 - lava_callback - DEBUG - Processing node 69ccdece74bda3ec93a419cd: baseline-nfs-arm64 2026-04-01 09:26:24,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:26:24,262 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:26:24,264 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccdece74bda3ec93a419cd/log.txt.gz 2026-04-01 09:26:24,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:26:24,661 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:26:24,664 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccdece74bda3ec93a419cd/lava-logs.yaml 2026-04-01 09:26:24,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:26:24,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:26:24,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccdece74bda3ec93a419cd/lava_callback.json.gz 2026-04-01 09:26:24,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:26:24,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdece74bda3ec93a419cd HTTP/1.1" 200 None 2026-04-01 09:26:24,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:26:24,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:26:24,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:26:24,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdece74bda3ec93a419cd HTTP/1.1" 200 None 2026-04-01 09:26:24,918 - lava_callback - INFO - Completed processing callback for node 69ccdece74bda3ec93a419cd INFO: 172.21.0.1:51592 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:26:30,005 - lava_callback - INFO - Received callback for node 69ca41b50e33d030878a9550 INFO: 172.21.0.1:34086 - "POST /node/69ca41b50e33d030878a9550 HTTP/1.0" 202 Accepted 2026-04-01 09:26:30,011 - lava_callback - INFO - Starting async job submit for node 69ca41b50e33d030878a9550 2026-04-01 09:26:30,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:26:30,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca41b50e33d030878a9550 HTTP/1.1" 200 None 2026-04-01 09:26:30,027 - lava_callback - DEBUG - Processing node 69ca41b50e33d030878a9550: baseline-arm64-clabbe 2026-04-01 09:26:30,028 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca41b50e33d030878a9550 2026-04-01 09:26:30,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:26:30,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca41b50e33d030878a9550 HTTP/1.1" 200 None 2026-04-01 09:26:30,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:26:30,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 09:26:30,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:26:30,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca41b50e33d030878a9550 HTTP/1.1" 200 None 2026-04-01 09:26:30,084 - lava_callback - ERROR - Error processing callback for node 69ca41b50e33d030878a9550: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50544 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:26:48,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:26:48,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:27:08,135 - lava_callback - INFO - Received callback for node 69cce4e774bda3ec93a41d8b INFO: 172.21.0.1:39030 - "POST /node/69cce4e774bda3ec93a41d8b HTTP/1.0" 202 Accepted 2026-04-01 09:27:08,141 - lava_callback - INFO - Starting async job submit for node 69cce4e774bda3ec93a41d8b 2026-04-01 09:27:08,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:27:08,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce4e774bda3ec93a41d8b HTTP/1.1" 200 None 2026-04-01 09:27:08,158 - lava_callback - DEBUG - Processing node 69cce4e774bda3ec93a41d8b: baseline-nfs-arm64 2026-04-01 09:27:08,160 - lava_callback - WARNING - Failed to upload log 2026-04-01 09:27:08,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:27:08,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:27:08,327 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cce4e774bda3ec93a41d8b/lava-logs.yaml 2026-04-01 09:27:08,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:27:08,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:27:08,475 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cce4e774bda3ec93a41d8b/lava_callback.json.gz 2026-04-01 09:27:08,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:27:08,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce4e774bda3ec93a41d8b HTTP/1.1" 200 None 2026-04-01 09:27:08,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:27:08,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:27:08,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:27:08,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce4e774bda3ec93a41d8b HTTP/1.1" 200 None 2026-04-01 09:27:08,552 - lava_callback - INFO - Completed processing callback for node 69cce4e774bda3ec93a41d8b INFO: 172.21.0.1:39040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34590 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:27:18,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:27:18,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53502 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:28:07,220 - lava_callback - INFO - Received callback for node 69ca42120e33d030878a9567 INFO: 172.21.0.1:53510 - "POST /node/69ca42120e33d030878a9567 HTTP/1.0" 202 Accepted 2026-04-01 09:28:07,226 - lava_callback - INFO - Starting async job submit for node 69ca42120e33d030878a9567 2026-04-01 09:28:07,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:28:07,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca42120e33d030878a9567 HTTP/1.1" 200 None 2026-04-01 09:28:07,243 - lava_callback - DEBUG - Processing node 69ca42120e33d030878a9567: baseline-arm-baylibre 2026-04-01 09:28:07,243 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca42120e33d030878a9567 2026-04-01 09:28:07,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:28:07,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca42120e33d030878a9567 HTTP/1.1" 200 None 2026-04-01 09:28:07,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:28:07,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-04-01 09:28:07,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:28:07,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca42120e33d030878a9567 HTTP/1.1" 200 None 2026-04-01 09:28:07,310 - lava_callback - ERROR - Error processing callback for node 69ca42120e33d030878a9567: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:28:27,229 - lava_callback - INFO - Received callback for node 69ca42370e33d030878a9573 INFO: 172.21.0.1:54732 - "POST /node/69ca42370e33d030878a9573 HTTP/1.0" 202 Accepted 2026-04-01 09:28:27,235 - lava_callback - INFO - Starting async job submit for node 69ca42370e33d030878a9573 2026-04-01 09:28:27,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:28:27,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca42370e33d030878a9573 HTTP/1.1" 200 None 2026-04-01 09:28:27,251 - lava_callback - DEBUG - Processing node 69ca42370e33d030878a9573: baseline-arm-baylibre 2026-04-01 09:28:27,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca42370e33d030878a9573 2026-04-01 09:28:27,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:28:27,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca42370e33d030878a9573 HTTP/1.1" 200 None 2026-04-01 09:28:27,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:28:27,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-04-01 09:28:27,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:28:27,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca42370e33d030878a9573 HTTP/1.1" 200 None 2026-04-01 09:28:27,315 - lava_callback - ERROR - Error processing callback for node 69ca42370e33d030878a9573: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50670 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:30:30,538 - lava_callback - INFO - Received callback for node 69cce53274bda3ec93a41da7 INFO: 172.21.0.1:50818 - "POST /node/69cce53274bda3ec93a41da7 HTTP/1.0" 202 Accepted 2026-04-01 09:30:30,545 - lava_callback - INFO - Starting async job submit for node 69cce53274bda3ec93a41da7 2026-04-01 09:30:30,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:30:30,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce53274bda3ec93a41da7 HTTP/1.1" 200 None 2026-04-01 09:30:30,605 - lava_callback - DEBUG - Processing node 69cce53274bda3ec93a41da7: baseline-arm64 2026-04-01 09:30:30,798 - lava_callback - WARNING - Failed to upload log 2026-04-01 09:30:30,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:30:31,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:30:31,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cce53274bda3ec93a41da7/lava-logs.yaml 2026-04-01 09:30:31,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:30:31,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:30:31,445 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cce53274bda3ec93a41da7/lava_callback.json.gz 2026-04-01 09:30:31,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:30:31,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce53274bda3ec93a41da7 HTTP/1.1" 200 None 2026-04-01 09:30:31,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:30:31,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:30:31,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:30:31,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce53274bda3ec93a41da7 HTTP/1.1" 200 None 2026-04-01 09:30:31,619 - lava_callback - INFO - Completed processing callback for node 69cce53274bda3ec93a41da7 INFO: 172.21.0.1:50820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42394 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:30:48,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:30:48,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 09:30:52,548 - lava_callback - INFO - Received callback for node 69cce58874bda3ec93a41dcb INFO: 172.21.0.1:59546 - "POST /node/69cce58874bda3ec93a41dcb HTTP/1.0" 202 Accepted 2026-04-01 09:30:52,555 - lava_callback - INFO - Starting async job submit for node 69cce58874bda3ec93a41dcb 2026-04-01 09:30:52,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:30:52,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce58874bda3ec93a41dcb HTTP/1.1" 200 None 2026-04-01 09:30:52,599 - lava_callback - DEBUG - Processing node 69cce58874bda3ec93a41dcb: baseline-arm64 2026-04-01 09:30:52,732 - lava_callback - WARNING - Failed to upload log 2026-04-01 09:30:52,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:30:53,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:30:53,250 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cce58874bda3ec93a41dcb/lava-logs.yaml 2026-04-01 09:30:53,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:30:53,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:30:53,387 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cce58874bda3ec93a41dcb/lava_callback.json.gz 2026-04-01 09:30:53,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:30:53,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce58874bda3ec93a41dcb HTTP/1.1" 200 None 2026-04-01 09:30:53,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:30:53,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:30:53,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:30:53,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce58874bda3ec93a41dcb HTTP/1.1" 200 None 2026-04-01 09:30:53,560 - lava_callback - INFO - Completed processing callback for node 69cce58874bda3ec93a41dcb INFO: 172.21.0.1:59556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60206 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:31:18,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:31:18,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38248 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:31:27,451 - lava_callback - INFO - Received callback for node 69ca42ec0e33d030878a95ac INFO: 172.21.0.1:38254 - "POST /node/69ca42ec0e33d030878a95ac HTTP/1.0" 202 Accepted 2026-04-01 09:31:27,456 - lava_callback - INFO - Starting async job submit for node 69ca42ec0e33d030878a95ac 2026-04-01 09:31:27,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:31:27,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca42ec0e33d030878a95ac HTTP/1.1" 200 None 2026-04-01 09:31:27,475 - lava_callback - DEBUG - Processing node 69ca42ec0e33d030878a95ac: baseline-arm-baylibre 2026-04-01 09:31:27,475 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca42ec0e33d030878a95ac 2026-04-01 09:31:27,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:31:27,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca42ec0e33d030878a95ac HTTP/1.1" 200 None 2026-04-01 09:31:27,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:31:27,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-04-01 09:31:27,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:31:27,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca42ec0e33d030878a95ac HTTP/1.1" 200 None 2026-04-01 09:31:27,568 - lava_callback - ERROR - Error processing callback for node 69ca42ec0e33d030878a95ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59410 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:34:07,714 - lava_callback - INFO - Received callback for node 69ca437d0e33d030878a95d7 INFO: 172.21.0.1:59420 - "POST /node/69ca437d0e33d030878a95d7 HTTP/1.0" 202 Accepted 2026-04-01 09:34:07,720 - lava_callback - INFO - Starting async job submit for node 69ca437d0e33d030878a95d7 2026-04-01 09:34:07,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:34:07,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca437d0e33d030878a95d7 HTTP/1.1" 200 None 2026-04-01 09:34:07,738 - lava_callback - DEBUG - Processing node 69ca437d0e33d030878a95d7: baseline-arm-baylibre 2026-04-01 09:34:07,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca437d0e33d030878a95d7 2026-04-01 09:34:07,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:34:07,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca437d0e33d030878a95d7 HTTP/1.1" 200 None 2026-04-01 09:34:07,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:34:07,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-04-01 09:34:07,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:34:07,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca437d0e33d030878a95d7 HTTP/1.1" 200 None 2026-04-01 09:34:07,807 - lava_callback - ERROR - Error processing callback for node 69ca437d0e33d030878a95d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:35:35,047 - lava_callback - INFO - Received callback for node 69cce30e74bda3ec93a41cc0 INFO: 172.21.0.1:37582 - "POST /node/69cce30e74bda3ec93a41cc0 HTTP/1.0" 202 Accepted 2026-04-01 09:35:35,055 - lava_callback - INFO - Starting async job submit for node 69cce30e74bda3ec93a41cc0 2026-04-01 09:35:35,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:35:35,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce30e74bda3ec93a41cc0 HTTP/1.1" 200 None 2026-04-01 09:35:35,140 - lava_callback - DEBUG - Processing node 69cce30e74bda3ec93a41cc0: baseline-arm 2026-04-01 09:35:35,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:35:36,041 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:35:36,043 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69cce30e74bda3ec93a41cc0/log.txt.gz 2026-04-01 09:35:36,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:37586 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:35:36,676 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:35:36,678 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69cce30e74bda3ec93a41cc0/lava-logs.yaml 2026-04-01 09:35:36,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:35:36,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:35:36,870 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69cce30e74bda3ec93a41cc0/lava_callback.json.gz DEBUG: Setup failed for 69cce30e74bda3ec93a41cc0. Transitting job node result: incomplete -> fail 2026-04-01 09:35:37,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:35:37,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce30e74bda3ec93a41cc0 HTTP/1.1" 200 None 2026-04-01 09:35:37,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:35:37,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 09:35:37,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:35:37,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce30e74bda3ec93a41cc0 HTTP/1.1" 200 None 2026-04-01 09:35:37,185 - lava_callback - INFO - Completed processing callback for node 69cce30e74bda3ec93a41cc0 INFO: 172.21.0.1:33466 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:35:48,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:35:48,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 09:35:50,425 - lava_callback - INFO - Received callback for node 69ca43eb0e33d030878a95ea INFO: 172.21.0.1:37598 - "POST /node/69ca43eb0e33d030878a95ea HTTP/1.0" 202 Accepted 2026-04-01 09:35:50,430 - lava_callback - INFO - Starting async job submit for node 69ca43eb0e33d030878a95ea 2026-04-01 09:35:50,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:35:50,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca43eb0e33d030878a95ea HTTP/1.1" 200 None 2026-04-01 09:35:50,449 - lava_callback - DEBUG - Processing node 69ca43eb0e33d030878a95ea: baseline-arm-clabbe 2026-04-01 09:35:50,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca43eb0e33d030878a95ea 2026-04-01 09:35:50,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:35:50,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca43eb0e33d030878a95ea HTTP/1.1" 200 None 2026-04-01 09:35:50,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:35:50,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-04-01 09:35:50,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:35:50,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca43eb0e33d030878a95ea HTTP/1.1" 200 None 2026-04-01 09:35:50,517 - lava_callback - ERROR - Error processing callback for node 69ca43eb0e33d030878a95ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51092 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:36:43,721 - lava_callback - INFO - Received callback for node 69cce5e474bda3ec93a41df1 INFO: 172.21.0.1:47498 - "POST /node/69cce5e474bda3ec93a41df1 HTTP/1.0" 202 Accepted 2026-04-01 09:36:43,728 - lava_callback - INFO - Starting async job submit for node 69cce5e474bda3ec93a41df1 2026-04-01 09:36:43,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:36:43,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce5e474bda3ec93a41df1 HTTP/1.1" 200 None 2026-04-01 09:36:43,777 - lava_callback - DEBUG - Processing node 69cce5e474bda3ec93a41df1: baseline-arm64 2026-04-01 09:36:44,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:36:44,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:36:44,328 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69cce5e474bda3ec93a41df1/log.txt.gz 2026-04-01 09:36:44,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:36:44,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:36:44,826 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cce5e474bda3ec93a41df1/lava-logs.yaml 2026-04-01 09:36:44,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:36:45,023 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:36:45,025 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cce5e474bda3ec93a41df1/lava_callback.json.gz DEBUG: Setup failed for 69cce5e474bda3ec93a41df1. Transitting job node result: incomplete -> fail 2026-04-01 09:36:45,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:36:45,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce5e474bda3ec93a41df1 HTTP/1.1" 200 None 2026-04-01 09:36:45,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:36:45,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:36:45,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:36:45,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce5e474bda3ec93a41df1 HTTP/1.1" 200 None 2026-04-01 09:36:45,310 - lava_callback - INFO - Completed processing callback for node 69cce5e474bda3ec93a41df1 INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:36:48,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:36:48,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59612 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:37:12,088 - lava_callback - INFO - Received callback for node 69cce65374bda3ec93a41e20 INFO: 172.21.0.1:53308 - "POST /node/69cce65374bda3ec93a41e20 HTTP/1.0" 202 Accepted 2026-04-01 09:37:12,095 - lava_callback - INFO - Starting async job submit for node 69cce65374bda3ec93a41e20 2026-04-01 09:37:12,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:37:12,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce65374bda3ec93a41e20 HTTP/1.1" 200 None 2026-04-01 09:37:12,169 - lava_callback - DEBUG - Processing node 69cce65374bda3ec93a41e20: ltp-syscalls-ipc 2026-04-01 09:37:12,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:37:12,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:37:12,841 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69cce65374bda3ec93a41e20/log.txt.gz 2026-04-01 09:37:13,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:37:13,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:37:13,418 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69cce65374bda3ec93a41e20/lava-logs.yaml 2026-04-01 09:37:13,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:37:13,667 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:37:13,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69cce65374bda3ec93a41e20/lava_callback.json.gz 2026-04-01 09:37:13,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:37:13,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce65374bda3ec93a41e20 HTTP/1.1" 200 None 2026-04-01 09:37:13,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:37:13,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 09:37:13,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:37:13,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce65374bda3ec93a41e20 HTTP/1.1" 200 None 2026-04-01 09:37:13,795 - lava_callback - INFO - Completed processing callback for node 69cce65374bda3ec93a41e20 INFO: 172.21.0.1:53310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:37:18,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:37:18,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:37:50,564 - lava_callback - INFO - Received callback for node 69ca445a0e33d030878a9604 INFO: 172.21.0.1:54414 - "POST /node/69ca445a0e33d030878a9604 HTTP/1.0" 202 Accepted 2026-04-01 09:37:50,570 - lava_callback - INFO - Starting async job submit for node 69ca445a0e33d030878a9604 2026-04-01 09:37:50,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:37:50,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca445a0e33d030878a9604 HTTP/1.1" 200 None 2026-04-01 09:37:50,592 - lava_callback - DEBUG - Processing node 69ca445a0e33d030878a9604: baseline-arm-clabbe 2026-04-01 09:37:50,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca445a0e33d030878a9604 2026-04-01 09:37:50,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:37:50,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca445a0e33d030878a9604 HTTP/1.1" 200 None 2026-04-01 09:37:50,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:37:50,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-04-01 09:37:50,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:37:50,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca445a0e33d030878a9604 HTTP/1.1" 200 None 2026-04-01 09:37:50,653 - lava_callback - ERROR - Error processing callback for node 69ca445a0e33d030878a9604: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:38:10,544 - lava_callback - INFO - Received callback for node 69ca447d0e33d030878a9618 INFO: 172.21.0.1:58642 - "POST /node/69ca447d0e33d030878a9618 HTTP/1.0" 202 Accepted 2026-04-01 09:38:10,553 - lava_callback - INFO - Starting async job submit for node 69ca447d0e33d030878a9618 2026-04-01 09:38:10,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:38:10,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca447d0e33d030878a9618 HTTP/1.1" 200 None 2026-04-01 09:38:10,574 - lava_callback - DEBUG - Processing node 69ca447d0e33d030878a9618: baseline-arm-clabbe 2026-04-01 09:38:10,574 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca447d0e33d030878a9618 2026-04-01 09:38:10,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:38:10,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca447d0e33d030878a9618 HTTP/1.1" 200 None 2026-04-01 09:38:10,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:38:10,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-04-01 09:38:10,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:38:10,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca447d0e33d030878a9618 HTTP/1.1" 200 None 2026-04-01 09:38:10,654 - lava_callback - ERROR - Error processing callback for node 69ca447d0e33d030878a9618: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47166 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:40:02,208 - lava_callback - INFO - Received callback for node 69cce36174bda3ec93a41cde INFO: 172.21.0.1:40472 - "POST /node/69cce36174bda3ec93a41cde HTTP/1.0" 202 Accepted 2026-04-01 09:40:02,257 - lava_callback - INFO - Starting async job submit for node 69cce36174bda3ec93a41cde 2026-04-01 09:40:02,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:40:02,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce36174bda3ec93a41cde HTTP/1.1" 200 None 2026-04-01 09:40:02,317 - lava_callback - DEBUG - Processing node 69cce36174bda3ec93a41cde: baseline-arm-pengutronix 2026-04-01 09:40:02,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:40:02,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:40:02,612 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cce36174bda3ec93a41cde/log.txt.gz 2026-04-01 09:40:02,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:40:02,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:40:02,854 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cce36174bda3ec93a41cde/lava-logs.yaml 2026-04-01 09:40:02,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:40:02,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:40:03,001 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69cce36174bda3ec93a41cde/lava_callback.json.gz DEBUG: Setup failed for 69cce36174bda3ec93a41cde. Transitting job node result: incomplete -> fail 2026-04-01 09:40:03,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:40:03,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce36174bda3ec93a41cde HTTP/1.1" 200 None 2026-04-01 09:40:03,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:40:03,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 09:40:03,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:40:03,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce36174bda3ec93a41cde HTTP/1.1" 200 None 2026-04-01 09:40:03,180 - lava_callback - INFO - Completed processing callback for node 69cce36174bda3ec93a41cde INFO: 172.21.0.1:40478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40492 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:40:10,635 - lava_callback - INFO - Received callback for node 69ca44ec0e33d030878a9636 INFO: 172.21.0.1:33796 - "POST /node/69ca44ec0e33d030878a9636 HTTP/1.0" 202 Accepted 2026-04-01 09:40:10,643 - lava_callback - INFO - Starting async job submit for node 69ca44ec0e33d030878a9636 2026-04-01 09:40:10,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:40:10,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca44ec0e33d030878a9636 HTTP/1.1" 200 None 2026-04-01 09:40:10,658 - lava_callback - DEBUG - Processing node 69ca44ec0e33d030878a9636: baseline-arm-clabbe 2026-04-01 09:40:10,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca44ec0e33d030878a9636 2026-04-01 09:40:10,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:40:10,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca44ec0e33d030878a9636 HTTP/1.1" 200 None 2026-04-01 09:40:10,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:40:10,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-04-01 09:40:10,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:40:10,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca44ec0e33d030878a9636 HTTP/1.1" 200 None 2026-04-01 09:40:10,710 - lava_callback - ERROR - Error processing callback for node 69ca44ec0e33d030878a9636: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33810 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:40:18,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:40:18,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:43:10,823 - lava_callback - INFO - Received callback for node 69ca45a40e33d030878a9659 INFO: 172.21.0.1:37092 - "POST /node/69ca45a40e33d030878a9659 HTTP/1.0" 202 Accepted 2026-04-01 09:43:10,828 - lava_callback - INFO - Starting async job submit for node 69ca45a40e33d030878a9659 2026-04-01 09:43:10,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:43:10,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca45a40e33d030878a9659 HTTP/1.1" 200 None 2026-04-01 09:43:10,844 - lava_callback - DEBUG - Processing node 69ca45a40e33d030878a9659: baseline-arm-clabbe 2026-04-01 09:43:10,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca45a40e33d030878a9659 2026-04-01 09:43:10,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:43:10,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca45a40e33d030878a9659 HTTP/1.1" 200 None 2026-04-01 09:43:10,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:43:10,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248d74a2c5046eb87f890 HTTP/1.1" 200 None 2026-04-01 09:43:10,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:43:10,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca45a40e33d030878a9659 HTTP/1.1" 200 None 2026-04-01 09:43:10,900 - lava_callback - ERROR - Error processing callback for node 69ca45a40e33d030878a9659: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40886 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:45:43,111 - lava_callback - INFO - Received callback for node 69cce6ac74bda3ec93a41e41 INFO: 172.21.0.1:50996 - "POST /node/69cce6ac74bda3ec93a41e41 HTTP/1.0" 202 Accepted 2026-04-01 09:45:43,118 - lava_callback - INFO - Starting async job submit for node 69cce6ac74bda3ec93a41e41 2026-04-01 09:45:43,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:45:43,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce6ac74bda3ec93a41e41 HTTP/1.1" 200 None 2026-04-01 09:45:43,157 - lava_callback - DEBUG - Processing node 69cce6ac74bda3ec93a41e41: baseline-arm64 2026-04-01 09:45:43,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:45:43,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:45:43,840 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69cce6ac74bda3ec93a41e41/log.txt.gz 2026-04-01 09:45:44,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:45:44,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:45:44,366 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cce6ac74bda3ec93a41e41/lava-logs.yaml 2026-04-01 09:45:44,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:45:44,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:45:44,561 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cce6ac74bda3ec93a41e41/lava_callback.json.gz 2026-04-01 09:45:44,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:45:44,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce6ac74bda3ec93a41e41 HTTP/1.1" 200 None 2026-04-01 09:45:44,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:45:44,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:45:44,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:45:44,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce6ac74bda3ec93a41e41 HTTP/1.1" 200 None 2026-04-01 09:45:44,721 - lava_callback - INFO - Completed processing callback for node 69cce6ac74bda3ec93a41e41 INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:45:48,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:45:48,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41016 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:47:08,259 - lava_callback - INFO - Received callback for node 69ca468a0e33d030878a969b INFO: 172.21.0.1:41028 - "POST /node/69ca468a0e33d030878a969b HTTP/1.0" 202 Accepted 2026-04-01 09:47:08,265 - lava_callback - INFO - Starting async job submit for node 69ca468a0e33d030878a969b 2026-04-01 09:47:08,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:47:08,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca468a0e33d030878a969b HTTP/1.1" 200 None 2026-04-01 09:47:08,281 - lava_callback - DEBUG - Processing node 69ca468a0e33d030878a969b: baseline-arm64-baylibre 2026-04-01 09:47:08,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca468a0e33d030878a969b 2026-04-01 09:47:08,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:47:08,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca468a0e33d030878a969b HTTP/1.1" 200 None 2026-04-01 09:47:08,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:47:08,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 09:47:08,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:47:08,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca468a0e33d030878a969b HTTP/1.1" 200 None 2026-04-01 09:47:08,345 - lava_callback - ERROR - Error processing callback for node 69ca468a0e33d030878a969b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44478 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:47:29,406 - lava_callback - INFO - Received callback for node 69cce70674bda3ec93a41e71 INFO: 172.21.0.1:44482 - "POST /node/69cce70674bda3ec93a41e71 HTTP/1.0" 202 Accepted 2026-04-01 09:47:29,414 - lava_callback - INFO - Starting async job submit for node 69cce70674bda3ec93a41e71 2026-04-01 09:47:29,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:47:29,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce70674bda3ec93a41e71 HTTP/1.1" 200 None 2026-04-01 09:47:29,456 - lava_callback - DEBUG - Processing node 69cce70674bda3ec93a41e71: baseline-nfs-arm64 2026-04-01 09:47:29,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:47:30,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:47:30,176 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cce70674bda3ec93a41e71/log.txt.gz 2026-04-01 09:47:30,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:47:30,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:47:30,721 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cce70674bda3ec93a41e71/lava-logs.yaml 2026-04-01 09:47:30,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:47:30,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:47:30,910 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cce70674bda3ec93a41e71/lava_callback.json.gz 2026-04-01 09:47:30,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:47:30,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce70674bda3ec93a41e71 HTTP/1.1" 200 None 2026-04-01 09:47:30,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:47:30,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:47:30,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:47:30,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce70674bda3ec93a41e71 HTTP/1.1" 200 None 2026-04-01 09:47:31,054 - lava_callback - INFO - Completed processing callback for node 69cce70674bda3ec93a41e71 INFO: 172.21.0.1:51798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:47:48,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:47:48,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:48:08,317 - lava_callback - INFO - Received callback for node 69ca46d30e33d030878a96a1 INFO: 172.21.0.1:50184 - "POST /node/69ca46d30e33d030878a96a1 HTTP/1.0" 202 Accepted 2026-04-01 09:48:08,322 - lava_callback - INFO - Starting async job submit for node 69ca46d30e33d030878a96a1 2026-04-01 09:48:08,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:48:08,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca46d30e33d030878a96a1 HTTP/1.1" 200 None 2026-04-01 09:48:08,346 - lava_callback - DEBUG - Processing node 69ca46d30e33d030878a96a1: baseline-arm64-baylibre 2026-04-01 09:48:08,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca46d30e33d030878a96a1 2026-04-01 09:48:08,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:48:08,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca46d30e33d030878a96a1 HTTP/1.1" 200 None 2026-04-01 09:48:08,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:48:08,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 09:48:08,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:48:08,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca46d30e33d030878a96a1 HTTP/1.1" 200 None 2026-04-01 09:48:08,418 - lava_callback - ERROR - Error processing callback for node 69ca46d30e33d030878a96a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:49:28,901 - lava_callback - INFO - Received callback for node 69ca471f0e33d030878a96ac INFO: 172.21.0.1:52592 - "POST /node/69ca471f0e33d030878a96ac HTTP/1.0" 202 Accepted 2026-04-01 09:49:28,907 - lava_callback - INFO - Starting async job submit for node 69ca471f0e33d030878a96ac 2026-04-01 09:49:28,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:49:28,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca471f0e33d030878a96ac HTTP/1.1" 200 None 2026-04-01 09:49:28,924 - lava_callback - DEBUG - Processing node 69ca471f0e33d030878a96ac: baseline-arm64-baylibre 2026-04-01 09:49:28,925 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca471f0e33d030878a96ac 2026-04-01 09:49:28,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:49:28,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca471f0e33d030878a96ac HTTP/1.1" 200 None 2026-04-01 09:49:28,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:49:28,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 09:49:28,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:49:28,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca471f0e33d030878a96ac HTTP/1.1" 200 None 2026-04-01 09:49:28,986 - lava_callback - ERROR - Error processing callback for node 69ca471f0e33d030878a96ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:50:48,512 - lava_callback - INFO - Received callback for node 69ca476c0e33d030878a96bb INFO: 172.21.0.1:50100 - "POST /node/69ca476c0e33d030878a96bb HTTP/1.0" 202 Accepted 2026-04-01 09:50:48,518 - lava_callback - INFO - Starting async job submit for node 69ca476c0e33d030878a96bb 2026-04-01 09:50:48,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:50:48,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca476c0e33d030878a96bb HTTP/1.1" 200 None 2026-04-01 09:50:48,538 - lava_callback - DEBUG - Processing node 69ca476c0e33d030878a96bb: baseline-arm64-baylibre 2026-04-01 09:50:48,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca476c0e33d030878a96bb 2026-04-01 09:50:48,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:50:48,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca476c0e33d030878a96bb HTTP/1.1" 200 None 2026-04-01 09:50:48,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:50:48,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 09:50:48,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:50:48,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca476c0e33d030878a96bb HTTP/1.1" 200 None 2026-04-01 09:50:48,595 - lava_callback - ERROR - Error processing callback for node 69ca476c0e33d030878a96bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48106 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:52:08,569 - lava_callback - INFO - Received callback for node 69ca47b50e33d030878a96c6 INFO: 172.21.0.1:48112 - "POST /node/69ca47b50e33d030878a96c6 HTTP/1.0" 202 Accepted 2026-04-01 09:52:08,575 - lava_callback - INFO - Starting async job submit for node 69ca47b50e33d030878a96c6 2026-04-01 09:52:08,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:52:08,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca47b50e33d030878a96c6 HTTP/1.1" 200 None 2026-04-01 09:52:08,595 - lava_callback - DEBUG - Processing node 69ca47b50e33d030878a96c6: baseline-arm64-baylibre 2026-04-01 09:52:08,595 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca47b50e33d030878a96c6 2026-04-01 09:52:08,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:52:08,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca47b50e33d030878a96c6 HTTP/1.1" 200 None 2026-04-01 09:52:08,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:52:08,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 09:52:08,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:52:08,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca47b50e33d030878a96c6 HTTP/1.1" 200 None 2026-04-01 09:52:08,664 - lava_callback - ERROR - Error processing callback for node 69ca47b50e33d030878a96c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47006 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:53:08,565 - lava_callback - INFO - Received callback for node 69ca48020e33d030878a96cd INFO: 172.21.0.1:47014 - "POST /node/69ca48020e33d030878a96cd HTTP/1.0" 202 Accepted 2026-04-01 09:53:08,570 - lava_callback - INFO - Starting async job submit for node 69ca48020e33d030878a96cd 2026-04-01 09:53:08,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:53:08,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca48020e33d030878a96cd HTTP/1.1" 200 None 2026-04-01 09:53:08,586 - lava_callback - DEBUG - Processing node 69ca48020e33d030878a96cd: baseline-arm64-baylibre 2026-04-01 09:53:08,586 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca48020e33d030878a96cd 2026-04-01 09:53:08,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:53:08,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca48020e33d030878a96cd HTTP/1.1" 200 None 2026-04-01 09:53:08,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:53:08,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 09:53:08,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:53:08,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca48020e33d030878a96cd HTTP/1.1" 200 None 2026-04-01 09:53:08,646 - lava_callback - ERROR - Error processing callback for node 69ca48020e33d030878a96cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:55:10,878 - lava_callback - INFO - Received callback for node 69cce9a274bda3ec93a41fa1 INFO: 172.21.0.1:32896 - "POST /node/69cce9a274bda3ec93a41fa1 HTTP/1.0" 202 Accepted 2026-04-01 09:55:10,885 - lava_callback - INFO - Starting async job submit for node 69cce9a274bda3ec93a41fa1 2026-04-01 09:55:10,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:55:10,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce9a274bda3ec93a41fa1 HTTP/1.1" 200 None 2026-04-01 09:55:10,943 - lava_callback - DEBUG - Processing node 69cce9a274bda3ec93a41fa1: baseline-nfs-arm64 2026-04-01 09:55:11,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:55:11,924 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:55:11,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cce9a274bda3ec93a41fa1/log.txt.gz 2026-04-01 09:55:12,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:55:12,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:55:12,643 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cce9a274bda3ec93a41fa1/lava-logs.yaml 2026-04-01 09:55:12,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 09:55:12,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 09:55:12,813 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cce9a274bda3ec93a41fa1/lava_callback.json.gz 2026-04-01 09:55:12,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:55:12,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce9a274bda3ec93a41fa1 HTTP/1.1" 200 None 2026-04-01 09:55:12,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:55:12,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 09:55:12,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:55:12,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce9a274bda3ec93a41fa1 HTTP/1.1" 200 None 2026-04-01 09:55:12,924 - lava_callback - INFO - Completed processing callback for node 69cce9a274bda3ec93a41fa1 INFO: 172.21.0.1:32910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:55:18,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:55:18,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43212 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:55:51,435 - lava_callback - INFO - Received callback for node 69ca489c0e33d030878a96df INFO: 172.21.0.1:32920 - "POST /node/69ca489c0e33d030878a96df HTTP/1.0" 202 Accepted 2026-04-01 09:55:51,441 - lava_callback - INFO - Starting async job submit for node 69ca489c0e33d030878a96df 2026-04-01 09:55:51,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:55:51,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca489c0e33d030878a96df HTTP/1.1" 200 None 2026-04-01 09:55:51,459 - lava_callback - DEBUG - Processing node 69ca489c0e33d030878a96df: baseline-arm64-clabbe 2026-04-01 09:55:51,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca489c0e33d030878a96df 2026-04-01 09:55:51,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:55:51,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca489c0e33d030878a96df HTTP/1.1" 200 None 2026-04-01 09:55:51,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:55:51,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 09:55:51,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:55:51,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca489c0e33d030878a96df HTTP/1.1" 200 None 2026-04-01 09:55:51,518 - lava_callback - ERROR - Error processing callback for node 69ca489c0e33d030878a96df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59484 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:57:11,442 - lava_callback - INFO - Received callback for node 69ca48e80e33d030878a96ea INFO: 172.21.0.1:59500 - "POST /node/69ca48e80e33d030878a96ea HTTP/1.0" 202 Accepted 2026-04-01 09:57:11,447 - lava_callback - INFO - Starting async job submit for node 69ca48e80e33d030878a96ea 2026-04-01 09:57:11,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:57:11,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca48e80e33d030878a96ea HTTP/1.1" 200 None 2026-04-01 09:57:11,472 - lava_callback - DEBUG - Processing node 69ca48e80e33d030878a96ea: baseline-arm64-clabbe 2026-04-01 09:57:11,472 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca48e80e33d030878a96ea 2026-04-01 09:57:11,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:57:11,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca48e80e33d030878a96ea HTTP/1.1" 200 None 2026-04-01 09:57:11,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:57:11,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 09:57:11,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:57:11,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca48e80e33d030878a96ea HTTP/1.1" 200 None 2026-04-01 09:57:11,525 - lava_callback - ERROR - Error processing callback for node 69ca48e80e33d030878a96ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK 2026-04-01 09:59:31,504 - lava_callback - INFO - Received callback for node 69ca49800e33d030878a96fb INFO: 172.21.0.1:58012 - "POST /node/69ca49800e33d030878a96fb HTTP/1.0" 202 Accepted 2026-04-01 09:59:31,509 - lava_callback - INFO - Starting async job submit for node 69ca49800e33d030878a96fb 2026-04-01 09:59:31,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:59:31,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca49800e33d030878a96fb HTTP/1.1" 200 None 2026-04-01 09:59:31,525 - lava_callback - DEBUG - Processing node 69ca49800e33d030878a96fb: baseline-arm64-clabbe 2026-04-01 09:59:31,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca49800e33d030878a96fb 2026-04-01 09:59:31,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:59:31,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca49800e33d030878a96fb HTTP/1.1" 200 None 2026-04-01 09:59:31,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:59:31,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 09:59:31,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 09:59:31,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca49800e33d030878a96fb HTTP/1.1" 200 None 2026-04-01 09:59:31,581 - lava_callback - ERROR - Error processing callback for node 69ca49800e33d030878a96fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38840 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:00:33,639 - lava_callback - INFO - Received callback for node 69cce8a174bda3ec93a41f36 INFO: 172.21.0.1:57280 - "POST /node/69cce8a174bda3ec93a41f36 HTTP/1.0" 202 Accepted 2026-04-01 10:00:33,649 - lava_callback - INFO - Starting async job submit for node 69cce8a174bda3ec93a41f36 2026-04-01 10:00:33,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:33,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce8a174bda3ec93a41f36 HTTP/1.1" 200 None 2026-04-01 10:00:33,745 - lava_callback - DEBUG - Processing node 69cce8a174bda3ec93a41f36: ltp-smoke 2026-04-01 10:00:34,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:00:34,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:00:34,433 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69cce8a174bda3ec93a41f36/log.txt.gz 2026-04-01 10:00:34,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:00:35,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:00:35,027 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69cce8a174bda3ec93a41f36/lava-logs.yaml 2026-04-01 10:00:35,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:00:35,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:00:35,231 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69cce8a174bda3ec93a41f36/lava_callback.json.gz 2026-04-01 10:00:35,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:35,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce8a174bda3ec93a41f36 HTTP/1.1" 200 None 2026-04-01 10:00:35,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:35,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48874bda3ec93a4126c HTTP/1.1" 200 None 2026-04-01 10:00:35,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:35,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce8a174bda3ec93a41f36 HTTP/1.1" 200 None 2026-04-01 10:00:35,548 - lava_callback - INFO - Completed processing callback for node 69cce8a174bda3ec93a41f36 INFO: 172.21.0.1:57294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45498 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:00:48,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:48,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 10:00:49,207 - lava_callback - INFO - Received callback for node 69cceccd74bda3ec93a420ae INFO: 172.21.0.1:45502 - "POST /node/69cceccd74bda3ec93a420ae HTTP/1.0" 202 Accepted 2026-04-01 10:00:49,213 - lava_callback - INFO - Starting async job submit for node 69cceccd74bda3ec93a420ae 2026-04-01 10:00:49,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:49,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cceccd74bda3ec93a420ae HTTP/1.1" 200 None 2026-04-01 10:00:49,238 - lava_callback - DEBUG - Processing node 69cceccd74bda3ec93a420ae: baseline-nfs-arm64 2026-04-01 10:00:49,240 - lava_callback - WARNING - Failed to upload log 2026-04-01 10:00:49,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:00:49,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:00:49,390 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cceccd74bda3ec93a420ae/lava-logs.yaml 2026-04-01 10:00:49,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:00:49,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:00:49,531 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cceccd74bda3ec93a420ae/lava_callback.json.gz 2026-04-01 10:00:49,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:49,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cceccd74bda3ec93a420ae HTTP/1.1" 200 None 2026-04-01 10:00:49,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:49,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:00:49,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:49,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cceccd74bda3ec93a420ae HTTP/1.1" 200 None 2026-04-01 10:00:49,605 - lava_callback - INFO - Completed processing callback for node 69cceccd74bda3ec93a420ae 2026-04-01 10:00:51,575 - lava_callback - INFO - Received callback for node 69ca49ce0e33d030878a9704 INFO: 172.21.0.1:58108 - "POST /node/69ca49ce0e33d030878a9704 HTTP/1.0" 202 Accepted 2026-04-01 10:00:51,581 - lava_callback - INFO - Starting async job submit for node 69ca49ce0e33d030878a9704 2026-04-01 10:00:51,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:51,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca49ce0e33d030878a9704 HTTP/1.1" 200 None 2026-04-01 10:00:51,598 - lava_callback - DEBUG - Processing node 69ca49ce0e33d030878a9704: baseline-arm64-clabbe 2026-04-01 10:00:51,598 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca49ce0e33d030878a9704 2026-04-01 10:00:51,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:51,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca49ce0e33d030878a9704 HTTP/1.1" 200 None 2026-04-01 10:00:51,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:51,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 10:00:51,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:00:51,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca49ce0e33d030878a9704 HTTP/1.1" 200 None 2026-04-01 10:00:51,654 - lava_callback - ERROR - Error processing callback for node 69ca49ce0e33d030878a9704: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34356 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:01:18,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:01:18,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:02:11,633 - lava_callback - INFO - Received callback for node 69ca4a1b0e33d030878a9714 INFO: 172.21.0.1:47642 - "POST /node/69ca4a1b0e33d030878a9714 HTTP/1.0" 202 Accepted 2026-04-01 10:02:11,639 - lava_callback - INFO - Starting async job submit for node 69ca4a1b0e33d030878a9714 2026-04-01 10:02:11,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:02:11,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4a1b0e33d030878a9714 HTTP/1.1" 200 None 2026-04-01 10:02:11,655 - lava_callback - DEBUG - Processing node 69ca4a1b0e33d030878a9714: baseline-arm64-clabbe 2026-04-01 10:02:11,655 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca4a1b0e33d030878a9714 2026-04-01 10:02:11,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:02:11,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4a1b0e33d030878a9714 HTTP/1.1" 200 None 2026-04-01 10:02:11,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:02:11,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 10:02:11,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:02:11,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca4a1b0e33d030878a9714 HTTP/1.1" 200 None 2026-04-01 10:02:11,711 - lava_callback - ERROR - Error processing callback for node 69ca4a1b0e33d030878a9714: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40618 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:03:36,274 - lava_callback - INFO - Received callback for node 69cced1c74bda3ec93a420cd INFO: 172.21.0.1:34494 - "POST /node/69cced1c74bda3ec93a420cd HTTP/1.0" 202 Accepted 2026-04-01 10:03:36,281 - lava_callback - INFO - Starting async job submit for node 69cced1c74bda3ec93a420cd 2026-04-01 10:03:36,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:03:36,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cced1c74bda3ec93a420cd HTTP/1.1" 200 None 2026-04-01 10:03:36,330 - lava_callback - DEBUG - Processing node 69cced1c74bda3ec93a420cd: baseline-arm64 2026-04-01 10:03:36,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:03:36,629 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:03:36,631 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69cced1c74bda3ec93a420cd/log.txt.gz 2026-04-01 10:03:36,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:03:36,930 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:03:36,932 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cced1c74bda3ec93a420cd/lava-logs.yaml 2026-04-01 10:03:36,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:03:37,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:03:37,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cced1c74bda3ec93a420cd/lava_callback.json.gz 2026-04-01 10:03:37,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:03:37,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cced1c74bda3ec93a420cd HTTP/1.1" 200 None 2026-04-01 10:03:37,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:03:37,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:03:37,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:03:37,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cced1c74bda3ec93a420cd HTTP/1.1" 200 None 2026-04-01 10:03:37,235 - lava_callback - INFO - Completed processing callback for node 69cced1c74bda3ec93a420cd INFO: 172.21.0.1:47164 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:03:48,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:03:48,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34478 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:04:51,765 - lava_callback - INFO - Received callback for node 69ca4ab40e33d030878a972c INFO: 172.21.0.1:59698 - "POST /node/69ca4ab40e33d030878a972c HTTP/1.0" 202 Accepted 2026-04-01 10:04:51,770 - lava_callback - INFO - Starting async job submit for node 69ca4ab40e33d030878a972c 2026-04-01 10:04:51,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:04:51,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4ab40e33d030878a972c HTTP/1.1" 200 None 2026-04-01 10:04:51,787 - lava_callback - DEBUG - Processing node 69ca4ab40e33d030878a972c: baseline-arm64-clabbe 2026-04-01 10:04:51,787 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca4ab40e33d030878a972c 2026-04-01 10:04:51,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:04:51,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4ab40e33d030878a972c HTTP/1.1" 200 None 2026-04-01 10:04:51,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:04:51,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 10:04:51,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:04:51,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca4ab40e33d030878a972c HTTP/1.1" 200 None 2026-04-01 10:04:51,843 - lava_callback - ERROR - Error processing callback for node 69ca4ab40e33d030878a972c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:05:05,535 - lava_callback - INFO - Received callback for node 69cced7174bda3ec93a420e6 INFO: 172.21.0.1:43556 - "POST /node/69cced7174bda3ec93a420e6 HTTP/1.0" 202 Accepted 2026-04-01 10:05:05,542 - lava_callback - INFO - Starting async job submit for node 69cced7174bda3ec93a420e6 2026-04-01 10:05:05,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:05:05,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cced7174bda3ec93a420e6 HTTP/1.1" 200 None 2026-04-01 10:05:05,589 - lava_callback - DEBUG - Processing node 69cced7174bda3ec93a420e6: baseline-arm64 2026-04-01 10:05:05,723 - lava_callback - WARNING - Failed to upload log 2026-04-01 10:05:05,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:05:06,000 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:05:06,002 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69cced7174bda3ec93a420e6/lava-logs.yaml 2026-04-01 10:05:06,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:05:06,182 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:05:06,183 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69cced7174bda3ec93a420e6/lava_callback.json.gz 2026-04-01 10:05:06,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:05:06,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cced7174bda3ec93a420e6 HTTP/1.1" 200 None 2026-04-01 10:05:06,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:05:06,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:05:06,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:05:06,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cced7174bda3ec93a420e6 HTTP/1.1" 200 None 2026-04-01 10:05:06,336 - lava_callback - INFO - Completed processing callback for node 69cced7174bda3ec93a420e6 INFO: 172.21.0.1:43566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40954 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:05:18,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:05:18,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47974 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:08:29,613 - lava_callback - INFO - Received callback for node 69ca4b8d0e33d030878a974d INFO: 172.21.0.1:47976 - "POST /node/69ca4b8d0e33d030878a974d HTTP/1.0" 202 Accepted 2026-04-01 10:08:29,619 - lava_callback - INFO - Starting async job submit for node 69ca4b8d0e33d030878a974d 2026-04-01 10:08:29,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:08:29,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4b8d0e33d030878a974d HTTP/1.1" 200 None 2026-04-01 10:08:29,639 - lava_callback - DEBUG - Processing node 69ca4b8d0e33d030878a974d: baseline-arm64-baylibre 2026-04-01 10:08:29,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca4b8d0e33d030878a974d 2026-04-01 10:08:29,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:08:29,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4b8d0e33d030878a974d HTTP/1.1" 200 None 2026-04-01 10:08:29,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:08:29,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-04-01 10:08:29,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:08:29,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca4b8d0e33d030878a974d HTTP/1.1" 200 None 2026-04-01 10:08:29,700 - lava_callback - ERROR - Error processing callback for node 69ca4b8d0e33d030878a974d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-01 10:08:34,186 - lava_callback - INFO - Received callback for node 69cce9f274bda3ec93a41fc2 INFO: 172.21.0.1:36708 - "POST /node/69cce9f274bda3ec93a41fc2 HTTP/1.0" 202 Accepted 2026-04-01 10:08:34,196 - lava_callback - INFO - Starting async job submit for node 69cce9f274bda3ec93a41fc2 2026-04-01 10:08:34,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:08:34,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce9f274bda3ec93a41fc2 HTTP/1.1" 200 None 2026-04-01 10:08:34,291 - lava_callback - DEBUG - Processing node 69cce9f274bda3ec93a41fc2: baseline-nfs-arm64 2026-04-01 10:08:35,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:08:35,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:08:35,508 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cce9f274bda3ec93a41fc2/log.txt.gz 2026-04-01 10:08:36,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:08:36,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:08:36,434 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cce9f274bda3ec93a41fc2/lava-logs.yaml 2026-04-01 10:08:36,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:36722 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:08:36,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:08:36,661 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69cce9f274bda3ec93a41fc2/lava_callback.json.gz DEBUG: Setup failed for 69cce9f274bda3ec93a41fc2. Transitting job node result: incomplete -> fail 2026-04-01 10:08:36,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:08:36,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cce9f274bda3ec93a41fc2 HTTP/1.1" 200 None 2026-04-01 10:08:36,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:08:36,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:08:36,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:08:36,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cce9f274bda3ec93a41fc2 HTTP/1.1" 200 None 2026-04-01 10:08:36,917 - lava_callback - INFO - Completed processing callback for node 69cce9f274bda3ec93a41fc2 INFO: 172.21.0.1:33586 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:08:48,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:08:48,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41356 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:13:29,777 - lava_callback - INFO - Received callback for node 69ca4cbe0e33d030878a977b INFO: 172.21.0.1:42270 - "POST /node/69ca4cbe0e33d030878a977b HTTP/1.0" 202 Accepted 2026-04-01 10:13:29,785 - lava_callback - INFO - Starting async job submit for node 69ca4cbe0e33d030878a977b 2026-04-01 10:13:29,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:13:29,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4cbe0e33d030878a977b HTTP/1.1" 200 None 2026-04-01 10:13:29,810 - lava_callback - DEBUG - Processing node 69ca4cbe0e33d030878a977b: baseline-arm64-baylibre 2026-04-01 10:13:29,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca4cbe0e33d030878a977b 2026-04-01 10:13:29,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:13:29,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4cbe0e33d030878a977b HTTP/1.1" 200 None 2026-04-01 10:13:29,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:13:29,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-04-01 10:13:29,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:13:29,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca4cbe0e33d030878a977b HTTP/1.1" 200 None 2026-04-01 10:13:29,869 - lava_callback - ERROR - Error processing callback for node 69ca4cbe0e33d030878a977b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60176 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:18:20,701 - lava_callback - INFO - Received callback for node 69ccee6774bda3ec93a4212b INFO: 172.21.0.1:52454 - "POST /node/69ccee6774bda3ec93a4212b HTTP/1.0" 202 Accepted 2026-04-01 10:18:20,708 - lava_callback - INFO - Starting async job submit for node 69ccee6774bda3ec93a4212b 2026-04-01 10:18:20,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:18:20,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccee6774bda3ec93a4212b HTTP/1.1" 200 None 2026-04-01 10:18:20,747 - lava_callback - DEBUG - Processing node 69ccee6774bda3ec93a4212b: baseline-arm64 2026-04-01 10:18:21,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:18:21,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:18:21,419 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccee6774bda3ec93a4212b/log.txt.gz 2026-04-01 10:18:21,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:18:21,915 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:18:21,918 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccee6774bda3ec93a4212b/lava-logs.yaml 2026-04-01 10:18:21,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:18:22,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:18:22,113 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccee6774bda3ec93a4212b/lava_callback.json.gz 2026-04-01 10:18:22,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:18:22,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccee6774bda3ec93a4212b HTTP/1.1" 200 None 2026-04-01 10:18:22,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:18:22,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:18:22,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:18:22,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccee6774bda3ec93a4212b HTTP/1.1" 200 None 2026-04-01 10:18:22,268 - lava_callback - INFO - Completed processing callback for node 69ccee6774bda3ec93a4212b INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:18:30,003 - lava_callback - INFO - Received callback for node 69ca4def0e33d030878a97ae INFO: 172.21.0.1:34018 - "POST /node/69ca4def0e33d030878a97ae HTTP/1.0" 202 Accepted 2026-04-01 10:18:30,009 - lava_callback - INFO - Starting async job submit for node 69ca4def0e33d030878a97ae 2026-04-01 10:18:30,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:18:30,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4def0e33d030878a97ae HTTP/1.1" 200 None 2026-04-01 10:18:30,025 - lava_callback - DEBUG - Processing node 69ca4def0e33d030878a97ae: baseline-arm64-baylibre 2026-04-01 10:18:30,025 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca4def0e33d030878a97ae 2026-04-01 10:18:30,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:18:30,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4def0e33d030878a97ae HTTP/1.1" 200 None 2026-04-01 10:18:30,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:18:30,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-04-01 10:18:30,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:18:30,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca4def0e33d030878a97ae HTTP/1.1" 200 None 2026-04-01 10:18:30,087 - lava_callback - ERROR - Error processing callback for node 69ca4def0e33d030878a97ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:18:48,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:18:48,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33238 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:19:27,539 - lava_callback - INFO - Received callback for node 69ccedc674bda3ec93a420f9 INFO: 172.21.0.1:33240 - "POST /node/69ccedc674bda3ec93a420f9 HTTP/1.0" 202 Accepted 2026-04-01 10:19:27,546 - lava_callback - INFO - Starting async job submit for node 69ccedc674bda3ec93a420f9 2026-04-01 10:19:27,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:19:27,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccedc674bda3ec93a420f9 HTTP/1.1" 200 None 2026-04-01 10:19:27,607 - lava_callback - DEBUG - Processing node 69ccedc674bda3ec93a420f9: baseline-arm 2026-04-01 10:19:28,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:19:28,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:19:28,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ccedc674bda3ec93a420f9/log.txt.gz 2026-04-01 10:19:28,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:19:28,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:19:28,764 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccedc674bda3ec93a420f9/lava-logs.yaml 2026-04-01 10:19:28,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:19:28,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:19:28,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccedc674bda3ec93a420f9/lava_callback.json.gz DEBUG: Setup failed for 69ccedc674bda3ec93a420f9. Transitting job node result: incomplete -> fail 2026-04-01 10:19:29,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:19:29,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccedc674bda3ec93a420f9 HTTP/1.1" 200 None 2026-04-01 10:19:29,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:19:29,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 10:19:29,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:19:29,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccedc674bda3ec93a420f9 HTTP/1.1" 200 None 2026-04-01 10:19:29,258 - lava_callback - INFO - Completed processing callback for node 69ccedc674bda3ec93a420f9 INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:19:48,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:19:48,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 10:19:50,139 - lava_callback - INFO - Received callback for node 69ca4e3a0e33d030878a97b6 INFO: 172.21.0.1:37562 - "POST /node/69ca4e3a0e33d030878a97b6 HTTP/1.0" 202 Accepted 2026-04-01 10:19:50,145 - lava_callback - INFO - Starting async job submit for node 69ca4e3a0e33d030878a97b6 2026-04-01 10:19:50,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:19:50,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4e3a0e33d030878a97b6 HTTP/1.1" 200 None 2026-04-01 10:19:50,161 - lava_callback - DEBUG - Processing node 69ca4e3a0e33d030878a97b6: baseline-arm64-baylibre 2026-04-01 10:19:50,162 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca4e3a0e33d030878a97b6 2026-04-01 10:19:50,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:19:50,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4e3a0e33d030878a97b6 HTTP/1.1" 200 None 2026-04-01 10:19:50,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:19:50,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-04-01 10:19:50,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:19:50,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca4e3a0e33d030878a97b6 HTTP/1.1" 200 None 2026-04-01 10:19:50,218 - lava_callback - ERROR - Error processing callback for node 69ca4e3a0e33d030878a97b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37566 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:20:01,483 - lava_callback - INFO - Received callback for node 69ccedef74bda3ec93a4210c INFO: 172.21.0.1:33722 - "POST /node/69ccedef74bda3ec93a4210c HTTP/1.0" 202 Accepted 2026-04-01 10:20:01,491 - lava_callback - INFO - Starting async job submit for node 69ccedef74bda3ec93a4210c 2026-04-01 10:20:01,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:20:01,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccedef74bda3ec93a4210c HTTP/1.1" 200 None 2026-04-01 10:20:01,567 - lava_callback - DEBUG - Processing node 69ccedef74bda3ec93a4210c: baseline-arm64 2026-04-01 10:20:01,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:20:02,120 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:20:02,122 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccedef74bda3ec93a4210c/log.txt.gz 2026-04-01 10:20:02,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:20:02,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:20:02,634 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccedef74bda3ec93a4210c/lava-logs.yaml 2026-04-01 10:20:02,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:20:02,806 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:20:02,808 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccedef74bda3ec93a4210c/lava_callback.json.gz DEBUG: Setup failed for 69ccedef74bda3ec93a4210c. Transitting job node result: incomplete -> fail 2026-04-01 10:20:02,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:20:02,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccedef74bda3ec93a4210c HTTP/1.1" 200 None 2026-04-01 10:20:02,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:20:02,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:20:02,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:20:02,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccedef74bda3ec93a4210c HTTP/1.1" 200 None 2026-04-01 10:20:03,008 - lava_callback - INFO - Completed processing callback for node 69ccedef74bda3ec93a4210c INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:20:18,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:20:18,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:21:01,544 - lava_callback - INFO - Received callback for node 69ccef1474bda3ec93a4215e INFO: 172.21.0.1:41754 - "POST /node/69ccef1474bda3ec93a4215e HTTP/1.0" 202 Accepted 2026-04-01 10:21:01,550 - lava_callback - INFO - Starting async job submit for node 69ccef1474bda3ec93a4215e 2026-04-01 10:21:01,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:21:01,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccef1474bda3ec93a4215e HTTP/1.1" 200 None 2026-04-01 10:21:01,594 - lava_callback - DEBUG - Processing node 69ccef1474bda3ec93a4215e: baseline-nfs-arm64 2026-04-01 10:21:02,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:21:02,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:21:02,433 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccef1474bda3ec93a4215e/log.txt.gz 2026-04-01 10:21:02,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:21:03,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:21:03,249 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccef1474bda3ec93a4215e/lava-logs.yaml 2026-04-01 10:21:03,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:21:03,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:21:03,419 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccef1474bda3ec93a4215e/lava_callback.json.gz 2026-04-01 10:21:03,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:21:03,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccef1474bda3ec93a4215e HTTP/1.1" 200 None 2026-04-01 10:21:03,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:21:03,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:21:03,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:21:03,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccef1474bda3ec93a4215e HTTP/1.1" 200 None 2026-04-01 10:21:03,556 - lava_callback - INFO - Completed processing callback for node 69ccef1474bda3ec93a4215e INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:21:18,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:21:18,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47308 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:22:30,209 - lava_callback - INFO - Received callback for node 69ca4ed30e33d030878a97d1 INFO: 172.21.0.1:43134 - "POST /node/69ca4ed30e33d030878a97d1 HTTP/1.0" 202 Accepted 2026-04-01 10:22:30,215 - lava_callback - INFO - Starting async job submit for node 69ca4ed30e33d030878a97d1 2026-04-01 10:22:30,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:22:30,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4ed30e33d030878a97d1 HTTP/1.1" 200 None 2026-04-01 10:22:30,231 - lava_callback - DEBUG - Processing node 69ca4ed30e33d030878a97d1: baseline-arm64-baylibre 2026-04-01 10:22:30,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca4ed30e33d030878a97d1 2026-04-01 10:22:30,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:22:30,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4ed30e33d030878a97d1 HTTP/1.1" 200 None 2026-04-01 10:22:30,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:22:30,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-04-01 10:22:30,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:22:30,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca4ed30e33d030878a97d1 HTTP/1.1" 200 None 2026-04-01 10:22:30,291 - lava_callback - ERROR - Error processing callback for node 69ca4ed30e33d030878a97d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35044 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:24:12,627 - lava_callback - INFO - Received callback for node 69ca4f480e33d030878a97f3 INFO: 172.21.0.1:35056 - "POST /node/69ca4f480e33d030878a97f3 HTTP/1.0" 202 Accepted 2026-04-01 10:24:12,633 - lava_callback - INFO - Starting async job submit for node 69ca4f480e33d030878a97f3 2026-04-01 10:24:12,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:24:12,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4f480e33d030878a97f3 HTTP/1.1" 200 None 2026-04-01 10:24:12,657 - lava_callback - DEBUG - Processing node 69ca4f480e33d030878a97f3: baseline-arm64-clabbe 2026-04-01 10:24:12,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca4f480e33d030878a97f3 2026-04-01 10:24:12,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:24:12,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4f480e33d030878a97f3 HTTP/1.1" 200 None 2026-04-01 10:24:12,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:24:12,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-04-01 10:24:12,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:24:12,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca4f480e33d030878a97f3 HTTP/1.1" 200 None 2026-04-01 10:24:12,718 - lava_callback - ERROR - Error processing callback for node 69ca4f480e33d030878a97f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:25:32,727 - lava_callback - INFO - Received callback for node 69ca4f940e33d030878a9803 INFO: 172.21.0.1:48326 - "POST /node/69ca4f940e33d030878a9803 HTTP/1.0" 202 Accepted 2026-04-01 10:25:32,732 - lava_callback - INFO - Starting async job submit for node 69ca4f940e33d030878a9803 2026-04-01 10:25:32,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:25:32,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4f940e33d030878a9803 HTTP/1.1" 200 None 2026-04-01 10:25:32,755 - lava_callback - DEBUG - Processing node 69ca4f940e33d030878a9803: baseline-arm64-clabbe 2026-04-01 10:25:32,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca4f940e33d030878a9803 2026-04-01 10:25:32,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:25:32,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4f940e33d030878a9803 HTTP/1.1" 200 None 2026-04-01 10:25:32,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:25:32,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-04-01 10:25:32,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:25:32,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca4f940e33d030878a9803 HTTP/1.1" 200 None 2026-04-01 10:25:32,818 - lava_callback - ERROR - Error processing callback for node 69ca4f940e33d030878a9803: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:26:23,784 - lava_callback - INFO - Received callback for node 69ccee4874bda3ec93a42124 INFO: 172.21.0.1:51690 - "POST /node/69ccee4874bda3ec93a42124 HTTP/1.0" 202 Accepted 2026-04-01 10:26:23,833 - lava_callback - INFO - Starting async job submit for node 69ccee4874bda3ec93a42124 2026-04-01 10:26:23,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:26:23,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccee4874bda3ec93a42124 HTTP/1.1" 200 None 2026-04-01 10:26:23,881 - lava_callback - DEBUG - Processing node 69ccee4874bda3ec93a42124: baseline-arm-pengutronix 2026-04-01 10:26:23,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:26:24,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:26:24,180 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccee4874bda3ec93a42124/log.txt.gz 2026-04-01 10:26:24,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:26:24,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:26:24,430 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccee4874bda3ec93a42124/lava-logs.yaml 2026-04-01 10:26:24,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:26:24,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:26:24,571 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccee4874bda3ec93a42124/lava_callback.json.gz DEBUG: Setup failed for 69ccee4874bda3ec93a42124. Transitting job node result: incomplete -> fail 2026-04-01 10:26:24,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:26:24,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccee4874bda3ec93a42124 HTTP/1.1" 200 None 2026-04-01 10:26:24,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:26:24,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 10:26:24,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:26:24,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccee4874bda3ec93a42124 HTTP/1.1" 200 None 2026-04-01 10:26:24,724 - lava_callback - INFO - Completed processing callback for node 69ccee4874bda3ec93a42124 INFO: 172.21.0.1:51706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:26:48,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:26:48,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 10:26:53,087 - lava_callback - INFO - Received callback for node 69ca4fe10e33d030878a980e INFO: 172.21.0.1:52868 - "POST /node/69ca4fe10e33d030878a980e HTTP/1.0" 202 Accepted 2026-04-01 10:26:53,092 - lava_callback - INFO - Starting async job submit for node 69ca4fe10e33d030878a980e 2026-04-01 10:26:53,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:26:53,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4fe10e33d030878a980e HTTP/1.1" 200 None 2026-04-01 10:26:53,109 - lava_callback - DEBUG - Processing node 69ca4fe10e33d030878a980e: baseline-arm64-clabbe 2026-04-01 10:26:53,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca4fe10e33d030878a980e 2026-04-01 10:26:53,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:26:53,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca4fe10e33d030878a980e HTTP/1.1" 200 None 2026-04-01 10:26:53,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:26:53,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-04-01 10:26:53,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:26:53,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca4fe10e33d030878a980e HTTP/1.1" 200 None 2026-04-01 10:26:53,169 - lava_callback - ERROR - Error processing callback for node 69ca4fe10e33d030878a980e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38552 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:27:50,100 - lava_callback - INFO - Received callback for node 69ccf31374bda3ec93a422ab INFO: 172.21.0.1:36200 - "POST /node/69ccf31374bda3ec93a422ab HTTP/1.0" 202 Accepted 2026-04-01 10:27:50,105 - lava_callback - INFO - Starting async job submit for node 69ccf31374bda3ec93a422ab 2026-04-01 10:27:50,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:27:50,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf31374bda3ec93a422ab HTTP/1.1" 200 None 2026-04-01 10:27:50,122 - lava_callback - DEBUG - Processing node 69ccf31374bda3ec93a422ab: baseline-nfs-arm64 2026-04-01 10:27:50,124 - lava_callback - WARNING - Failed to upload log 2026-04-01 10:27:50,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:27:50,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:27:50,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccf31374bda3ec93a422ab/lava-logs.yaml 2026-04-01 10:27:50,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:27:50,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:27:50,407 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccf31374bda3ec93a422ab/lava_callback.json.gz 2026-04-01 10:27:50,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:27:50,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf31374bda3ec93a422ab HTTP/1.1" 200 None 2026-04-01 10:27:50,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:27:50,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:27:50,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:27:50,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccf31374bda3ec93a422ab HTTP/1.1" 200 None 2026-04-01 10:27:50,472 - lava_callback - INFO - Completed processing callback for node 69ccf31374bda3ec93a422ab INFO: 172.21.0.1:36208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:28:12,836 - lava_callback - INFO - Received callback for node 69ca502f0e33d030878a981e INFO: 172.21.0.1:36186 - "POST /node/69ca502f0e33d030878a981e HTTP/1.0" 202 Accepted 2026-04-01 10:28:12,842 - lava_callback - INFO - Starting async job submit for node 69ca502f0e33d030878a981e 2026-04-01 10:28:12,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:28:12,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca502f0e33d030878a981e HTTP/1.1" 200 None 2026-04-01 10:28:12,858 - lava_callback - DEBUG - Processing node 69ca502f0e33d030878a981e: baseline-arm64-clabbe 2026-04-01 10:28:12,858 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca502f0e33d030878a981e 2026-04-01 10:28:12,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:28:12,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca502f0e33d030878a981e HTTP/1.1" 200 None 2026-04-01 10:28:12,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:28:12,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-04-01 10:28:12,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:28:12,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca502f0e33d030878a981e HTTP/1.1" 200 None 2026-04-01 10:28:12,916 - lava_callback - ERROR - Error processing callback for node 69ca502f0e33d030878a981e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:28:18,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:28:18,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59028 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:29:32,917 - lava_callback - INFO - Received callback for node 69ca507e0e33d030878a9833 INFO: 172.21.0.1:40958 - "POST /node/69ca507e0e33d030878a9833 HTTP/1.0" 202 Accepted 2026-04-01 10:29:32,922 - lava_callback - INFO - Starting async job submit for node 69ca507e0e33d030878a9833 2026-04-01 10:29:32,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:29:32,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca507e0e33d030878a9833 HTTP/1.1" 200 None 2026-04-01 10:29:32,938 - lava_callback - DEBUG - Processing node 69ca507e0e33d030878a9833: baseline-arm64-clabbe 2026-04-01 10:29:32,938 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca507e0e33d030878a9833 2026-04-01 10:29:32,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:29:32,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca507e0e33d030878a9833 HTTP/1.1" 200 None 2026-04-01 10:29:32,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:29:32,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-04-01 10:29:32,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:29:32,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca507e0e33d030878a9833 HTTP/1.1" 200 None 2026-04-01 10:29:32,993 - lava_callback - ERROR - Error processing callback for node 69ca507e0e33d030878a9833: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48340 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:32:12,918 - lava_callback - INFO - Received callback for node 69ca51170e33d030878a984e INFO: 172.21.0.1:48356 - "POST /node/69ca51170e33d030878a984e HTTP/1.0" 202 Accepted 2026-04-01 10:32:12,923 - lava_callback - INFO - Starting async job submit for node 69ca51170e33d030878a984e 2026-04-01 10:32:12,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:32:12,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca51170e33d030878a984e HTTP/1.1" 200 None 2026-04-01 10:32:12,939 - lava_callback - DEBUG - Processing node 69ca51170e33d030878a984e: baseline-arm64-clabbe 2026-04-01 10:32:12,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca51170e33d030878a984e 2026-04-01 10:32:12,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:32:12,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca51170e33d030878a984e HTTP/1.1" 200 None 2026-04-01 10:32:12,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:32:12,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c248e54a2c5046eb87f89f HTTP/1.1" 200 None 2026-04-01 10:32:12,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:32:12,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca51170e33d030878a984e HTTP/1.1" 200 None 2026-04-01 10:32:13,003 - lava_callback - ERROR - Error processing callback for node 69ca51170e33d030878a984e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:32:26,685 - lava_callback - INFO - Received callback for node 69ccf40974bda3ec93a422f5 INFO: 172.21.0.1:53232 - "POST /node/69ccf40974bda3ec93a422f5 HTTP/1.0" 202 Accepted 2026-04-01 10:32:26,691 - lava_callback - INFO - Starting async job submit for node 69ccf40974bda3ec93a422f5 2026-04-01 10:32:26,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:32:26,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf40974bda3ec93a422f5 HTTP/1.1" 200 None 2026-04-01 10:32:26,743 - lava_callback - DEBUG - Processing node 69ccf40974bda3ec93a422f5: baseline-arm64 2026-04-01 10:32:26,882 - lava_callback - WARNING - Failed to upload log 2026-04-01 10:32:26,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:32:27,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:32:27,178 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccf40974bda3ec93a422f5/lava-logs.yaml 2026-04-01 10:32:27,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:32:27,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:32:27,323 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccf40974bda3ec93a422f5/lava_callback.json.gz 2026-04-01 10:32:27,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:32:27,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf40974bda3ec93a422f5 HTTP/1.1" 200 None 2026-04-01 10:32:27,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:32:27,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:32:27,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:32:27,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccf40974bda3ec93a422f5 HTTP/1.1" 200 None 2026-04-01 10:32:27,498 - lava_callback - INFO - Completed processing callback for node 69ccf40974bda3ec93a422f5 INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58816 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:32:48,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:32:48,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42912 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-01 10:35:15,240 - lava_callback - INFO - Received callback for node 69ccf4b174bda3ec93a42321 INFO: 172.21.0.1:42918 - "POST /node/69ccf4b174bda3ec93a42321 HTTP/1.0" 202 Accepted 2026-04-01 10:35:15,251 - lava_callback - INFO - Starting async job submit for node 69ccf4b174bda3ec93a42321 2026-04-01 10:35:15,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:35:15,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf4b174bda3ec93a42321 HTTP/1.1" 200 None 2026-04-01 10:35:15,299 - lava_callback - DEBUG - Processing node 69ccf4b174bda3ec93a42321: baseline-arm64 2026-04-01 10:35:15,456 - lava_callback - WARNING - Failed to upload log 2026-04-01 10:35:15,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:35:15,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:35:15,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccf4b174bda3ec93a42321/lava-logs.yaml 2026-04-01 10:35:15,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:35:15,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:35:15,864 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccf4b174bda3ec93a42321/lava_callback.json.gz 2026-04-01 10:35:15,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:35:15,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf4b174bda3ec93a42321 HTTP/1.1" 200 None 2026-04-01 10:35:15,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:35:15,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:35:15,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:35:15,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccf4b174bda3ec93a42321 HTTP/1.1" 200 None 2026-04-01 10:35:16,015 - lava_callback - INFO - Completed processing callback for node 69ccf4b174bda3ec93a42321 INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:35:18,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:35:18,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48938 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48158 - "GET /node/698d48ce820eff0a56c15b61%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:44:54,427 - lava_callback - INFO - Received callback for node 69ccf30974bda3ec93a4229e INFO: 172.21.0.1:38226 - "POST /node/69ccf30974bda3ec93a4229e HTTP/1.0" 202 Accepted 2026-04-01 10:44:54,438 - lava_callback - INFO - Starting async job submit for node 69ccf30974bda3ec93a4229e 2026-04-01 10:44:54,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:44:54,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf30974bda3ec93a4229e HTTP/1.1" 200 None 2026-04-01 10:44:54,552 - lava_callback - DEBUG - Processing node 69ccf30974bda3ec93a4229e: ltp-smoke 2026-04-01 10:44:55,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:44:55,178 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:44:55,180 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccf30974bda3ec93a4229e/log.txt.gz 2026-04-01 10:44:55,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:44:55,656 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:44:55,658 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccf30974bda3ec93a4229e/lava-logs.yaml 2026-04-01 10:44:55,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:44:55,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:44:55,832 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ccf30974bda3ec93a4229e/lava_callback.json.gz 2026-04-01 10:44:55,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:44:55,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf30974bda3ec93a4229e HTTP/1.1" 200 None 2026-04-01 10:44:55,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:44:55,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48874bda3ec93a4126c HTTP/1.1" 200 None 2026-04-01 10:44:55,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:44:56,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccf30974bda3ec93a4229e HTTP/1.1" 200 None 2026-04-01 10:44:56,130 - lava_callback - INFO - Completed processing callback for node 69ccf30974bda3ec93a4229e INFO: 172.21.0.1:38228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37260 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:45:18,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:45:18,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:48:51,742 - lava_callback - INFO - Received callback for node 69ca55010e33d030878a98fc INFO: 172.21.0.1:51404 - "POST /node/69ca55010e33d030878a98fc HTTP/1.0" 202 Accepted 2026-04-01 10:48:51,750 - lava_callback - INFO - Starting async job submit for node 69ca55010e33d030878a98fc 2026-04-01 10:48:51,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:48:51,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca55010e33d030878a98fc HTTP/1.1" 200 None 2026-04-01 10:48:51,775 - lava_callback - DEBUG - Processing node 69ca55010e33d030878a98fc: baseline-arm-baylibre 2026-04-01 10:48:51,775 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca55010e33d030878a98fc 2026-04-01 10:48:51,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:48:51,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca55010e33d030878a98fc HTTP/1.1" 200 None 2026-04-01 10:48:51,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:48:51,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-01 10:48:51,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:48:51,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca55010e33d030878a98fc HTTP/1.1" 200 None 2026-04-01 10:48:51,833 - lava_callback - ERROR - Error processing callback for node 69ca55010e33d030878a98fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:50:51,714 - lava_callback - INFO - Received callback for node 69ca55860e33d030878a9922 INFO: 172.21.0.1:35910 - "POST /node/69ca55860e33d030878a9922 HTTP/1.0" 202 Accepted 2026-04-01 10:50:51,720 - lava_callback - INFO - Starting async job submit for node 69ca55860e33d030878a9922 2026-04-01 10:50:51,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:50:51,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca55860e33d030878a9922 HTTP/1.1" 200 None 2026-04-01 10:50:51,738 - lava_callback - DEBUG - Processing node 69ca55860e33d030878a9922: baseline-arm-baylibre 2026-04-01 10:50:51,738 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca55860e33d030878a9922 2026-04-01 10:50:51,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:50:51,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca55860e33d030878a9922 HTTP/1.1" 200 None 2026-04-01 10:50:51,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:50:51,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-01 10:50:51,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:50:51,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca55860e33d030878a9922 HTTP/1.1" 200 None 2026-04-01 10:50:51,813 - lava_callback - ERROR - Error processing callback for node 69ca55860e33d030878a9922: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43878 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:52:53,963 - lava_callback - INFO - Received callback for node 69ca55fb0e33d030878a9959 INFO: 172.21.0.1:54656 - "POST /node/69ca55fb0e33d030878a9959 HTTP/1.0" 202 Accepted 2026-04-01 10:52:53,969 - lava_callback - INFO - Starting async job submit for node 69ca55fb0e33d030878a9959 2026-04-01 10:52:53,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:52:53,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca55fb0e33d030878a9959 HTTP/1.1" 200 None 2026-04-01 10:52:53,985 - lava_callback - DEBUG - Processing node 69ca55fb0e33d030878a9959: baseline-arm-clabbe 2026-04-01 10:52:53,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca55fb0e33d030878a9959 2026-04-01 10:52:53,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:52:53,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca55fb0e33d030878a9959 HTTP/1.1" 200 None 2026-04-01 10:52:54,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:52:54,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-01 10:52:54,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:52:54,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca55fb0e33d030878a9959 HTTP/1.1" 200 None 2026-04-01 10:52:54,044 - lava_callback - ERROR - Error processing callback for node 69ca55fb0e33d030878a9959: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43398 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:54:12,212 - lava_callback - INFO - Received callback for node 69ccf55e74bda3ec93a42354 INFO: 172.21.0.1:43404 - "POST /node/69ccf55e74bda3ec93a42354 HTTP/1.0" 202 Accepted 2026-04-01 10:54:12,218 - lava_callback - INFO - Starting async job submit for node 69ccf55e74bda3ec93a42354 2026-04-01 10:54:12,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:54:12,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf55e74bda3ec93a42354 HTTP/1.1" 200 None 2026-04-01 10:54:12,258 - lava_callback - DEBUG - Processing node 69ccf55e74bda3ec93a42354: baseline-arm64 2026-04-01 10:54:12,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:54:12,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:54:12,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccf55e74bda3ec93a42354/log.txt.gz 2026-04-01 10:54:13,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:54:13,393 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:54:13,396 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccf55e74bda3ec93a42354/lava-logs.yaml 2026-04-01 10:54:13,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:54:13,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:54:13,564 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccf55e74bda3ec93a42354/lava_callback.json.gz 2026-04-01 10:54:13,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:54:13,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf55e74bda3ec93a42354 HTTP/1.1" 200 None 2026-04-01 10:54:13,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:54:13,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:54:13,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:54:13,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccf55e74bda3ec93a42354 HTTP/1.1" 200 None 2026-04-01 10:54:13,708 - lava_callback - INFO - Completed processing callback for node 69ccf55e74bda3ec93a42354 INFO: 172.21.0.1:43418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:54:18,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:54:18,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53298 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:54:54,074 - lava_callback - INFO - Received callback for node 69ca566d0e33d030878a9974 INFO: 172.21.0.1:59740 - "POST /node/69ca566d0e33d030878a9974 HTTP/1.0" 202 Accepted 2026-04-01 10:54:54,080 - lava_callback - INFO - Starting async job submit for node 69ca566d0e33d030878a9974 2026-04-01 10:54:54,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:54:54,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca566d0e33d030878a9974 HTTP/1.1" 200 None 2026-04-01 10:54:54,096 - lava_callback - DEBUG - Processing node 69ca566d0e33d030878a9974: baseline-arm-clabbe 2026-04-01 10:54:54,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca566d0e33d030878a9974 2026-04-01 10:54:54,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:54:54,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca566d0e33d030878a9974 HTTP/1.1" 200 None 2026-04-01 10:54:54,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:54:54,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-01 10:54:54,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:54:54,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca566d0e33d030878a9974 HTTP/1.1" 200 None 2026-04-01 10:54:54,152 - lava_callback - ERROR - Error processing callback for node 69ca566d0e33d030878a9974: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:54:59,023 - lava_callback - INFO - Received callback for node 69ccf5ad74bda3ec93a4236b INFO: 172.21.0.1:59762 - "POST /node/69ccf5ad74bda3ec93a4236b HTTP/1.0" 202 Accepted 2026-04-01 10:54:59,034 - lava_callback - INFO - Starting async job submit for node 69ccf5ad74bda3ec93a4236b 2026-04-01 10:54:59,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:54:59,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf5ad74bda3ec93a4236b HTTP/1.1" 200 None 2026-04-01 10:54:59,114 - lava_callback - DEBUG - Processing node 69ccf5ad74bda3ec93a4236b: baseline-arm 2026-04-01 10:54:59,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:54:59,850 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:54:59,853 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ccf5ad74bda3ec93a4236b/log.txt.gz 2026-04-01 10:55:00,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:55:00,596 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:55:00,599 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ccf5ad74bda3ec93a4236b/lava-logs.yaml 2026-04-01 10:55:00,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:55:00,827 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:55:00,829 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ccf5ad74bda3ec93a4236b/lava_callback.json.gz DEBUG: Setup failed for 69ccf5ad74bda3ec93a4236b. Transitting job node result: incomplete -> fail 2026-04-01 10:55:00,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:01,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf5ad74bda3ec93a4236b HTTP/1.1" 200 None 2026-04-01 10:55:01,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:01,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 10:55:01,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:01,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccf5ad74bda3ec93a4236b HTTP/1.1" 200 None 2026-04-01 10:55:01,202 - lava_callback - INFO - Completed processing callback for node 69ccf5ad74bda3ec93a4236b 2026-04-01 10:55:01,691 - lava_callback - INFO - Received callback for node 69ccf62e74bda3ec93a4238a INFO: 172.21.0.1:42044 - "POST /node/69ccf62e74bda3ec93a4238a HTTP/1.0" 202 Accepted 2026-04-01 10:55:01,699 - lava_callback - INFO - Starting async job submit for node 69ccf62e74bda3ec93a4238a 2026-04-01 10:55:01,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:01,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf62e74bda3ec93a4238a HTTP/1.1" 200 None 2026-04-01 10:55:01,742 - lava_callback - DEBUG - Processing node 69ccf62e74bda3ec93a4238a: baseline-nfs-arm64 2026-04-01 10:55:02,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:55:02,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:55:02,398 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccf62e74bda3ec93a4238a/log.txt.gz 2026-04-01 10:55:02,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:55:02,910 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:55:02,913 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccf62e74bda3ec93a4238a/lava-logs.yaml 2026-04-01 10:55:02,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:55:03,188 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:55:03,190 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccf62e74bda3ec93a4238a/lava_callback.json.gz 2026-04-01 10:55:03,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:03,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf62e74bda3ec93a4238a HTTP/1.1" 200 None 2026-04-01 10:55:03,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:03,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:55:03,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:03,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccf62e74bda3ec93a4238a HTTP/1.1" 200 None 2026-04-01 10:55:03,374 - lava_callback - INFO - Completed processing callback for node 69ccf62e74bda3ec93a4238a INFO: 172.21.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50048 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:55:18,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:18,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33002 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:55:34,066 - lava_callback - INFO - Received callback for node 69ca56950e33d030878a9982 INFO: 172.21.0.1:42108 - "POST /node/69ca56950e33d030878a9982 HTTP/1.0" 202 Accepted 2026-04-01 10:55:34,073 - lava_callback - INFO - Starting async job submit for node 69ca56950e33d030878a9982 2026-04-01 10:55:34,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:34,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca56950e33d030878a9982 HTTP/1.1" 200 None 2026-04-01 10:55:34,098 - lava_callback - DEBUG - Processing node 69ca56950e33d030878a9982: baseline-arm-clabbe 2026-04-01 10:55:34,098 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca56950e33d030878a9982 2026-04-01 10:55:34,099 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:34,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca56950e33d030878a9982 HTTP/1.1" 200 None 2026-04-01 10:55:34,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:34,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-01 10:55:34,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:34,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca56950e33d030878a9982 HTTP/1.1" 200 None 2026-04-01 10:55:34,168 - lava_callback - ERROR - Error processing callback for node 69ca56950e33d030878a9982: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48124 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:55:57,380 - lava_callback - INFO - Received callback for node 69ccf50d74bda3ec93a4233b INFO: 172.21.0.1:48128 - "POST /node/69ccf50d74bda3ec93a4233b HTTP/1.0" 202 Accepted 2026-04-01 10:55:57,387 - lava_callback - INFO - Starting async job submit for node 69ccf50d74bda3ec93a4233b 2026-04-01 10:55:57,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:57,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf50d74bda3ec93a4233b HTTP/1.1" 200 None 2026-04-01 10:55:57,447 - lava_callback - DEBUG - Processing node 69ccf50d74bda3ec93a4233b: baseline-nfs-arm64 2026-04-01 10:55:58,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:55:58,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:55:58,835 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccf50d74bda3ec93a4233b/log.txt.gz 2026-04-01 10:55:59,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:55:59,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:55:59,642 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccf50d74bda3ec93a4233b/lava-logs.yaml 2026-04-01 10:55:59,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:55:59,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:55:59,867 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccf50d74bda3ec93a4233b/lava_callback.json.gz DEBUG: Setup failed for 69ccf50d74bda3ec93a4233b. Transitting job node result: incomplete -> fail 2026-04-01 10:55:59,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:59,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf50d74bda3ec93a4233b HTTP/1.1" 200 None 2026-04-01 10:55:59,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:55:59,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:55:59,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:56:00,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccf50d74bda3ec93a4233b HTTP/1.1" 200 None 2026-04-01 10:56:00,123 - lava_callback - INFO - Completed processing callback for node 69ccf50d74bda3ec93a4233b INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42114 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:56:14,169 - lava_callback - INFO - Received callback for node 69ca56bc0e33d030878a998f INFO: 172.21.0.1:42118 - "POST /node/69ca56bc0e33d030878a998f HTTP/1.0" 202 Accepted 2026-04-01 10:56:14,174 - lava_callback - INFO - Starting async job submit for node 69ca56bc0e33d030878a998f 2026-04-01 10:56:14,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:56:14,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca56bc0e33d030878a998f HTTP/1.1" 200 None 2026-04-01 10:56:14,199 - lava_callback - DEBUG - Processing node 69ca56bc0e33d030878a998f: baseline-arm-clabbe 2026-04-01 10:56:14,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca56bc0e33d030878a998f 2026-04-01 10:56:14,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:56:14,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca56bc0e33d030878a998f HTTP/1.1" 200 None 2026-04-01 10:56:14,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:56:14,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-01 10:56:14,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:56:14,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca56bc0e33d030878a998f HTTP/1.1" 200 None 2026-04-01 10:56:14,251 - lava_callback - ERROR - Error processing callback for node 69ca56bc0e33d030878a998f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42144 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:56:18,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:56:18,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39182 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:56:41,071 - lava_callback - INFO - Received callback for node 69ccf5d774bda3ec93a42378 INFO: 172.21.0.1:50266 - "POST /node/69ccf5d774bda3ec93a42378 HTTP/1.0" 202 Accepted 2026-04-01 10:56:41,079 - lava_callback - INFO - Starting async job submit for node 69ccf5d774bda3ec93a42378 2026-04-01 10:56:41,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:56:41,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf5d774bda3ec93a42378 HTTP/1.1" 200 None 2026-04-01 10:56:41,151 - lava_callback - DEBUG - Processing node 69ccf5d774bda3ec93a42378: baseline-arm64 2026-04-01 10:56:41,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:56:41,675 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:56:41,677 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccf5d774bda3ec93a42378/log.txt.gz 2026-04-01 10:56:41,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:56:42,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:56:42,116 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccf5d774bda3ec93a42378/lava-logs.yaml 2026-04-01 10:56:42,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 10:56:42,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 10:56:42,279 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ccf5d774bda3ec93a42378/lava_callback.json.gz DEBUG: Setup failed for 69ccf5d774bda3ec93a42378. Transitting job node result: incomplete -> fail 2026-04-01 10:56:42,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:56:42,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf5d774bda3ec93a42378 HTTP/1.1" 200 None 2026-04-01 10:56:42,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:56:42,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 10:56:42,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:56:42,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccf5d774bda3ec93a42378 HTTP/1.1" 200 None 2026-04-01 10:56:42,495 - lava_callback - INFO - Completed processing callback for node 69ccf5d774bda3ec93a42378 INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:56:48,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:56:48,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK 2026-04-01 10:57:14,268 - lava_callback - INFO - Received callback for node 69ca57060e33d030878a99ab INFO: 172.21.0.1:49428 - "POST /node/69ca57060e33d030878a99ab HTTP/1.0" 202 Accepted 2026-04-01 10:57:14,273 - lava_callback - INFO - Starting async job submit for node 69ca57060e33d030878a99ab 2026-04-01 10:57:14,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:57:14,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca57060e33d030878a99ab HTTP/1.1" 200 None 2026-04-01 10:57:14,303 - lava_callback - DEBUG - Processing node 69ca57060e33d030878a99ab: baseline-arm-clabbe 2026-04-01 10:57:14,303 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca57060e33d030878a99ab 2026-04-01 10:57:14,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:57:14,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca57060e33d030878a99ab HTTP/1.1" 200 None 2026-04-01 10:57:14,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:57:14,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950a9f2866272ea51b8c4 HTTP/1.1" 200 None 2026-04-01 10:57:14,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 10:57:14,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca57060e33d030878a99ab HTTP/1.1" 200 None 2026-04-01 10:57:14,367 - lava_callback - ERROR - Error processing callback for node 69ca57060e33d030878a99ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45274 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:00:14,773 - lava_callback - INFO - Received callback for node 69cbfccf8df9359ff4898436 INFO: 172.21.0.1:45286 - "POST /node/69cbfccf8df9359ff4898436 HTTP/1.0" 202 Accepted 2026-04-01 11:00:14,782 - lava_callback - INFO - Starting async job submit for node 69cbfccf8df9359ff4898436 2026-04-01 11:00:14,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:00:14,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfccf8df9359ff4898436 HTTP/1.1" 200 None 2026-04-01 11:00:14,824 - lava_callback - DEBUG - Processing node 69cbfccf8df9359ff4898436: baseline-arm64-broonie 2026-04-01 11:00:15,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45288 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-01 11:00:15,205 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:00:15,206 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfccf8df9359ff4898436/log.txt.gz 2026-04-01 11:00:15,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:00:15,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:00:15,592 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfccf8df9359ff4898436/lava-logs.yaml 2026-04-01 11:00:15,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:00:15,774 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:00:15,776 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfccf8df9359ff4898436/lava_callback.json.gz 2026-04-01 11:00:15,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:00:15,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfccf8df9359ff4898436 HTTP/1.1" 200 None 2026-04-01 11:00:15,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:00:15,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-01 11:00:15,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:00:15,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfccf8df9359ff4898436 HTTP/1.1" 200 None 2026-04-01 11:00:15,886 - lava_callback - INFO - Completed processing callback for node 69cbfccf8df9359ff4898436 INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:00:18,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:00:18,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:01:25,464 - lava_callback - INFO - Received callback for node 69ccf68774bda3ec93a423a2 INFO: 172.21.0.1:50736 - "POST /node/69ccf68774bda3ec93a423a2 HTTP/1.0" 202 Accepted 2026-04-01 11:01:25,517 - lava_callback - INFO - Starting async job submit for node 69ccf68774bda3ec93a423a2 2026-04-01 11:01:25,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:01:25,565 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf68774bda3ec93a423a2 HTTP/1.1" 200 None 2026-04-01 11:01:25,566 - lava_callback - DEBUG - Processing node 69ccf68774bda3ec93a423a2: baseline-arm-pengutronix 2026-04-01 11:01:25,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:01:25,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:01:25,832 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccf68774bda3ec93a423a2/log.txt.gz 2026-04-01 11:01:25,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:01:26,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:01:26,085 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccf68774bda3ec93a423a2/lava-logs.yaml 2026-04-01 11:01:26,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:01:26,208 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:01:26,210 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ccf68774bda3ec93a423a2/lava_callback.json.gz DEBUG: Setup failed for 69ccf68774bda3ec93a423a2. Transitting job node result: incomplete -> fail 2026-04-01 11:01:26,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:01:26,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf68774bda3ec93a423a2 HTTP/1.1" 200 None 2026-04-01 11:01:26,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:01:26,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd48274bda3ec93a41266 HTTP/1.1" 200 None 2026-04-01 11:01:26,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:01:26,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccf68774bda3ec93a423a2 HTTP/1.1" 200 None 2026-04-01 11:01:26,374 - lava_callback - INFO - Completed processing callback for node 69ccf68774bda3ec93a423a2 INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:01:48,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:01:48,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-01 11:01:55,212 - lava_callback - INFO - Received callback for node 69cc58d78df9359ff489a10c INFO: 172.21.0.1:47260 - "POST /node/69cc58d78df9359ff489a10c HTTP/1.0" 202 Accepted 2026-04-01 11:01:55,219 - lava_callback - INFO - Starting async job submit for node 69cc58d78df9359ff489a10c 2026-04-01 11:01:55,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:01:55,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc58d78df9359ff489a10c HTTP/1.1" 200 None 2026-04-01 11:01:55,277 - lava_callback - DEBUG - Processing node 69cc58d78df9359ff489a10c: baseline-arm64-broonie 2026-04-01 11:01:55,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:01:55,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:01:55,794 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cc58d78df9359ff489a10c/log.txt.gz 2026-04-01 11:01:55,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:01:56,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:01:56,127 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cc58d78df9359ff489a10c/lava-logs.yaml 2026-04-01 11:01:56,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:01:56,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:01:56,290 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cc58d78df9359ff489a10c/lava_callback.json.gz 2026-04-01 11:01:56,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:01:56,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cc58d78df9359ff489a10c HTTP/1.1" 200 None 2026-04-01 11:01:56,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:01:56,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-01 11:01:56,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:01:56,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cc58d78df9359ff489a10c HTTP/1.1" 200 None 2026-04-01 11:01:56,386 - lava_callback - INFO - Completed processing callback for node 69cc58d78df9359ff489a10c INFO: 172.21.0.1:47276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:02:18,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:02:18,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55466 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:03:15,145 - lava_callback - INFO - Received callback for node 69ccb01d8cd9cbcdc945bdac INFO: 172.21.0.1:55482 - "POST /node/69ccb01d8cd9cbcdc945bdac HTTP/1.0" 202 Accepted 2026-04-01 11:03:15,151 - lava_callback - INFO - Starting async job submit for node 69ccb01d8cd9cbcdc945bdac INFO: 172.21.0.1:55492 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-01 11:03:15,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:03:15,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccb01d8cd9cbcdc945bdac HTTP/1.1" 200 None 2026-04-01 11:03:15,364 - lava_callback - DEBUG - Processing node 69ccb01d8cd9cbcdc945bdac: baseline-arm64-broonie 2026-04-01 11:03:15,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:03:15,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:03:15,769 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccb01d8cd9cbcdc945bdac/log.txt.gz 2026-04-01 11:03:15,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:03:16,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:03:16,138 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccb01d8cd9cbcdc945bdac/lava-logs.yaml 2026-04-01 11:03:16,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:03:16,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:03:16,286 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccb01d8cd9cbcdc945bdac/lava_callback.json.gz 2026-04-01 11:03:16,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:03:16,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccb01d8cd9cbcdc945bdac HTTP/1.1" 200 None 2026-04-01 11:03:16,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:03:16,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-01 11:03:16,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:03:16,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccb01d8cd9cbcdc945bdac HTTP/1.1" 200 None 2026-04-01 11:03:16,401 - lava_callback - INFO - Completed processing callback for node 69ccb01d8cd9cbcdc945bdac INFO: 172.21.0.1:55500 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:03:18,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:03:18,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41718 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:04:17,067 - lava_callback - INFO - Received callback for node 69ccdee974bda3ec93a41a2e INFO: 172.21.0.1:41734 - "POST /node/69ccdee974bda3ec93a41a2e HTTP/1.0" 202 Accepted 2026-04-01 11:04:17,073 - lava_callback - INFO - Starting async job submit for node 69ccdee974bda3ec93a41a2e 2026-04-01 11:04:17,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:04:17,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdee974bda3ec93a41a2e HTTP/1.1" 200 None 2026-04-01 11:04:17,129 - lava_callback - DEBUG - Processing node 69ccdee974bda3ec93a41a2e: baseline-arm64-broonie 2026-04-01 11:04:17,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:04:17,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:04:17,509 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdee974bda3ec93a41a2e/log.txt.gz 2026-04-01 11:04:17,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:04:17,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:04:17,865 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdee974bda3ec93a41a2e/lava-logs.yaml 2026-04-01 11:04:17,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:04:18,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:04:18,048 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdee974bda3ec93a41a2e/lava_callback.json.gz 2026-04-01 11:04:18,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:04:18,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdee974bda3ec93a41a2e HTTP/1.1" 200 None 2026-04-01 11:04:18,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:04:18,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 11:04:18,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:04:18,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdee974bda3ec93a41a2e HTTP/1.1" 200 None 2026-04-01 11:04:18,127 - lava_callback - INFO - Completed processing callback for node 69ccdee974bda3ec93a41a2e 2026-04-01 11:04:18,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:04:18,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:05:12,736 - lava_callback - INFO - Received callback for node 69ca58e50e33d030878a99fb INFO: 172.21.0.1:33012 - "POST /node/69ca58e50e33d030878a99fb HTTP/1.0" 202 Accepted 2026-04-01 11:05:12,741 - lava_callback - INFO - Starting async job submit for node 69ca58e50e33d030878a99fb 2026-04-01 11:05:12,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:05:12,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca58e50e33d030878a99fb HTTP/1.1" 200 None 2026-04-01 11:05:12,772 - lava_callback - DEBUG - Processing node 69ca58e50e33d030878a99fb: baseline-arm64-baylibre 2026-04-01 11:05:12,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca58e50e33d030878a99fb 2026-04-01 11:05:12,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:05:12,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca58e50e33d030878a99fb HTTP/1.1" 200 None 2026-04-01 11:05:12,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:05:12,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-01 11:05:12,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:05:12,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca58e50e33d030878a99fb HTTP/1.1" 200 None 2026-04-01 11:05:12,830 - lava_callback - ERROR - Error processing callback for node 69ca58e50e33d030878a99fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:09:19,273 - lava_callback - INFO - Received callback for node 69cbfcd18df9359ff489843a INFO: 172.21.0.1:59794 - "POST /node/69cbfcd18df9359ff489843a HTTP/1.0" 202 Accepted 2026-04-01 11:09:19,279 - lava_callback - INFO - Starting async job submit for node 69cbfcd18df9359ff489843a 2026-04-01 11:09:19,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:09:19,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcd18df9359ff489843a HTTP/1.1" 200 None 2026-04-01 11:09:19,345 - lava_callback - DEBUG - Processing node 69cbfcd18df9359ff489843a: baseline-arm64-broonie 2026-04-01 11:09:19,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:09:19,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:09:19,795 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfcd18df9359ff489843a/log.txt.gz 2026-04-01 11:09:20,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:09:20,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:09:20,271 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfcd18df9359ff489843a/lava-logs.yaml 2026-04-01 11:09:20,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:09:20,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:09:20,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69cbfcd18df9359ff489843a/lava_callback.json.gz 2026-04-01 11:09:20,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:09:20,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbfcd18df9359ff489843a HTTP/1.1" 200 None 2026-04-01 11:09:20,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:09:20,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf4278df9359ff4897d37 HTTP/1.1" 200 None 2026-04-01 11:09:20,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:09:20,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbfcd18df9359ff489843a HTTP/1.1" 200 None 2026-04-01 11:09:20,571 - lava_callback - INFO - Completed processing callback for node 69cbfcd18df9359ff489843a INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:09:32,665 - lava_callback - INFO - Received callback for node 69ca59d80e33d030878a9a17 INFO: 172.21.0.1:41776 - "POST /node/69ca59d80e33d030878a9a17 HTTP/1.0" 202 Accepted 2026-04-01 11:09:32,670 - lava_callback - INFO - Starting async job submit for node 69ca59d80e33d030878a9a17 2026-04-01 11:09:32,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:09:32,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca59d80e33d030878a9a17 HTTP/1.1" 200 None 2026-04-01 11:09:32,686 - lava_callback - DEBUG - Processing node 69ca59d80e33d030878a9a17: baseline-arm64-baylibre 2026-04-01 11:09:32,686 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca59d80e33d030878a9a17 2026-04-01 11:09:32,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:09:32,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca59d80e33d030878a9a17 HTTP/1.1" 200 None 2026-04-01 11:09:32,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:09:32,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-01 11:09:32,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:09:32,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca59d80e33d030878a9a17 HTTP/1.1" 200 None 2026-04-01 11:09:32,743 - lava_callback - ERROR - Error processing callback for node 69ca59d80e33d030878a9a17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37440 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:09:48,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:09:48,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52640 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:11:19,333 - lava_callback - INFO - Received callback for node 69ccdeec74bda3ec93a41a31 INFO: 172.21.0.1:52642 - "POST /node/69ccdeec74bda3ec93a41a31 HTTP/1.0" 202 Accepted 2026-04-01 11:11:19,340 - lava_callback - INFO - Starting async job submit for node 69ccdeec74bda3ec93a41a31 2026-04-01 11:11:19,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:11:19,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeec74bda3ec93a41a31 HTTP/1.1" 200 None 2026-04-01 11:11:19,380 - lava_callback - DEBUG - Processing node 69ccdeec74bda3ec93a41a31: baseline-arm64-broonie 2026-04-01 11:11:19,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:11:19,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:11:19,768 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdeec74bda3ec93a41a31/log.txt.gz 2026-04-01 11:11:19,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:11:20,213 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:11:20,216 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdeec74bda3ec93a41a31/lava-logs.yaml 2026-04-01 11:11:20,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:11:20,383 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:11:20,384 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ccdeec74bda3ec93a41a31/lava_callback.json.gz 2026-04-01 11:11:20,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:11:20,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccdeec74bda3ec93a41a31 HTTP/1.1" 200 None 2026-04-01 11:11:20,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:11:20,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 11:11:20,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:11:20,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccdeec74bda3ec93a41a31 HTTP/1.1" 200 None 2026-04-01 11:11:20,469 - lava_callback - INFO - Completed processing callback for node 69ccdeec74bda3ec93a41a31 INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49284 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:11:48,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:11:48,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40008 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:12:34,888 - lava_callback - INFO - Received callback for node 69ca5a920e33d030878a9a31 INFO: 172.21.0.1:42398 - "POST /node/69ca5a920e33d030878a9a31 HTTP/1.0" 202 Accepted 2026-04-01 11:12:34,894 - lava_callback - INFO - Starting async job submit for node 69ca5a920e33d030878a9a31 2026-04-01 11:12:34,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:12:34,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5a920e33d030878a9a31 HTTP/1.1" 200 None 2026-04-01 11:12:34,910 - lava_callback - DEBUG - Processing node 69ca5a920e33d030878a9a31: baseline-arm64-clabbe 2026-04-01 11:12:34,911 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca5a920e33d030878a9a31 2026-04-01 11:12:34,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:12:34,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5a920e33d030878a9a31 HTTP/1.1" 200 None 2026-04-01 11:12:34,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:12:34,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-01 11:12:34,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:12:34,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca5a920e33d030878a9a31 HTTP/1.1" 200 None 2026-04-01 11:12:34,977 - lava_callback - ERROR - Error processing callback for node 69ca5a920e33d030878a9a31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39104 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:13:54,985 - lava_callback - INFO - Received callback for node 69ca5ae00e33d030878a9a3f INFO: 172.21.0.1:43904 - "POST /node/69ca5ae00e33d030878a9a3f HTTP/1.0" 202 Accepted 2026-04-01 11:13:54,994 - lava_callback - INFO - Starting async job submit for node 69ca5ae00e33d030878a9a3f 2026-04-01 11:13:54,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:13:55,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5ae00e33d030878a9a3f HTTP/1.1" 200 None 2026-04-01 11:13:55,011 - lava_callback - DEBUG - Processing node 69ca5ae00e33d030878a9a3f: baseline-arm64-clabbe 2026-04-01 11:13:55,011 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca5ae00e33d030878a9a3f 2026-04-01 11:13:55,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:13:55,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5ae00e33d030878a9a3f HTTP/1.1" 200 None 2026-04-01 11:13:55,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:13:55,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-01 11:13:55,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:13:55,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca5ae00e33d030878a9a3f HTTP/1.1" 200 None 2026-04-01 11:13:55,075 - lava_callback - ERROR - Error processing callback for node 69ca5ae00e33d030878a9a3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56558 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:16:18,198 - lava_callback - INFO - Received callback for node 69ccf9c974bda3ec93a423e0 INFO: 172.21.0.1:56560 - "POST /node/69ccf9c974bda3ec93a423e0 HTTP/1.0" 202 Accepted 2026-04-01 11:16:18,205 - lava_callback - INFO - Starting async job submit for node 69ccf9c974bda3ec93a423e0 2026-04-01 11:16:18,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:16:18,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf9c974bda3ec93a423e0 HTTP/1.1" 200 None 2026-04-01 11:16:18,276 - lava_callback - DEBUG - Processing node 69ccf9c974bda3ec93a423e0: baseline-nfs-arm64 2026-04-01 11:16:19,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:16:19,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:16:19,543 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccf9c974bda3ec93a423e0/log.txt.gz 2026-04-01 11:16:20,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:16:20,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:16:20,433 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccf9c974bda3ec93a423e0/lava-logs.yaml 2026-04-01 11:16:20,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-01 11:16:20,650 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-01 11:16:20,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ccf9c974bda3ec93a423e0/lava_callback.json.gz DEBUG: Setup failed for 69ccf9c974bda3ec93a423e0. Transitting job node result: incomplete -> fail 2026-04-01 11:16:20,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:16:20,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccf9c974bda3ec93a423e0 HTTP/1.1" 200 None 2026-04-01 11:16:20,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:16:20,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ccd49074bda3ec93a41275 HTTP/1.1" 200 None 2026-04-01 11:16:20,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:16:20,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ccf9c974bda3ec93a423e0 HTTP/1.1" 200 None 2026-04-01 11:16:20,883 - lava_callback - INFO - Completed processing callback for node 69ccf9c974bda3ec93a423e0 INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:16:35,124 - lava_callback - INFO - Received callback for node 69ca5b820e33d030878a9a55 INFO: 172.21.0.1:41608 - "POST /node/69ca5b820e33d030878a9a55 HTTP/1.0" 202 Accepted 2026-04-01 11:16:35,135 - lava_callback - INFO - Starting async job submit for node 69ca5b820e33d030878a9a55 2026-04-01 11:16:35,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:16:35,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5b820e33d030878a9a55 HTTP/1.1" 200 None 2026-04-01 11:16:35,160 - lava_callback - DEBUG - Processing node 69ca5b820e33d030878a9a55: baseline-arm64-clabbe 2026-04-01 11:16:35,160 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca5b820e33d030878a9a55 2026-04-01 11:16:35,161 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:16:35,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5b820e33d030878a9a55 HTTP/1.1" 200 None 2026-04-01 11:16:35,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:16:35,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-01 11:16:35,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:16:35,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca5b820e33d030878a9a55 HTTP/1.1" 200 None 2026-04-01 11:16:35,246 - lava_callback - ERROR - Error processing callback for node 69ca5b820e33d030878a9a55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39808 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:16:48,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:16:48,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53088 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:17:55,175 - lava_callback - INFO - Received callback for node 69ca5bd10e33d030878a9a5f INFO: 172.21.0.1:54144 - "POST /node/69ca5bd10e33d030878a9a5f HTTP/1.0" 202 Accepted 2026-04-01 11:17:55,180 - lava_callback - INFO - Starting async job submit for node 69ca5bd10e33d030878a9a5f 2026-04-01 11:17:55,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:17:55,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5bd10e33d030878a9a5f HTTP/1.1" 200 None 2026-04-01 11:17:55,196 - lava_callback - DEBUG - Processing node 69ca5bd10e33d030878a9a5f: baseline-arm64-clabbe 2026-04-01 11:17:55,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca5bd10e33d030878a9a5f 2026-04-01 11:17:55,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:17:55,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5bd10e33d030878a9a5f HTTP/1.1" 200 None 2026-04-01 11:17:55,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:17:55,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-01 11:17:55,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:17:55,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca5bd10e33d030878a9a5f HTTP/1.1" 200 None 2026-04-01 11:17:55,255 - lava_callback - ERROR - Error processing callback for node 69ca5bd10e33d030878a9a5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37358 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-01 11:19:15,231 - lava_callback - INFO - Received callback for node 69ca5c1f0e33d030878a9a71 INFO: 172.21.0.1:37372 - "POST /node/69ca5c1f0e33d030878a9a71 HTTP/1.0" 202 Accepted 2026-04-01 11:19:15,237 - lava_callback - INFO - Starting async job submit for node 69ca5c1f0e33d030878a9a71 2026-04-01 11:19:15,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:19:15,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5c1f0e33d030878a9a71 HTTP/1.1" 200 None 2026-04-01 11:19:15,253 - lava_callback - DEBUG - Processing node 69ca5c1f0e33d030878a9a71: baseline-arm64-clabbe 2026-04-01 11:19:15,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca5c1f0e33d030878a9a71 2026-04-01 11:19:15,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:19:15,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5c1f0e33d030878a9a71 HTTP/1.1" 200 None 2026-04-01 11:19:15,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:19:15,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-01 11:19:15,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:19:15,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca5c1f0e33d030878a9a71 HTTP/1.1" 200 None 2026-04-01 11:19:15,314 - lava_callback - ERROR - Error processing callback for node 69ca5c1f0e33d030878a9a71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49876 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44386 - "GET / HTTP/1.0" 200 OK 2026-04-01 11:21:35,333 - lava_callback - INFO - Received callback for node 69ca5caf0e33d030878a9a81 INFO: 172.21.0.1:49690 - "POST /node/69ca5caf0e33d030878a9a81 HTTP/1.0" 202 Accepted 2026-04-01 11:21:35,339 - lava_callback - INFO - Starting async job submit for node 69ca5caf0e33d030878a9a81 2026-04-01 11:21:35,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:21:35,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5caf0e33d030878a9a81 HTTP/1.1" 200 None 2026-04-01 11:21:35,355 - lava_callback - DEBUG - Processing node 69ca5caf0e33d030878a9a81: baseline-arm64-clabbe 2026-04-01 11:21:35,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca5caf0e33d030878a9a81 2026-04-01 11:21:35,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:21:35,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca5caf0e33d030878a9a81 HTTP/1.1" 200 None 2026-04-01 11:21:35,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:21:35,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c950b6f2866272ea51b8d9 HTTP/1.1" 200 None 2026-04-01 11:21:35,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 11:21:35,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca5caf0e33d030878a9a81 HTTP/1.1" 200 None 2026-04-01 11:21:35,413 - lava_callback - ERROR - Error processing callback for node 69ca5caf0e33d030878a9a81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57036 - "GET /node/698c536e755d7811a41416a2%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41952 - "GET /node/69bb47c6a1e2bfb1b3346b86%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42000 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET /node/69b9114f0ec88e58bad0d73f%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53418 - "GET /node/698e2afd952a14bf500e41c7%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40658 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:46:38,086 - lava_callback - INFO - Received callback for node 69ca70a00e33d030878a9b4a INFO: 172.21.0.1:40664 - "POST /node/69ca70a00e33d030878a9b4a HTTP/1.0" 202 Accepted 2026-04-01 12:46:38,091 - lava_callback - INFO - Starting async job submit for node 69ca70a00e33d030878a9b4a 2026-04-01 12:46:38,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:46:38,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca70a00e33d030878a9b4a HTTP/1.1" 200 None 2026-04-01 12:46:38,111 - lava_callback - DEBUG - Processing node 69ca70a00e33d030878a9b4a: baseline-arm-baylibre 2026-04-01 12:46:38,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca70a00e33d030878a9b4a 2026-04-01 12:46:38,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:46:38,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca70a00e33d030878a9b4a HTTP/1.1" 200 None 2026-04-01 12:46:38,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:46:38,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 12:46:38,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:46:38,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca70a00e33d030878a9b4a HTTP/1.1" 200 None 2026-04-01 12:46:38,170 - lava_callback - ERROR - Error processing callback for node 69ca70a00e33d030878a9b4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49068 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52552 - "GET /security.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:52560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56920 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:48:39,085 - lava_callback - INFO - Received callback for node 69ca71140e33d030878a9b80 INFO: 172.21.0.1:56932 - "POST /node/69ca71140e33d030878a9b80 HTTP/1.0" 202 Accepted 2026-04-01 12:48:39,090 - lava_callback - INFO - Starting async job submit for node 69ca71140e33d030878a9b80 2026-04-01 12:48:39,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:48:39,108 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca71140e33d030878a9b80 HTTP/1.1" 200 None 2026-04-01 12:48:39,109 - lava_callback - DEBUG - Processing node 69ca71140e33d030878a9b80: baseline-arm-clabbe 2026-04-01 12:48:39,109 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca71140e33d030878a9b80 2026-04-01 12:48:39,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:48:39,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca71140e33d030878a9b80 HTTP/1.1" 200 None 2026-04-01 12:48:39,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:48:39,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 12:48:39,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:48:39,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca71140e33d030878a9b80 HTTP/1.1" 200 None 2026-04-01 12:48:39,180 - lava_callback - ERROR - Error processing callback for node 69ca71140e33d030878a9b80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48602 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:49:19,059 - lava_callback - INFO - Received callback for node 69ca713b0e33d030878a9b87 INFO: 172.21.0.1:48604 - "POST /node/69ca713b0e33d030878a9b87 HTTP/1.0" 202 Accepted 2026-04-01 12:49:19,064 - lava_callback - INFO - Starting async job submit for node 69ca713b0e33d030878a9b87 2026-04-01 12:49:19,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:49:19,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca713b0e33d030878a9b87 HTTP/1.1" 200 None 2026-04-01 12:49:19,101 - lava_callback - DEBUG - Processing node 69ca713b0e33d030878a9b87: baseline-arm-clabbe 2026-04-01 12:49:19,101 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca713b0e33d030878a9b87 2026-04-01 12:49:19,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:49:19,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca713b0e33d030878a9b87 HTTP/1.1" 200 None 2026-04-01 12:49:19,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:49:19,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 12:49:19,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:49:19,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca713b0e33d030878a9b87 HTTP/1.1" 200 None 2026-04-01 12:49:19,185 - lava_callback - ERROR - Error processing callback for node 69ca713b0e33d030878a9b87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42448 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:49:59,101 - lava_callback - INFO - Received callback for node 69ca71610e33d030878a9b9a INFO: 172.21.0.1:42454 - "POST /node/69ca71610e33d030878a9b9a HTTP/1.0" 202 Accepted 2026-04-01 12:49:59,106 - lava_callback - INFO - Starting async job submit for node 69ca71610e33d030878a9b9a 2026-04-01 12:49:59,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:49:59,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca71610e33d030878a9b9a HTTP/1.1" 200 None 2026-04-01 12:49:59,123 - lava_callback - DEBUG - Processing node 69ca71610e33d030878a9b9a: baseline-arm-clabbe 2026-04-01 12:49:59,123 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca71610e33d030878a9b9a 2026-04-01 12:49:59,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:49:59,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca71610e33d030878a9b9a HTTP/1.1" 200 None 2026-04-01 12:49:59,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:49:59,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 12:49:59,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:49:59,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca71610e33d030878a9b9a HTTP/1.1" 200 None 2026-04-01 12:49:59,177 - lava_callback - ERROR - Error processing callback for node 69ca71610e33d030878a9b9a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:50:19,068 - lava_callback - INFO - Received callback for node 69ca71880e33d030878a9baa INFO: 172.21.0.1:50680 - "POST /node/69ca71880e33d030878a9baa HTTP/1.0" 202 Accepted 2026-04-01 12:50:19,073 - lava_callback - INFO - Starting async job submit for node 69ca71880e33d030878a9baa 2026-04-01 12:50:19,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:50:19,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca71880e33d030878a9baa HTTP/1.1" 200 None 2026-04-01 12:50:19,089 - lava_callback - DEBUG - Processing node 69ca71880e33d030878a9baa: baseline-arm-clabbe 2026-04-01 12:50:19,090 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca71880e33d030878a9baa 2026-04-01 12:50:19,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:50:19,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca71880e33d030878a9baa HTTP/1.1" 200 None 2026-04-01 12:50:19,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:50:19,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 12:50:19,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:50:19,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca71880e33d030878a9baa HTTP/1.1" 200 None 2026-04-01 12:50:19,142 - lava_callback - ERROR - Error processing callback for node 69ca71880e33d030878a9baa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:50:59,129 - lava_callback - INFO - Received callback for node 69ca71ae0e33d030878a9bb9 INFO: 172.21.0.1:38306 - "POST /node/69ca71ae0e33d030878a9bb9 HTTP/1.0" 202 Accepted 2026-04-01 12:50:59,135 - lava_callback - INFO - Starting async job submit for node 69ca71ae0e33d030878a9bb9 2026-04-01 12:50:59,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:50:59,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca71ae0e33d030878a9bb9 HTTP/1.1" 200 None 2026-04-01 12:50:59,151 - lava_callback - DEBUG - Processing node 69ca71ae0e33d030878a9bb9: baseline-arm-clabbe 2026-04-01 12:50:59,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca71ae0e33d030878a9bb9 2026-04-01 12:50:59,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:50:59,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca71ae0e33d030878a9bb9 HTTP/1.1" 200 None 2026-04-01 12:50:59,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:50:59,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c11b3c3aafdab4be7746 HTTP/1.1" 200 None 2026-04-01 12:50:59,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:50:59,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca71ae0e33d030878a9bb9 HTTP/1.1" 200 None 2026-04-01 12:50:59,238 - lava_callback - ERROR - Error processing callback for node 69ca71ae0e33d030878a9bb9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:51:58,513 - lava_callback - INFO - Received callback for node 69ca71e10e33d030878a9bce INFO: 172.21.0.1:51860 - "POST /node/69ca71e10e33d030878a9bce HTTP/1.0" 202 Accepted 2026-04-01 12:51:58,518 - lava_callback - INFO - Starting async job submit for node 69ca71e10e33d030878a9bce 2026-04-01 12:51:58,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:51:58,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca71e10e33d030878a9bce HTTP/1.1" 200 None 2026-04-01 12:51:58,538 - lava_callback - DEBUG - Processing node 69ca71e10e33d030878a9bce: baseline-arm-baylibre 2026-04-01 12:51:58,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca71e10e33d030878a9bce 2026-04-01 12:51:58,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:51:58,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca71e10e33d030878a9bce HTTP/1.1" 200 None 2026-04-01 12:51:58,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:51:58,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 12:51:58,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:51:58,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca71e10e33d030878a9bce HTTP/1.1" 200 None 2026-04-01 12:51:58,620 - lava_callback - ERROR - Error processing callback for node 69ca71e10e33d030878a9bce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46670 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54216 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:53:18,411 - lava_callback - INFO - Received callback for node 69ca72320e33d030878a9bec INFO: 172.21.0.1:54218 - "POST /node/69ca72320e33d030878a9bec HTTP/1.0" 202 Accepted 2026-04-01 12:53:18,417 - lava_callback - INFO - Starting async job submit for node 69ca72320e33d030878a9bec 2026-04-01 12:53:18,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:53:18,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca72320e33d030878a9bec HTTP/1.1" 200 None 2026-04-01 12:53:18,433 - lava_callback - DEBUG - Processing node 69ca72320e33d030878a9bec: baseline-arm-baylibre 2026-04-01 12:53:18,433 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca72320e33d030878a9bec 2026-04-01 12:53:18,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:53:18,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca72320e33d030878a9bec HTTP/1.1" 200 None 2026-04-01 12:53:18,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:53:18,468 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 12:53:18,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:53:18,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca72320e33d030878a9bec HTTP/1.1" 200 None 2026-04-01 12:53:18,500 - lava_callback - ERROR - Error processing callback for node 69ca72320e33d030878a9bec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46300 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:56:19,391 - lava_callback - INFO - Received callback for node 69ca72ed0e33d030878a9c08 INFO: 172.21.0.1:46302 - "POST /node/69ca72ed0e33d030878a9c08 HTTP/1.0" 202 Accepted 2026-04-01 12:56:19,396 - lava_callback - INFO - Starting async job submit for node 69ca72ed0e33d030878a9c08 2026-04-01 12:56:19,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:56:19,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca72ed0e33d030878a9c08 HTTP/1.1" 200 None 2026-04-01 12:56:19,412 - lava_callback - DEBUG - Processing node 69ca72ed0e33d030878a9c08: baseline-arm-clabbe 2026-04-01 12:56:19,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca72ed0e33d030878a9c08 2026-04-01 12:56:19,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:56:19,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca72ed0e33d030878a9c08 HTTP/1.1" 200 None 2026-04-01 12:56:19,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:56:19,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 12:56:19,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:56:19,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca72ed0e33d030878a9c08 HTTP/1.1" 200 None 2026-04-01 12:56:19,474 - lava_callback - ERROR - Error processing callback for node 69ca72ed0e33d030878a9c08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:58:19,467 - lava_callback - INFO - Received callback for node 69ca735c0e33d030878a9c18 INFO: 172.21.0.1:34104 - "POST /node/69ca735c0e33d030878a9c18 HTTP/1.0" 202 Accepted 2026-04-01 12:58:19,473 - lava_callback - INFO - Starting async job submit for node 69ca735c0e33d030878a9c18 2026-04-01 12:58:19,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:58:19,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca735c0e33d030878a9c18 HTTP/1.1" 200 None 2026-04-01 12:58:19,495 - lava_callback - DEBUG - Processing node 69ca735c0e33d030878a9c18: baseline-arm-clabbe 2026-04-01 12:58:19,495 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca735c0e33d030878a9c18 2026-04-01 12:58:19,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:58:19,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca735c0e33d030878a9c18 HTTP/1.1" 200 None 2026-04-01 12:58:19,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:58:19,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 12:58:19,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:58:19,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca735c0e33d030878a9c18 HTTP/1.1" 200 None 2026-04-01 12:58:19,564 - lava_callback - ERROR - Error processing callback for node 69ca735c0e33d030878a9c18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42712 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:58:59,397 - lava_callback - INFO - Received callback for node 69ca73830e33d030878a9c2c INFO: 172.21.0.1:42722 - "POST /node/69ca73830e33d030878a9c2c HTTP/1.0" 202 Accepted 2026-04-01 12:58:59,402 - lava_callback - INFO - Starting async job submit for node 69ca73830e33d030878a9c2c 2026-04-01 12:58:59,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:58:59,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca73830e33d030878a9c2c HTTP/1.1" 200 None 2026-04-01 12:58:59,418 - lava_callback - DEBUG - Processing node 69ca73830e33d030878a9c2c: baseline-arm-clabbe 2026-04-01 12:58:59,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca73830e33d030878a9c2c 2026-04-01 12:58:59,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:58:59,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca73830e33d030878a9c2c HTTP/1.1" 200 None 2026-04-01 12:58:59,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:58:59,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 12:58:59,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:58:59,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca73830e33d030878a9c2c HTTP/1.1" 200 None 2026-04-01 12:58:59,474 - lava_callback - ERROR - Error processing callback for node 69ca73830e33d030878a9c2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57632 - "GET / HTTP/1.0" 200 OK 2026-04-01 12:59:39,501 - lava_callback - INFO - Received callback for node 69ca73a90e33d030878a9c47 INFO: 172.21.0.1:57640 - "POST /node/69ca73a90e33d030878a9c47 HTTP/1.0" 202 Accepted 2026-04-01 12:59:39,506 - lava_callback - INFO - Starting async job submit for node 69ca73a90e33d030878a9c47 2026-04-01 12:59:39,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:59:39,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca73a90e33d030878a9c47 HTTP/1.1" 200 None 2026-04-01 12:59:39,523 - lava_callback - DEBUG - Processing node 69ca73a90e33d030878a9c47: baseline-arm-clabbe 2026-04-01 12:59:39,523 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca73a90e33d030878a9c47 2026-04-01 12:59:39,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:59:39,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca73a90e33d030878a9c47 HTTP/1.1" 200 None 2026-04-01 12:59:39,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:59:39,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 12:59:39,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 12:59:39,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca73a90e33d030878a9c47 HTTP/1.1" 200 None 2026-04-01 12:59:39,579 - lava_callback - ERROR - Error processing callback for node 69ca73a90e33d030878a9c47: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:00:19,638 - lava_callback - INFO - Received callback for node 69ca73cd0e33d030878a9c50 INFO: 172.21.0.1:44194 - "POST /node/69ca73cd0e33d030878a9c50 HTTP/1.0" 202 Accepted 2026-04-01 13:00:19,643 - lava_callback - INFO - Starting async job submit for node 69ca73cd0e33d030878a9c50 2026-04-01 13:00:19,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:00:19,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca73cd0e33d030878a9c50 HTTP/1.1" 200 None 2026-04-01 13:00:19,659 - lava_callback - DEBUG - Processing node 69ca73cd0e33d030878a9c50: baseline-arm-clabbe 2026-04-01 13:00:19,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca73cd0e33d030878a9c50 2026-04-01 13:00:19,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:00:19,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca73cd0e33d030878a9c50 HTTP/1.1" 200 None 2026-04-01 13:00:19,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:00:19,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:00:19,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:00:19,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca73cd0e33d030878a9c50 HTTP/1.1" 200 None 2026-04-01 13:00:19,723 - lava_callback - ERROR - Error processing callback for node 69ca73cd0e33d030878a9c50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:00:39,558 - lava_callback - INFO - Received callback for node 69ca73f20e33d030878a9c62 INFO: 172.21.0.1:34332 - "POST /node/69ca73f20e33d030878a9c62 HTTP/1.0" 202 Accepted 2026-04-01 13:00:39,565 - lava_callback - INFO - Starting async job submit for node 69ca73f20e33d030878a9c62 2026-04-01 13:00:39,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:00:39,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca73f20e33d030878a9c62 HTTP/1.1" 200 None 2026-04-01 13:00:39,584 - lava_callback - DEBUG - Processing node 69ca73f20e33d030878a9c62: baseline-arm-clabbe 2026-04-01 13:00:39,584 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca73f20e33d030878a9c62 2026-04-01 13:00:39,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:00:39,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca73f20e33d030878a9c62 HTTP/1.1" 200 None 2026-04-01 13:00:39,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:00:39,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:00:39,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:00:39,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca73f20e33d030878a9c62 HTTP/1.1" 200 None 2026-04-01 13:00:39,667 - lava_callback - ERROR - Error processing callback for node 69ca73f20e33d030878a9c62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41238 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:01:19,526 - lava_callback - INFO - Received callback for node 69ca74170e33d030878a9c74 INFO: 172.21.0.1:41242 - "POST /node/69ca74170e33d030878a9c74 HTTP/1.0" 202 Accepted 2026-04-01 13:01:19,531 - lava_callback - INFO - Starting async job submit for node 69ca74170e33d030878a9c74 2026-04-01 13:01:19,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:01:19,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca74170e33d030878a9c74 HTTP/1.1" 200 None 2026-04-01 13:01:19,548 - lava_callback - DEBUG - Processing node 69ca74170e33d030878a9c74: baseline-arm-clabbe 2026-04-01 13:01:19,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca74170e33d030878a9c74 2026-04-01 13:01:19,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:01:19,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca74170e33d030878a9c74 HTTP/1.1" 200 None 2026-04-01 13:01:19,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:01:19,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:01:19,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:01:19,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca74170e33d030878a9c74 HTTP/1.1" 200 None 2026-04-01 13:01:19,604 - lava_callback - ERROR - Error processing callback for node 69ca74170e33d030878a9c74: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51802 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:01:59,583 - lava_callback - INFO - Received callback for node 69ca743c0e33d030878a9c84 INFO: 172.21.0.1:51816 - "POST /node/69ca743c0e33d030878a9c84 HTTP/1.0" 202 Accepted 2026-04-01 13:01:59,589 - lava_callback - INFO - Starting async job submit for node 69ca743c0e33d030878a9c84 2026-04-01 13:01:59,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:01:59,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca743c0e33d030878a9c84 HTTP/1.1" 200 None 2026-04-01 13:01:59,605 - lava_callback - DEBUG - Processing node 69ca743c0e33d030878a9c84: baseline-arm-clabbe 2026-04-01 13:01:59,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca743c0e33d030878a9c84 2026-04-01 13:01:59,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:01:59,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca743c0e33d030878a9c84 HTTP/1.1" 200 None 2026-04-01 13:01:59,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:01:59,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:01:59,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:01:59,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca743c0e33d030878a9c84 HTTP/1.1" 200 None 2026-04-01 13:01:59,672 - lava_callback - ERROR - Error processing callback for node 69ca743c0e33d030878a9c84: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34386 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34390 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:03:19,722 - lava_callback - INFO - Received callback for node 69ca74850e33d030878a9ca0 INFO: 172.21.0.1:56864 - "POST /node/69ca74850e33d030878a9ca0 HTTP/1.0" 202 Accepted 2026-04-01 13:03:19,728 - lava_callback - INFO - Starting async job submit for node 69ca74850e33d030878a9ca0 2026-04-01 13:03:19,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:03:19,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca74850e33d030878a9ca0 HTTP/1.1" 200 None 2026-04-01 13:03:19,743 - lava_callback - DEBUG - Processing node 69ca74850e33d030878a9ca0: baseline-arm-clabbe 2026-04-01 13:03:19,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca74850e33d030878a9ca0 2026-04-01 13:03:19,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:03:19,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca74850e33d030878a9ca0 HTTP/1.1" 200 None 2026-04-01 13:03:19,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:03:19,782 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:03:19,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:03:19,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca74850e33d030878a9ca0 HTTP/1.1" 200 None 2026-04-01 13:03:19,833 - lava_callback - ERROR - Error processing callback for node 69ca74850e33d030878a9ca0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42252 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:04:19,738 - lava_callback - INFO - Received callback for node 69ca74ce0e33d030878a9cbf INFO: 172.21.0.1:58092 - "POST /node/69ca74ce0e33d030878a9cbf HTTP/1.0" 202 Accepted 2026-04-01 13:04:19,744 - lava_callback - INFO - Starting async job submit for node 69ca74ce0e33d030878a9cbf 2026-04-01 13:04:19,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:04:19,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca74ce0e33d030878a9cbf HTTP/1.1" 200 None 2026-04-01 13:04:19,760 - lava_callback - DEBUG - Processing node 69ca74ce0e33d030878a9cbf: baseline-arm-clabbe 2026-04-01 13:04:19,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca74ce0e33d030878a9cbf 2026-04-01 13:04:19,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:04:19,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca74ce0e33d030878a9cbf HTTP/1.1" 200 None 2026-04-01 13:04:19,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:04:19,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:04:19,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:04:19,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca74ce0e33d030878a9cbf HTTP/1.1" 200 None 2026-04-01 13:04:19,810 - lava_callback - ERROR - Error processing callback for node 69ca74ce0e33d030878a9cbf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43452 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:06:19,794 - lava_callback - INFO - Received callback for node 69ca753a0e33d030878a9ce5 INFO: 172.21.0.1:33670 - "POST /node/69ca753a0e33d030878a9ce5 HTTP/1.0" 202 Accepted 2026-04-01 13:06:19,801 - lava_callback - INFO - Starting async job submit for node 69ca753a0e33d030878a9ce5 2026-04-01 13:06:19,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:06:19,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca753a0e33d030878a9ce5 HTTP/1.1" 200 None 2026-04-01 13:06:19,817 - lava_callback - DEBUG - Processing node 69ca753a0e33d030878a9ce5: baseline-arm-clabbe 2026-04-01 13:06:19,817 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca753a0e33d030878a9ce5 2026-04-01 13:06:19,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:06:19,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca753a0e33d030878a9ce5 HTTP/1.1" 200 None 2026-04-01 13:06:19,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:06:19,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:06:19,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:06:19,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca753a0e33d030878a9ce5 HTTP/1.1" 200 None 2026-04-01 13:06:19,875 - lava_callback - ERROR - Error processing callback for node 69ca753a0e33d030878a9ce5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60602 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:06:39,321 - lava_callback - INFO - Received callback for node 69ca755c0e33d030878a9cf6 INFO: 172.21.0.1:60616 - "POST /node/69ca755c0e33d030878a9cf6 HTTP/1.0" 202 Accepted 2026-04-01 13:06:39,329 - lava_callback - INFO - Starting async job submit for node 69ca755c0e33d030878a9cf6 2026-04-01 13:06:39,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:06:39,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca755c0e33d030878a9cf6 HTTP/1.1" 200 None 2026-04-01 13:06:39,346 - lava_callback - DEBUG - Processing node 69ca755c0e33d030878a9cf6: baseline-arm-baylibre 2026-04-01 13:06:39,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca755c0e33d030878a9cf6 2026-04-01 13:06:39,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:06:39,361 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca755c0e33d030878a9cf6 HTTP/1.1" 200 None 2026-04-01 13:06:39,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:06:39,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:06:39,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:06:39,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca755c0e33d030878a9cf6 HTTP/1.1" 200 None 2026-04-01 13:06:39,404 - lava_callback - ERROR - Error processing callback for node 69ca755c0e33d030878a9cf6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37336 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:07:19,141 - lava_callback - INFO - Received callback for node 69ca75810e33d030878a9d06 INFO: 172.21.0.1:37340 - "POST /node/69ca75810e33d030878a9d06 HTTP/1.0" 202 Accepted 2026-04-01 13:07:19,147 - lava_callback - INFO - Starting async job submit for node 69ca75810e33d030878a9d06 2026-04-01 13:07:19,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:07:19,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca75810e33d030878a9d06 HTTP/1.1" 200 None 2026-04-01 13:07:19,164 - lava_callback - DEBUG - Processing node 69ca75810e33d030878a9d06: baseline-arm-baylibre 2026-04-01 13:07:19,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca75810e33d030878a9d06 2026-04-01 13:07:19,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:07:19,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca75810e33d030878a9d06 HTTP/1.1" 200 None 2026-04-01 13:07:19,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:07:19,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:07:19,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:07:19,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca75810e33d030878a9d06 HTTP/1.1" 200 None 2026-04-01 13:07:19,245 - lava_callback - ERROR - Error processing callback for node 69ca75810e33d030878a9d06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:08:19,927 - lava_callback - INFO - Received callback for node 69ca75bf0e33d030878a9d1a INFO: 172.21.0.1:45416 - "POST /node/69ca75bf0e33d030878a9d1a HTTP/1.0" 202 Accepted 2026-04-01 13:08:19,936 - lava_callback - INFO - Starting async job submit for node 69ca75bf0e33d030878a9d1a 2026-04-01 13:08:19,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:08:19,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca75bf0e33d030878a9d1a HTTP/1.1" 200 None 2026-04-01 13:08:19,953 - lava_callback - DEBUG - Processing node 69ca75bf0e33d030878a9d1a: baseline-arm-clabbe 2026-04-01 13:08:19,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca75bf0e33d030878a9d1a 2026-04-01 13:08:19,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:08:19,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca75bf0e33d030878a9d1a HTTP/1.1" 200 None 2026-04-01 13:08:19,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:08:19,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:08:19,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:08:20,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca75bf0e33d030878a9d1a HTTP/1.1" 200 None 2026-04-01 13:08:20,020 - lava_callback - ERROR - Error processing callback for node 69ca75bf0e33d030878a9d1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47114 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:09:19,984 - lava_callback - INFO - Received callback for node 69ca75fb0e33d030878a9d2f INFO: 172.21.0.1:60048 - "POST /node/69ca75fb0e33d030878a9d2f HTTP/1.0" 202 Accepted 2026-04-01 13:09:19,990 - lava_callback - INFO - Starting async job submit for node 69ca75fb0e33d030878a9d2f 2026-04-01 13:09:19,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:09:20,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca75fb0e33d030878a9d2f HTTP/1.1" 200 None 2026-04-01 13:09:20,014 - lava_callback - DEBUG - Processing node 69ca75fb0e33d030878a9d2f: baseline-arm-clabbe 2026-04-01 13:09:20,015 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca75fb0e33d030878a9d2f 2026-04-01 13:09:20,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:09:20,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca75fb0e33d030878a9d2f HTTP/1.1" 200 None 2026-04-01 13:09:20,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:09:20,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:09:20,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:09:20,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca75fb0e33d030878a9d2f HTTP/1.1" 200 None 2026-04-01 13:09:20,101 - lava_callback - ERROR - Error processing callback for node 69ca75fb0e33d030878a9d2f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:10:19,931 - lava_callback - INFO - Received callback for node 69ca76370e33d030878a9d43 INFO: 172.21.0.1:51632 - "POST /node/69ca76370e33d030878a9d43 HTTP/1.0" 202 Accepted 2026-04-01 13:10:19,937 - lava_callback - INFO - Starting async job submit for node 69ca76370e33d030878a9d43 2026-04-01 13:10:19,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:10:19,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca76370e33d030878a9d43 HTTP/1.1" 200 None 2026-04-01 13:10:19,953 - lava_callback - DEBUG - Processing node 69ca76370e33d030878a9d43: baseline-arm-clabbe 2026-04-01 13:10:19,953 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca76370e33d030878a9d43 2026-04-01 13:10:19,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:10:19,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca76370e33d030878a9d43 HTTP/1.1" 200 None 2026-04-01 13:10:19,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:10:19,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:10:19,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:10:20,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca76370e33d030878a9d43 HTTP/1.1" 200 None 2026-04-01 13:10:20,007 - lava_callback - ERROR - Error processing callback for node 69ca76370e33d030878a9d43: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:11:19,972 - lava_callback - INFO - Received callback for node 69ca76730e33d030878a9d55 INFO: 172.21.0.1:45722 - "POST /node/69ca76730e33d030878a9d55 HTTP/1.0" 202 Accepted 2026-04-01 13:11:19,978 - lava_callback - INFO - Starting async job submit for node 69ca76730e33d030878a9d55 2026-04-01 13:11:19,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:11:19,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca76730e33d030878a9d55 HTTP/1.1" 200 None 2026-04-01 13:11:19,995 - lava_callback - DEBUG - Processing node 69ca76730e33d030878a9d55: baseline-arm-clabbe 2026-04-01 13:11:19,995 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca76730e33d030878a9d55 2026-04-01 13:11:19,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:11:20,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca76730e33d030878a9d55 HTTP/1.1" 200 None 2026-04-01 13:11:20,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:11:20,033 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e3a29015d0f9598f73c HTTP/1.1" 200 None 2026-04-01 13:11:20,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:11:20,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca76730e33d030878a9d55 HTTP/1.1" 200 None 2026-04-01 13:11:20,081 - lava_callback - ERROR - Error processing callback for node 69ca76730e33d030878a9d55: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:24:40,384 - lava_callback - INFO - Received callback for node 69ca79850e33d030878a9db3 INFO: 172.21.0.1:41494 - "POST /node/69ca79850e33d030878a9db3 HTTP/1.0" 202 Accepted 2026-04-01 13:24:40,390 - lava_callback - INFO - Starting async job submit for node 69ca79850e33d030878a9db3 2026-04-01 13:24:40,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:24:40,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca79850e33d030878a9db3 HTTP/1.1" 200 None 2026-04-01 13:24:40,406 - lava_callback - DEBUG - Processing node 69ca79850e33d030878a9db3: baseline-arm64-baylibre 2026-04-01 13:24:40,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca79850e33d030878a9db3 2026-04-01 13:24:40,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:24:40,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca79850e33d030878a9db3 HTTP/1.1" 200 None 2026-04-01 13:24:40,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:24:40,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 13:24:40,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:24:40,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca79850e33d030878a9db3 HTTP/1.1" 200 None 2026-04-01 13:24:40,458 - lava_callback - ERROR - Error processing callback for node 69ca79850e33d030878a9db3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59274 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:27:00,231 - lava_callback - INFO - Received callback for node 69ca7a1d0e33d030878a9dca INFO: 172.21.0.1:39176 - "POST /node/69ca7a1d0e33d030878a9dca HTTP/1.0" 202 Accepted 2026-04-01 13:27:00,237 - lava_callback - INFO - Starting async job submit for node 69ca7a1d0e33d030878a9dca 2026-04-01 13:27:00,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:27:00,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7a1d0e33d030878a9dca HTTP/1.1" 200 None 2026-04-01 13:27:00,253 - lava_callback - DEBUG - Processing node 69ca7a1d0e33d030878a9dca: baseline-arm64-baylibre 2026-04-01 13:27:00,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7a1d0e33d030878a9dca 2026-04-01 13:27:00,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:27:00,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7a1d0e33d030878a9dca HTTP/1.1" 200 None 2026-04-01 13:27:00,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:27:00,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 13:27:00,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:27:00,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7a1d0e33d030878a9dca HTTP/1.1" 200 None 2026-04-01 13:27:00,313 - lava_callback - ERROR - Error processing callback for node 69ca7a1d0e33d030878a9dca: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54182 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55646 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:29:40,395 - lava_callback - INFO - Received callback for node 69ca7ab50e33d030878a9de3 INFO: 172.21.0.1:41728 - "POST /node/69ca7ab50e33d030878a9de3 HTTP/1.0" 202 Accepted 2026-04-01 13:29:40,401 - lava_callback - INFO - Starting async job submit for node 69ca7ab50e33d030878a9de3 2026-04-01 13:29:40,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:29:40,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7ab50e33d030878a9de3 HTTP/1.1" 200 None 2026-04-01 13:29:40,418 - lava_callback - DEBUG - Processing node 69ca7ab50e33d030878a9de3: baseline-arm64-baylibre 2026-04-01 13:29:40,418 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7ab50e33d030878a9de3 2026-04-01 13:29:40,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:29:40,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7ab50e33d030878a9de3 HTTP/1.1" 200 None 2026-04-01 13:29:40,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:29:40,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 13:29:40,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:29:40,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7ab50e33d030878a9de3 HTTP/1.1" 200 None 2026-04-01 13:29:40,473 - lava_callback - ERROR - Error processing callback for node 69ca7ab50e33d030878a9de3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:31:00,443 - lava_callback - INFO - Received callback for node 69ca7b010e33d030878a9def INFO: 172.21.0.1:42558 - "POST /node/69ca7b010e33d030878a9def HTTP/1.0" 202 Accepted 2026-04-01 13:31:00,449 - lava_callback - INFO - Starting async job submit for node 69ca7b010e33d030878a9def 2026-04-01 13:31:00,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:31:00,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7b010e33d030878a9def HTTP/1.1" 200 None 2026-04-01 13:31:00,473 - lava_callback - DEBUG - Processing node 69ca7b010e33d030878a9def: baseline-arm64-baylibre 2026-04-01 13:31:00,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7b010e33d030878a9def 2026-04-01 13:31:00,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:31:00,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7b010e33d030878a9def HTTP/1.1" 200 None 2026-04-01 13:31:00,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:31:00,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 13:31:00,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:31:00,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7b010e33d030878a9def HTTP/1.1" 200 None 2026-04-01 13:31:00,537 - lava_callback - ERROR - Error processing callback for node 69ca7b010e33d030878a9def: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41446 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:32:00,432 - lava_callback - INFO - Received callback for node 69ca7b4a0e33d030878a9e00 INFO: 172.21.0.1:51850 - "POST /node/69ca7b4a0e33d030878a9e00 HTTP/1.0" 202 Accepted 2026-04-01 13:32:00,438 - lava_callback - INFO - Starting async job submit for node 69ca7b4a0e33d030878a9e00 2026-04-01 13:32:00,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:32:00,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7b4a0e33d030878a9e00 HTTP/1.1" 200 None 2026-04-01 13:32:00,455 - lava_callback - DEBUG - Processing node 69ca7b4a0e33d030878a9e00: baseline-arm64-baylibre 2026-04-01 13:32:00,455 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7b4a0e33d030878a9e00 2026-04-01 13:32:00,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:32:00,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7b4a0e33d030878a9e00 HTTP/1.1" 200 None 2026-04-01 13:32:00,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:32:00,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 13:32:00,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:32:00,504 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7b4a0e33d030878a9e00 HTTP/1.1" 200 None 2026-04-01 13:32:00,509 - lava_callback - ERROR - Error processing callback for node 69ca7b4a0e33d030878a9e00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54490 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:33:41,052 - lava_callback - INFO - Received callback for node 69ca7b9f0e33d030878a9e12 INFO: 172.21.0.1:45734 - "POST /node/69ca7b9f0e33d030878a9e12 HTTP/1.0" 202 Accepted 2026-04-01 13:33:41,057 - lava_callback - INFO - Starting async job submit for node 69ca7b9f0e33d030878a9e12 2026-04-01 13:33:41,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:33:41,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7b9f0e33d030878a9e12 HTTP/1.1" 200 None 2026-04-01 13:33:41,073 - lava_callback - DEBUG - Processing node 69ca7b9f0e33d030878a9e12: baseline-arm64-clabbe 2026-04-01 13:33:41,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7b9f0e33d030878a9e12 2026-04-01 13:33:41,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:33:41,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7b9f0e33d030878a9e12 HTTP/1.1" 200 None 2026-04-01 13:33:41,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:33:41,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 13:33:41,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:33:41,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7b9f0e33d030878a9e12 HTTP/1.1" 200 None 2026-04-01 13:33:41,132 - lava_callback - ERROR - Error processing callback for node 69ca7b9f0e33d030878a9e12: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:34:40,570 - lava_callback - INFO - Received callback for node 69ca7be30e33d030878a9e25 INFO: 172.21.0.1:37022 - "POST /node/69ca7be30e33d030878a9e25 HTTP/1.0" 202 Accepted 2026-04-01 13:34:40,575 - lava_callback - INFO - Starting async job submit for node 69ca7be30e33d030878a9e25 2026-04-01 13:34:40,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:34:40,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7be30e33d030878a9e25 HTTP/1.1" 200 None 2026-04-01 13:34:40,591 - lava_callback - DEBUG - Processing node 69ca7be30e33d030878a9e25: baseline-arm64-baylibre 2026-04-01 13:34:40,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7be30e33d030878a9e25 2026-04-01 13:34:40,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:34:40,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7be30e33d030878a9e25 HTTP/1.1" 200 None 2026-04-01 13:34:40,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:34:40,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 13:34:40,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:34:40,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7be30e33d030878a9e25 HTTP/1.1" 200 None 2026-04-01 13:34:40,653 - lava_callback - ERROR - Error processing callback for node 69ca7be30e33d030878a9e25: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36630 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:36:01,150 - lava_callback - INFO - Received callback for node 69ca7c360e33d030878a9e36 INFO: 172.21.0.1:56568 - "POST /node/69ca7c360e33d030878a9e36 HTTP/1.0" 202 Accepted 2026-04-01 13:36:01,156 - lava_callback - INFO - Starting async job submit for node 69ca7c360e33d030878a9e36 2026-04-01 13:36:01,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:36:01,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7c360e33d030878a9e36 HTTP/1.1" 200 None 2026-04-01 13:36:01,177 - lava_callback - DEBUG - Processing node 69ca7c360e33d030878a9e36: baseline-arm64-clabbe 2026-04-01 13:36:01,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7c360e33d030878a9e36 2026-04-01 13:36:01,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:36:01,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7c360e33d030878a9e36 HTTP/1.1" 200 None 2026-04-01 13:36:01,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:36:01,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 13:36:01,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:36:01,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7c360e33d030878a9e36 HTTP/1.1" 200 None 2026-04-01 13:36:01,245 - lava_callback - ERROR - Error processing callback for node 69ca7c360e33d030878a9e36: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:37:20,703 - lava_callback - INFO - Received callback for node 69ca7c7d0e33d030878a9e41 INFO: 172.21.0.1:38796 - "POST /node/69ca7c7d0e33d030878a9e41 HTTP/1.0" 202 Accepted 2026-04-01 13:37:20,709 - lava_callback - INFO - Starting async job submit for node 69ca7c7d0e33d030878a9e41 2026-04-01 13:37:20,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:37:20,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7c7d0e33d030878a9e41 HTTP/1.1" 200 None 2026-04-01 13:37:20,725 - lava_callback - DEBUG - Processing node 69ca7c7d0e33d030878a9e41: baseline-arm64-baylibre 2026-04-01 13:37:20,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7c7d0e33d030878a9e41 2026-04-01 13:37:20,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:37:20,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7c7d0e33d030878a9e41 HTTP/1.1" 200 None 2026-04-01 13:37:20,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:37:20,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 13:37:20,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:37:20,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7c7d0e33d030878a9e41 HTTP/1.1" 200 None 2026-04-01 13:37:20,789 - lava_callback - ERROR - Error processing callback for node 69ca7c7d0e33d030878a9e41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:38:41,161 - lava_callback - INFO - Received callback for node 69ca7cd20e33d030878a9e57 INFO: 172.21.0.1:36020 - "POST /node/69ca7cd20e33d030878a9e57 HTTP/1.0" 202 Accepted 2026-04-01 13:38:41,166 - lava_callback - INFO - Starting async job submit for node 69ca7cd20e33d030878a9e57 2026-04-01 13:38:41,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:38:41,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7cd20e33d030878a9e57 HTTP/1.1" 200 None 2026-04-01 13:38:41,183 - lava_callback - DEBUG - Processing node 69ca7cd20e33d030878a9e57: baseline-arm64-clabbe 2026-04-01 13:38:41,183 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7cd20e33d030878a9e57 2026-04-01 13:38:41,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:38:41,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7cd20e33d030878a9e57 HTTP/1.1" 200 None 2026-04-01 13:38:41,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:38:41,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 13:38:41,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:38:41,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7cd20e33d030878a9e57 HTTP/1.1" 200 None 2026-04-01 13:38:41,255 - lava_callback - ERROR - Error processing callback for node 69ca7cd20e33d030878a9e57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42102 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:39:40,824 - lava_callback - INFO - Received callback for node 69ca7d180e33d030878a9e61 INFO: 172.21.0.1:49494 - "POST /node/69ca7d180e33d030878a9e61 HTTP/1.0" 202 Accepted 2026-04-01 13:39:40,830 - lava_callback - INFO - Starting async job submit for node 69ca7d180e33d030878a9e61 2026-04-01 13:39:40,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:39:40,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7d180e33d030878a9e61 HTTP/1.1" 200 None 2026-04-01 13:39:40,846 - lava_callback - DEBUG - Processing node 69ca7d180e33d030878a9e61: baseline-arm64-baylibre 2026-04-01 13:39:40,846 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7d180e33d030878a9e61 2026-04-01 13:39:40,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:39:40,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7d180e33d030878a9e61 HTTP/1.1" 200 None 2026-04-01 13:39:40,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:39:40,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 13:39:40,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:39:40,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7d180e33d030878a9e61 HTTP/1.1" 200 None 2026-04-01 13:39:40,917 - lava_callback - ERROR - Error processing callback for node 69ca7d180e33d030878a9e61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39232 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:41:21,252 - lava_callback - INFO - Received callback for node 69ca7d6d0e33d030878a9e70 INFO: 172.21.0.1:39664 - "POST /node/69ca7d6d0e33d030878a9e70 HTTP/1.0" 202 Accepted 2026-04-01 13:41:21,257 - lava_callback - INFO - Starting async job submit for node 69ca7d6d0e33d030878a9e70 2026-04-01 13:41:21,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:41:21,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7d6d0e33d030878a9e70 HTTP/1.1" 200 None 2026-04-01 13:41:21,274 - lava_callback - DEBUG - Processing node 69ca7d6d0e33d030878a9e70: baseline-arm64-clabbe 2026-04-01 13:41:21,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7d6d0e33d030878a9e70 2026-04-01 13:41:21,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:41:21,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7d6d0e33d030878a9e70 HTTP/1.1" 200 None 2026-04-01 13:41:21,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:41:21,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 13:41:21,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:41:21,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7d6d0e33d030878a9e70 HTTP/1.1" 200 None 2026-04-01 13:41:21,338 - lava_callback - ERROR - Error processing callback for node 69ca7d6d0e33d030878a9e70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41854 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:42:20,940 - lava_callback - INFO - Received callback for node 69ca7db40e33d030878a9e7d INFO: 172.21.0.1:42058 - "POST /node/69ca7db40e33d030878a9e7d HTTP/1.0" 202 Accepted 2026-04-01 13:42:20,945 - lava_callback - INFO - Starting async job submit for node 69ca7db40e33d030878a9e7d 2026-04-01 13:42:20,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:42:20,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7db40e33d030878a9e7d HTTP/1.1" 200 None 2026-04-01 13:42:20,968 - lava_callback - DEBUG - Processing node 69ca7db40e33d030878a9e7d: baseline-arm64-baylibre 2026-04-01 13:42:20,968 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7db40e33d030878a9e7d 2026-04-01 13:42:20,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:42:20,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7db40e33d030878a9e7d HTTP/1.1" 200 None 2026-04-01 13:42:20,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:42:20,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 13:42:21,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:42:21,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7db40e33d030878a9e7d HTTP/1.1" 200 None 2026-04-01 13:42:21,029 - lava_callback - ERROR - Error processing callback for node 69ca7db40e33d030878a9e7d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54624 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:43:41,338 - lava_callback - INFO - Received callback for node 69ca7e070e33d030878a9e8f INFO: 172.21.0.1:44624 - "POST /node/69ca7e070e33d030878a9e8f HTTP/1.0" 202 Accepted 2026-04-01 13:43:41,343 - lava_callback - INFO - Starting async job submit for node 69ca7e070e33d030878a9e8f 2026-04-01 13:43:41,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:43:41,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7e070e33d030878a9e8f HTTP/1.1" 200 None 2026-04-01 13:43:41,360 - lava_callback - DEBUG - Processing node 69ca7e070e33d030878a9e8f: baseline-arm64-clabbe 2026-04-01 13:43:41,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7e070e33d030878a9e8f 2026-04-01 13:43:41,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:43:41,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7e070e33d030878a9e8f HTTP/1.1" 200 None 2026-04-01 13:43:41,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:43:41,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 13:43:41,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:43:41,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7e070e33d030878a9e8f HTTP/1.1" 200 None 2026-04-01 13:43:41,411 - lava_callback - ERROR - Error processing callback for node 69ca7e070e33d030878a9e8f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60978 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:45:01,425 - lava_callback - INFO - Received callback for node 69ca7e550e33d030878a9ea4 INFO: 172.21.0.1:59218 - "POST /node/69ca7e550e33d030878a9ea4 HTTP/1.0" 202 Accepted 2026-04-01 13:45:01,431 - lava_callback - INFO - Starting async job submit for node 69ca7e550e33d030878a9ea4 2026-04-01 13:45:01,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:45:01,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7e550e33d030878a9ea4 HTTP/1.1" 200 None 2026-04-01 13:45:01,448 - lava_callback - DEBUG - Processing node 69ca7e550e33d030878a9ea4: baseline-arm64-clabbe 2026-04-01 13:45:01,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7e550e33d030878a9ea4 2026-04-01 13:45:01,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:45:01,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7e550e33d030878a9ea4 HTTP/1.1" 200 None 2026-04-01 13:45:01,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:45:01,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c9c1283c3aafdab4be7756 HTTP/1.1" 200 None 2026-04-01 13:45:01,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:45:01,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7e550e33d030878a9ea4 HTTP/1.1" 200 None 2026-04-01 13:45:01,516 - lava_callback - ERROR - Error processing callback for node 69ca7e550e33d030878a9ea4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60242 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:46:21,145 - lava_callback - INFO - Received callback for node 69ca7e9d0e33d030878a9eac INFO: 172.21.0.1:58896 - "POST /node/69ca7e9d0e33d030878a9eac HTTP/1.0" 202 Accepted 2026-04-01 13:46:21,151 - lava_callback - INFO - Starting async job submit for node 69ca7e9d0e33d030878a9eac 2026-04-01 13:46:21,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:46:21,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7e9d0e33d030878a9eac HTTP/1.1" 200 None 2026-04-01 13:46:21,167 - lava_callback - DEBUG - Processing node 69ca7e9d0e33d030878a9eac: baseline-arm64-baylibre 2026-04-01 13:46:21,167 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7e9d0e33d030878a9eac 2026-04-01 13:46:21,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:46:21,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7e9d0e33d030878a9eac HTTP/1.1" 200 None 2026-04-01 13:46:21,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:46:21,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 13:46:21,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:46:21,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7e9d0e33d030878a9eac HTTP/1.1" 200 None 2026-04-01 13:46:21,224 - lava_callback - ERROR - Error processing callback for node 69ca7e9d0e33d030878a9eac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58574 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39042 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:51:21,659 - lava_callback - INFO - Received callback for node 69ca7fd10e33d030878a9ee4 INFO: 172.21.0.1:44630 - "POST /node/69ca7fd10e33d030878a9ee4 HTTP/1.0" 202 Accepted 2026-04-01 13:51:21,665 - lava_callback - INFO - Starting async job submit for node 69ca7fd10e33d030878a9ee4 2026-04-01 13:51:21,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:51:21,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7fd10e33d030878a9ee4 HTTP/1.1" 200 None 2026-04-01 13:51:21,681 - lava_callback - DEBUG - Processing node 69ca7fd10e33d030878a9ee4: baseline-arm64-clabbe 2026-04-01 13:51:21,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca7fd10e33d030878a9ee4 2026-04-01 13:51:21,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:51:21,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca7fd10e33d030878a9ee4 HTTP/1.1" 200 None 2026-04-01 13:51:21,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:51:21,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 13:51:21,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:51:21,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca7fd10e33d030878a9ee4 HTTP/1.1" 200 None 2026-04-01 13:51:21,738 - lava_callback - ERROR - Error processing callback for node 69ca7fd10e33d030878a9ee4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53448 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:52:41,728 - lava_callback - INFO - Received callback for node 69ca801e0e33d030878a9ef7 INFO: 172.21.0.1:37176 - "POST /node/69ca801e0e33d030878a9ef7 HTTP/1.0" 202 Accepted 2026-04-01 13:52:41,734 - lava_callback - INFO - Starting async job submit for node 69ca801e0e33d030878a9ef7 2026-04-01 13:52:41,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:52:41,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca801e0e33d030878a9ef7 HTTP/1.1" 200 None 2026-04-01 13:52:41,750 - lava_callback - DEBUG - Processing node 69ca801e0e33d030878a9ef7: baseline-arm64-clabbe 2026-04-01 13:52:41,750 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca801e0e33d030878a9ef7 2026-04-01 13:52:41,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:52:41,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca801e0e33d030878a9ef7 HTTP/1.1" 200 None 2026-04-01 13:52:41,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:52:41,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 13:52:41,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:52:41,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca801e0e33d030878a9ef7 HTTP/1.1" 200 None 2026-04-01 13:52:41,809 - lava_callback - ERROR - Error processing callback for node 69ca801e0e33d030878a9ef7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:54:01,801 - lava_callback - INFO - Received callback for node 69ca806d0e33d030878a9f06 INFO: 172.21.0.1:45932 - "POST /node/69ca806d0e33d030878a9f06 HTTP/1.0" 202 Accepted 2026-04-01 13:54:01,807 - lava_callback - INFO - Starting async job submit for node 69ca806d0e33d030878a9f06 2026-04-01 13:54:01,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:54:01,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca806d0e33d030878a9f06 HTTP/1.1" 200 None 2026-04-01 13:54:01,828 - lava_callback - DEBUG - Processing node 69ca806d0e33d030878a9f06: baseline-arm64-clabbe 2026-04-01 13:54:01,829 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca806d0e33d030878a9f06 2026-04-01 13:54:01,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:54:01,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca806d0e33d030878a9f06 HTTP/1.1" 200 None 2026-04-01 13:54:01,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:54:01,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 13:54:01,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:54:01,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca806d0e33d030878a9f06 HTTP/1.1" 200 None 2026-04-01 13:54:01,879 - lava_callback - ERROR - Error processing callback for node 69ca806d0e33d030878a9f06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK 2026-04-01 13:59:22,020 - lava_callback - INFO - Received callback for node 69ca81a60e33d030878a9f3e INFO: 172.21.0.1:59678 - "POST /node/69ca81a60e33d030878a9f3e HTTP/1.0" 202 Accepted 2026-04-01 13:59:22,026 - lava_callback - INFO - Starting async job submit for node 69ca81a60e33d030878a9f3e 2026-04-01 13:59:22,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:59:22,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca81a60e33d030878a9f3e HTTP/1.1" 200 None 2026-04-01 13:59:22,041 - lava_callback - DEBUG - Processing node 69ca81a60e33d030878a9f3e: baseline-arm64-clabbe 2026-04-01 13:59:22,041 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca81a60e33d030878a9f3e 2026-04-01 13:59:22,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:59:22,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca81a60e33d030878a9f3e HTTP/1.1" 200 None 2026-04-01 13:59:22,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:59:22,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 13:59:22,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 13:59:22,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca81a60e33d030878a9f3e HTTP/1.1" 200 None 2026-04-01 13:59:22,099 - lava_callback - ERROR - Error processing callback for node 69ca81a60e33d030878a9f3e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:00:42,100 - lava_callback - INFO - Received callback for node 69ca81fa0e33d030878a9f57 INFO: 172.21.0.1:36510 - "POST /node/69ca81fa0e33d030878a9f57 HTTP/1.0" 202 Accepted 2026-04-01 14:00:42,106 - lava_callback - INFO - Starting async job submit for node 69ca81fa0e33d030878a9f57 2026-04-01 14:00:42,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:00:42,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca81fa0e33d030878a9f57 HTTP/1.1" 200 None 2026-04-01 14:00:42,132 - lava_callback - DEBUG - Processing node 69ca81fa0e33d030878a9f57: baseline-arm64-clabbe 2026-04-01 14:00:42,133 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca81fa0e33d030878a9f57 2026-04-01 14:00:42,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:00:42,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca81fa0e33d030878a9f57 HTTP/1.1" 200 None 2026-04-01 14:00:42,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:00:42,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:00:42,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:00:42,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca81fa0e33d030878a9f57 HTTP/1.1" 200 None 2026-04-01 14:00:42,184 - lava_callback - ERROR - Error processing callback for node 69ca81fa0e33d030878a9f57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54084 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:01:42,013 - lava_callback - INFO - Received callback for node 69ca82440e33d030878a9f60 INFO: 172.21.0.1:53424 - "POST /node/69ca82440e33d030878a9f60 HTTP/1.0" 202 Accepted 2026-04-01 14:01:42,019 - lava_callback - INFO - Starting async job submit for node 69ca82440e33d030878a9f60 2026-04-01 14:01:42,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:01:42,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca82440e33d030878a9f60 HTTP/1.1" 200 None 2026-04-01 14:01:42,037 - lava_callback - DEBUG - Processing node 69ca82440e33d030878a9f60: baseline-arm64-baylibre 2026-04-01 14:01:42,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca82440e33d030878a9f60 2026-04-01 14:01:42,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:01:42,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca82440e33d030878a9f60 HTTP/1.1" 200 None 2026-04-01 14:01:42,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:01:42,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:01:42,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:01:42,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca82440e33d030878a9f60 HTTP/1.1" 200 None 2026-04-01 14:01:42,103 - lava_callback - ERROR - Error processing callback for node 69ca82440e33d030878a9f60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45858 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:03:22,213 - lava_callback - INFO - Received callback for node 69ca82990e33d030878a9f72 INFO: 172.21.0.1:33100 - "POST /node/69ca82990e33d030878a9f72 HTTP/1.0" 202 Accepted 2026-04-01 14:03:22,219 - lava_callback - INFO - Starting async job submit for node 69ca82990e33d030878a9f72 2026-04-01 14:03:22,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:03:22,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca82990e33d030878a9f72 HTTP/1.1" 200 None 2026-04-01 14:03:22,235 - lava_callback - DEBUG - Processing node 69ca82990e33d030878a9f72: baseline-arm64-clabbe 2026-04-01 14:03:22,236 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca82990e33d030878a9f72 2026-04-01 14:03:22,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:03:22,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca82990e33d030878a9f72 HTTP/1.1" 200 None 2026-04-01 14:03:22,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:03:22,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:03:22,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:03:22,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca82990e33d030878a9f72 HTTP/1.1" 200 None 2026-04-01 14:03:22,294 - lava_callback - ERROR - Error processing callback for node 69ca82990e33d030878a9f72: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50950 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50958 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:04:22,088 - lava_callback - INFO - Received callback for node 69ca82e20e33d030878a9f80 INFO: 172.21.0.1:35346 - "POST /node/69ca82e20e33d030878a9f80 HTTP/1.0" 202 Accepted 2026-04-01 14:04:22,094 - lava_callback - INFO - Starting async job submit for node 69ca82e20e33d030878a9f80 2026-04-01 14:04:22,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:04:22,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca82e20e33d030878a9f80 HTTP/1.1" 200 None 2026-04-01 14:04:22,117 - lava_callback - DEBUG - Processing node 69ca82e20e33d030878a9f80: baseline-arm64-baylibre 2026-04-01 14:04:22,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca82e20e33d030878a9f80 2026-04-01 14:04:22,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:04:22,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca82e20e33d030878a9f80 HTTP/1.1" 200 None 2026-04-01 14:04:22,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:04:22,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:04:22,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:04:22,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca82e20e33d030878a9f80 HTTP/1.1" 200 None 2026-04-01 14:04:22,182 - lava_callback - ERROR - Error processing callback for node 69ca82e20e33d030878a9f80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42052 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:06:02,334 - lava_callback - INFO - Received callback for node 69ca83390e33d030878a9f92 INFO: 172.21.0.1:51012 - "POST /node/69ca83390e33d030878a9f92 HTTP/1.0" 202 Accepted 2026-04-01 14:06:02,339 - lava_callback - INFO - Starting async job submit for node 69ca83390e33d030878a9f92 2026-04-01 14:06:02,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:06:02,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca83390e33d030878a9f92 HTTP/1.1" 200 None 2026-04-01 14:06:02,355 - lava_callback - DEBUG - Processing node 69ca83390e33d030878a9f92: baseline-arm64-clabbe 2026-04-01 14:06:02,356 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca83390e33d030878a9f92 2026-04-01 14:06:02,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:06:02,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca83390e33d030878a9f92 HTTP/1.1" 200 None 2026-04-01 14:06:02,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:06:02,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:06:02,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:06:02,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca83390e33d030878a9f92 HTTP/1.1" 200 None 2026-04-01 14:06:02,417 - lava_callback - ERROR - Error processing callback for node 69ca83390e33d030878a9f92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:07:22,366 - lava_callback - INFO - Received callback for node 69ca83880e33d030878a9fa6 INFO: 172.21.0.1:42502 - "POST /node/69ca83880e33d030878a9fa6 HTTP/1.0" 202 Accepted 2026-04-01 14:07:22,373 - lava_callback - INFO - Starting async job submit for node 69ca83880e33d030878a9fa6 2026-04-01 14:07:22,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:07:22,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca83880e33d030878a9fa6 HTTP/1.1" 200 None 2026-04-01 14:07:22,389 - lava_callback - DEBUG - Processing node 69ca83880e33d030878a9fa6: baseline-arm64-clabbe 2026-04-01 14:07:22,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca83880e33d030878a9fa6 2026-04-01 14:07:22,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:07:22,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca83880e33d030878a9fa6 HTTP/1.1" 200 None 2026-04-01 14:07:22,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:07:22,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:07:22,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:07:22,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca83880e33d030878a9fa6 HTTP/1.1" 200 None 2026-04-01 14:07:22,456 - lava_callback - ERROR - Error processing callback for node 69ca83880e33d030878a9fa6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:08:42,454 - lava_callback - INFO - Received callback for node 69ca83d50e33d030878a9fbc INFO: 172.21.0.1:52300 - "POST /node/69ca83d50e33d030878a9fbc HTTP/1.0" 202 Accepted 2026-04-01 14:08:42,459 - lava_callback - INFO - Starting async job submit for node 69ca83d50e33d030878a9fbc 2026-04-01 14:08:42,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:08:42,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca83d50e33d030878a9fbc HTTP/1.1" 200 None 2026-04-01 14:08:42,480 - lava_callback - DEBUG - Processing node 69ca83d50e33d030878a9fbc: baseline-arm64-clabbe 2026-04-01 14:08:42,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca83d50e33d030878a9fbc 2026-04-01 14:08:42,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:08:42,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca83d50e33d030878a9fbc HTTP/1.1" 200 None 2026-04-01 14:08:42,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:08:42,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:08:42,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:08:42,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca83d50e33d030878a9fbc HTTP/1.1" 200 None 2026-04-01 14:08:42,539 - lava_callback - ERROR - Error processing callback for node 69ca83d50e33d030878a9fbc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42920 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:09:42,467 - lava_callback - INFO - Received callback for node 69ca84220e33d030878a9fc7 INFO: 172.21.0.1:42352 - "POST /node/69ca84220e33d030878a9fc7 HTTP/1.0" 202 Accepted 2026-04-01 14:09:42,472 - lava_callback - INFO - Starting async job submit for node 69ca84220e33d030878a9fc7 2026-04-01 14:09:42,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:09:42,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca84220e33d030878a9fc7 HTTP/1.1" 200 None 2026-04-01 14:09:42,488 - lava_callback - DEBUG - Processing node 69ca84220e33d030878a9fc7: baseline-arm64-clabbe 2026-04-01 14:09:42,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca84220e33d030878a9fc7 2026-04-01 14:09:42,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:09:42,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca84220e33d030878a9fc7 HTTP/1.1" 200 None 2026-04-01 14:09:42,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:09:42,519 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:09:42,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:09:42,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca84220e33d030878a9fc7 HTTP/1.1" 200 None 2026-04-01 14:09:42,551 - lava_callback - ERROR - Error processing callback for node 69ca84220e33d030878a9fc7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:11:02,530 - lava_callback - INFO - Received callback for node 69ca84710e33d030878a9fdd INFO: 172.21.0.1:33890 - "POST /node/69ca84710e33d030878a9fdd HTTP/1.0" 202 Accepted 2026-04-01 14:11:02,535 - lava_callback - INFO - Starting async job submit for node 69ca84710e33d030878a9fdd 2026-04-01 14:11:02,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:11:02,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca84710e33d030878a9fdd HTTP/1.1" 200 None 2026-04-01 14:11:02,551 - lava_callback - DEBUG - Processing node 69ca84710e33d030878a9fdd: baseline-arm64-clabbe 2026-04-01 14:11:02,552 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca84710e33d030878a9fdd 2026-04-01 14:11:02,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:11:02,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca84710e33d030878a9fdd HTTP/1.1" 200 None 2026-04-01 14:11:02,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:11:02,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:11:02,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:11:02,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca84710e33d030878a9fdd HTTP/1.1" 200 None 2026-04-01 14:11:02,606 - lava_callback - ERROR - Error processing callback for node 69ca84710e33d030878a9fdd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:12:22,619 - lava_callback - INFO - Received callback for node 69ca84c00e33d030878a9fe4 INFO: 172.21.0.1:59112 - "POST /node/69ca84c00e33d030878a9fe4 HTTP/1.0" 202 Accepted 2026-04-01 14:12:22,624 - lava_callback - INFO - Starting async job submit for node 69ca84c00e33d030878a9fe4 2026-04-01 14:12:22,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:12:22,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca84c00e33d030878a9fe4 HTTP/1.1" 200 None 2026-04-01 14:12:22,641 - lava_callback - DEBUG - Processing node 69ca84c00e33d030878a9fe4: baseline-arm64-clabbe 2026-04-01 14:12:22,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca84c00e33d030878a9fe4 2026-04-01 14:12:22,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:12:22,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca84c00e33d030878a9fe4 HTTP/1.1" 200 None 2026-04-01 14:12:22,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:12:22,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:12:22,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:12:22,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca84c00e33d030878a9fe4 HTTP/1.1" 200 None 2026-04-01 14:12:22,728 - lava_callback - ERROR - Error processing callback for node 69ca84c00e33d030878a9fe4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33364 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:13:42,658 - lava_callback - INFO - Received callback for node 69ca850e0e33d030878a9ff6 INFO: 172.21.0.1:44306 - "POST /node/69ca850e0e33d030878a9ff6 HTTP/1.0" 202 Accepted 2026-04-01 14:13:42,664 - lava_callback - INFO - Starting async job submit for node 69ca850e0e33d030878a9ff6 2026-04-01 14:13:42,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:13:42,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca850e0e33d030878a9ff6 HTTP/1.1" 200 None 2026-04-01 14:13:42,680 - lava_callback - DEBUG - Processing node 69ca850e0e33d030878a9ff6: baseline-arm64-clabbe 2026-04-01 14:13:42,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca850e0e33d030878a9ff6 2026-04-01 14:13:42,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:13:42,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca850e0e33d030878a9ff6 HTTP/1.1" 200 None 2026-04-01 14:13:42,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:13:42,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:13:42,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:13:42,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca850e0e33d030878a9ff6 HTTP/1.1" 200 None 2026-04-01 14:13:42,749 - lava_callback - ERROR - Error processing callback for node 69ca850e0e33d030878a9ff6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49890 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:15:02,718 - lava_callback - INFO - Received callback for node 69ca85600e33d030878aa00b INFO: 172.21.0.1:39912 - "POST /node/69ca85600e33d030878aa00b HTTP/1.0" 202 Accepted 2026-04-01 14:15:02,725 - lava_callback - INFO - Starting async job submit for node 69ca85600e33d030878aa00b 2026-04-01 14:15:02,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:15:02,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca85600e33d030878aa00b HTTP/1.1" 200 None 2026-04-01 14:15:02,742 - lava_callback - DEBUG - Processing node 69ca85600e33d030878aa00b: baseline-arm64-clabbe 2026-04-01 14:15:02,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca85600e33d030878aa00b 2026-04-01 14:15:02,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:15:02,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca85600e33d030878aa00b HTTP/1.1" 200 None 2026-04-01 14:15:02,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:15:02,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:15:02,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:15:02,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca85600e33d030878aa00b HTTP/1.1" 200 None 2026-04-01 14:15:02,802 - lava_callback - ERROR - Error processing callback for node 69ca85600e33d030878aa00b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48942 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:16:22,818 - lava_callback - INFO - Received callback for node 69ca85ad0e33d030878aa011 INFO: 172.21.0.1:36430 - "POST /node/69ca85ad0e33d030878aa011 HTTP/1.0" 202 Accepted 2026-04-01 14:16:22,824 - lava_callback - INFO - Starting async job submit for node 69ca85ad0e33d030878aa011 2026-04-01 14:16:22,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:16:22,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca85ad0e33d030878aa011 HTTP/1.1" 200 None 2026-04-01 14:16:22,855 - lava_callback - DEBUG - Processing node 69ca85ad0e33d030878aa011: baseline-arm64-clabbe 2026-04-01 14:16:22,855 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca85ad0e33d030878aa011 2026-04-01 14:16:22,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:16:22,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca85ad0e33d030878aa011 HTTP/1.1" 200 None 2026-04-01 14:16:22,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:16:22,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:16:22,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:16:22,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca85ad0e33d030878aa011 HTTP/1.1" 200 None 2026-04-01 14:16:22,923 - lava_callback - ERROR - Error processing callback for node 69ca85ad0e33d030878aa011: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:17:42,858 - lava_callback - INFO - Received callback for node 69ca85fa0e33d030878aa021 INFO: 172.21.0.1:59448 - "POST /node/69ca85fa0e33d030878aa021 HTTP/1.0" 202 Accepted 2026-04-01 14:17:42,864 - lava_callback - INFO - Starting async job submit for node 69ca85fa0e33d030878aa021 2026-04-01 14:17:42,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:17:42,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca85fa0e33d030878aa021 HTTP/1.1" 200 None 2026-04-01 14:17:42,881 - lava_callback - DEBUG - Processing node 69ca85fa0e33d030878aa021: baseline-arm64-clabbe 2026-04-01 14:17:42,881 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca85fa0e33d030878aa021 2026-04-01 14:17:42,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:17:42,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca85fa0e33d030878aa021 HTTP/1.1" 200 None 2026-04-01 14:17:42,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:17:42,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:17:42,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:17:42,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca85fa0e33d030878aa021 HTTP/1.1" 200 None 2026-04-01 14:17:42,946 - lava_callback - ERROR - Error processing callback for node 69ca85fa0e33d030878aa021: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46306 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:19:02,871 - lava_callback - INFO - Received callback for node 69ca86470e33d030878aa02a INFO: 172.21.0.1:57218 - "POST /node/69ca86470e33d030878aa02a HTTP/1.0" 202 Accepted 2026-04-01 14:19:02,877 - lava_callback - INFO - Starting async job submit for node 69ca86470e33d030878aa02a 2026-04-01 14:19:02,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:19:02,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca86470e33d030878aa02a HTTP/1.1" 200 None 2026-04-01 14:19:02,899 - lava_callback - DEBUG - Processing node 69ca86470e33d030878aa02a: baseline-arm64-clabbe 2026-04-01 14:19:02,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca86470e33d030878aa02a 2026-04-01 14:19:02,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:19:02,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca86470e33d030878aa02a HTTP/1.1" 200 None 2026-04-01 14:19:02,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:19:02,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:19:02,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:19:02,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca86470e33d030878aa02a HTTP/1.1" 200 None 2026-04-01 14:19:02,951 - lava_callback - ERROR - Error processing callback for node 69ca86470e33d030878aa02a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34894 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:20:22,964 - lava_callback - INFO - Received callback for node 69ca86940e33d030878aa03e INFO: 172.21.0.1:47862 - "POST /node/69ca86940e33d030878aa03e HTTP/1.0" 202 Accepted 2026-04-01 14:20:22,969 - lava_callback - INFO - Starting async job submit for node 69ca86940e33d030878aa03e 2026-04-01 14:20:22,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:20:22,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca86940e33d030878aa03e HTTP/1.1" 200 None 2026-04-01 14:20:22,990 - lava_callback - DEBUG - Processing node 69ca86940e33d030878aa03e: baseline-arm64-clabbe 2026-04-01 14:20:22,990 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca86940e33d030878aa03e 2026-04-01 14:20:22,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:20:23,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca86940e33d030878aa03e HTTP/1.1" 200 None 2026-04-01 14:20:23,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:20:23,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c71e4e29015d0f9598f750 HTTP/1.1" 200 None 2026-04-01 14:20:23,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:20:23,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca86940e33d030878aa03e HTTP/1.1" 200 None 2026-04-01 14:20:23,052 - lava_callback - ERROR - Error processing callback for node 69ca86940e33d030878aa03e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:40:43,903 - lava_callback - INFO - Received callback for node 69ca8b680e33d030878aa05f INFO: 172.21.0.1:60936 - "POST /node/69ca8b680e33d030878aa05f HTTP/1.0" 202 Accepted 2026-04-01 14:40:43,909 - lava_callback - INFO - Starting async job submit for node 69ca8b680e33d030878aa05f 2026-04-01 14:40:43,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:40:43,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8b680e33d030878aa05f HTTP/1.1" 200 None 2026-04-01 14:40:43,925 - lava_callback - DEBUG - Processing node 69ca8b680e33d030878aa05f: baseline-arm-clabbe 2026-04-01 14:40:43,926 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8b680e33d030878aa05f 2026-04-01 14:40:43,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:40:43,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8b680e33d030878aa05f HTTP/1.1" 200 None 2026-04-01 14:40:43,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:40:43,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 14:40:43,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:40:43,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8b680e33d030878aa05f HTTP/1.1" 200 None 2026-04-01 14:40:43,982 - lava_callback - ERROR - Error processing callback for node 69ca8b680e33d030878aa05f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41414 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:41:43,894 - lava_callback - INFO - Received callback for node 69ca8b940e33d030878aa07e INFO: 172.21.0.1:55354 - "POST /node/69ca8b940e33d030878aa07e HTTP/1.0" 202 Accepted 2026-04-01 14:41:43,900 - lava_callback - INFO - Starting async job submit for node 69ca8b940e33d030878aa07e 2026-04-01 14:41:43,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:41:43,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8b940e33d030878aa07e HTTP/1.1" 200 None 2026-04-01 14:41:43,916 - lava_callback - DEBUG - Processing node 69ca8b940e33d030878aa07e: baseline-arm-clabbe 2026-04-01 14:41:43,916 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8b940e33d030878aa07e 2026-04-01 14:41:43,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:41:43,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8b940e33d030878aa07e HTTP/1.1" 200 None 2026-04-01 14:41:43,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:41:43,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 14:41:43,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:41:43,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8b940e33d030878aa07e HTTP/1.1" 200 None 2026-04-01 14:41:43,979 - lava_callback - ERROR - Error processing callback for node 69ca8b940e33d030878aa07e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47076 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:42:43,960 - lava_callback - INFO - Received callback for node 69ca8bd00e33d030878aa097 INFO: 172.21.0.1:38178 - "POST /node/69ca8bd00e33d030878aa097 HTTP/1.0" 202 Accepted 2026-04-01 14:42:43,966 - lava_callback - INFO - Starting async job submit for node 69ca8bd00e33d030878aa097 2026-04-01 14:42:43,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:42:43,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8bd00e33d030878aa097 HTTP/1.1" 200 None 2026-04-01 14:42:43,985 - lava_callback - DEBUG - Processing node 69ca8bd00e33d030878aa097: baseline-arm-clabbe 2026-04-01 14:42:43,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8bd00e33d030878aa097 2026-04-01 14:42:43,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:42:44,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8bd00e33d030878aa097 HTTP/1.1" 200 None 2026-04-01 14:42:44,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:42:44,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 14:42:44,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:42:44,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8bd00e33d030878aa097 HTTP/1.1" 200 None 2026-04-01 14:42:44,049 - lava_callback - ERROR - Error processing callback for node 69ca8bd00e33d030878aa097: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:43:23,956 - lava_callback - INFO - Received callback for node 69ca8bf80e33d030878aa0a5 INFO: 172.21.0.1:53512 - "POST /node/69ca8bf80e33d030878aa0a5 HTTP/1.0" 202 Accepted 2026-04-01 14:43:23,961 - lava_callback - INFO - Starting async job submit for node 69ca8bf80e33d030878aa0a5 2026-04-01 14:43:23,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:43:23,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8bf80e33d030878aa0a5 HTTP/1.1" 200 None 2026-04-01 14:43:23,977 - lava_callback - DEBUG - Processing node 69ca8bf80e33d030878aa0a5: baseline-arm-clabbe 2026-04-01 14:43:23,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8bf80e33d030878aa0a5 2026-04-01 14:43:23,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:43:23,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8bf80e33d030878aa0a5 HTTP/1.1" 200 None 2026-04-01 14:43:23,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:43:24,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 14:43:24,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:43:24,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8bf80e33d030878aa0a5 HTTP/1.1" 200 None 2026-04-01 14:43:24,058 - lava_callback - ERROR - Error processing callback for node 69ca8bf80e33d030878aa0a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42638 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:45:04,110 - lava_callback - INFO - Received callback for node 69ca8c6b0e33d030878aa0f7 INFO: 172.21.0.1:55336 - "POST /node/69ca8c6b0e33d030878aa0f7 HTTP/1.0" 202 Accepted 2026-04-01 14:45:04,116 - lava_callback - INFO - Starting async job submit for node 69ca8c6b0e33d030878aa0f7 2026-04-01 14:45:04,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:45:04,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8c6b0e33d030878aa0f7 HTTP/1.1" 200 None 2026-04-01 14:45:04,132 - lava_callback - DEBUG - Processing node 69ca8c6b0e33d030878aa0f7: baseline-arm-clabbe 2026-04-01 14:45:04,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8c6b0e33d030878aa0f7 2026-04-01 14:45:04,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:45:04,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8c6b0e33d030878aa0f7 HTTP/1.1" 200 None 2026-04-01 14:45:04,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:45:04,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 14:45:04,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:45:04,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8c6b0e33d030878aa0f7 HTTP/1.1" 200 None 2026-04-01 14:45:04,192 - lava_callback - ERROR - Error processing callback for node 69ca8c6b0e33d030878aa0f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:45:44,074 - lava_callback - INFO - Received callback for node 69ca8c930e33d030878aa10a INFO: 172.21.0.1:45694 - "POST /node/69ca8c930e33d030878aa10a HTTP/1.0" 202 Accepted 2026-04-01 14:45:44,080 - lava_callback - INFO - Starting async job submit for node 69ca8c930e33d030878aa10a 2026-04-01 14:45:44,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:45:44,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8c930e33d030878aa10a HTTP/1.1" 200 None 2026-04-01 14:45:44,096 - lava_callback - DEBUG - Processing node 69ca8c930e33d030878aa10a: baseline-arm-clabbe 2026-04-01 14:45:44,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8c930e33d030878aa10a 2026-04-01 14:45:44,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:45:44,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8c930e33d030878aa10a HTTP/1.1" 200 None 2026-04-01 14:45:44,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:45:44,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 14:45:44,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:45:44,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8c930e33d030878aa10a HTTP/1.1" 200 None 2026-04-01 14:45:44,192 - lava_callback - ERROR - Error processing callback for node 69ca8c930e33d030878aa10a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36940 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:49:24,301 - lava_callback - INFO - Received callback for node 69ca8d700e33d030878aa162 INFO: 172.21.0.1:37196 - "POST /node/69ca8d700e33d030878aa162 HTTP/1.0" 202 Accepted 2026-04-01 14:49:24,306 - lava_callback - INFO - Starting async job submit for node 69ca8d700e33d030878aa162 2026-04-01 14:49:24,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:49:24,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8d700e33d030878aa162 HTTP/1.1" 200 None 2026-04-01 14:49:24,322 - lava_callback - DEBUG - Processing node 69ca8d700e33d030878aa162: baseline-arm-clabbe 2026-04-01 14:49:24,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8d700e33d030878aa162 2026-04-01 14:49:24,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:49:24,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8d700e33d030878aa162 HTTP/1.1" 200 None 2026-04-01 14:49:24,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:49:24,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 14:49:24,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:49:24,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8d700e33d030878aa162 HTTP/1.1" 200 None 2026-04-01 14:49:24,381 - lava_callback - ERROR - Error processing callback for node 69ca8d700e33d030878aa162: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54112 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:50:04,412 - lava_callback - INFO - Received callback for node 69ca8d980e33d030878aa173 INFO: 172.21.0.1:38396 - "POST /node/69ca8d980e33d030878aa173 HTTP/1.0" 202 Accepted 2026-04-01 14:50:04,418 - lava_callback - INFO - Starting async job submit for node 69ca8d980e33d030878aa173 2026-04-01 14:50:04,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:50:04,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8d980e33d030878aa173 HTTP/1.1" 200 None 2026-04-01 14:50:04,434 - lava_callback - DEBUG - Processing node 69ca8d980e33d030878aa173: baseline-arm-clabbe 2026-04-01 14:50:04,434 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8d980e33d030878aa173 2026-04-01 14:50:04,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:50:04,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8d980e33d030878aa173 HTTP/1.1" 200 None 2026-04-01 14:50:04,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:50:04,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 14:50:04,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:50:04,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8d980e33d030878aa173 HTTP/1.1" 200 None 2026-04-01 14:50:04,486 - lava_callback - ERROR - Error processing callback for node 69ca8d980e33d030878aa173: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51930 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55852 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:50:44,337 - lava_callback - INFO - Received callback for node 69ca8dc10e33d030878aa196 INFO: 172.21.0.1:45796 - "POST /node/69ca8dc10e33d030878aa196 HTTP/1.0" 202 Accepted 2026-04-01 14:50:44,343 - lava_callback - INFO - Starting async job submit for node 69ca8dc10e33d030878aa196 2026-04-01 14:50:44,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:50:44,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8dc10e33d030878aa196 HTTP/1.1" 200 None 2026-04-01 14:50:44,359 - lava_callback - DEBUG - Processing node 69ca8dc10e33d030878aa196: baseline-arm-clabbe 2026-04-01 14:50:44,360 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8dc10e33d030878aa196 2026-04-01 14:50:44,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:50:44,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8dc10e33d030878aa196 HTTP/1.1" 200 None 2026-04-01 14:50:44,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:50:44,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 14:50:44,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:50:44,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8dc10e33d030878aa196 HTTP/1.1" 200 None 2026-04-01 14:50:44,431 - lava_callback - ERROR - Error processing callback for node 69ca8dc10e33d030878aa196: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53564 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:51:24,347 - lava_callback - INFO - Received callback for node 69ca8de70e33d030878aa1c0 INFO: 172.21.0.1:40766 - "POST /node/69ca8de70e33d030878aa1c0 HTTP/1.0" 202 Accepted 2026-04-01 14:51:24,353 - lava_callback - INFO - Starting async job submit for node 69ca8de70e33d030878aa1c0 2026-04-01 14:51:24,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:51:24,369 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8de70e33d030878aa1c0 HTTP/1.1" 200 None 2026-04-01 14:51:24,370 - lava_callback - DEBUG - Processing node 69ca8de70e33d030878aa1c0: baseline-arm-clabbe 2026-04-01 14:51:24,370 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8de70e33d030878aa1c0 2026-04-01 14:51:24,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:51:24,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8de70e33d030878aa1c0 HTTP/1.1" 200 None 2026-04-01 14:51:24,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:51:24,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 14:51:24,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:51:24,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8de70e33d030878aa1c0 HTTP/1.1" 200 None 2026-04-01 14:51:24,451 - lava_callback - ERROR - Error processing callback for node 69ca8de70e33d030878aa1c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33006 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:52:04,668 - lava_callback - INFO - Received callback for node 69ca8e0c0e33d030878aa1db INFO: 172.21.0.1:39976 - "POST /node/69ca8e0c0e33d030878aa1db HTTP/1.0" 202 Accepted 2026-04-01 14:52:04,673 - lava_callback - INFO - Starting async job submit for node 69ca8e0c0e33d030878aa1db 2026-04-01 14:52:04,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:52:04,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8e0c0e33d030878aa1db HTTP/1.1" 200 None 2026-04-01 14:52:04,689 - lava_callback - DEBUG - Processing node 69ca8e0c0e33d030878aa1db: baseline-arm-clabbe 2026-04-01 14:52:04,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8e0c0e33d030878aa1db 2026-04-01 14:52:04,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:52:04,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8e0c0e33d030878aa1db HTTP/1.1" 200 None 2026-04-01 14:52:04,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:52:04,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ef0e33d030878a87ef HTTP/1.1" 200 None 2026-04-01 14:52:04,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:52:04,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8e0c0e33d030878aa1db HTTP/1.1" 200 None 2026-04-01 14:52:04,741 - lava_callback - ERROR - Error processing callback for node 69ca8e0c0e33d030878aa1db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39216 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:52:44,381 - lava_callback - INFO - Received callback for node 69ca8e320e33d030878aa1e9 INFO: 172.21.0.1:45862 - "POST /node/69ca8e320e33d030878aa1e9 HTTP/1.0" 202 Accepted 2026-04-01 14:52:44,388 - lava_callback - INFO - Starting async job submit for node 69ca8e320e33d030878aa1e9 2026-04-01 14:52:44,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:52:44,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8e320e33d030878aa1e9 HTTP/1.1" 200 None 2026-04-01 14:52:44,404 - lava_callback - DEBUG - Processing node 69ca8e320e33d030878aa1e9: baseline-arm-clabbe 2026-04-01 14:52:44,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8e320e33d030878aa1e9 2026-04-01 14:52:44,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:52:44,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8e320e33d030878aa1e9 HTTP/1.1" 200 None 2026-04-01 14:52:44,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:52:44,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 14:52:44,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:52:44,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8e320e33d030878aa1e9 HTTP/1.1" 200 None 2026-04-01 14:52:44,472 - lava_callback - ERROR - Error processing callback for node 69ca8e320e33d030878aa1e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33868 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:53:24,442 - lava_callback - INFO - Received callback for node 69ca8e580e33d030878aa1f9 INFO: 172.21.0.1:48622 - "POST /node/69ca8e580e33d030878aa1f9 HTTP/1.0" 202 Accepted 2026-04-01 14:53:24,451 - lava_callback - INFO - Starting async job submit for node 69ca8e580e33d030878aa1f9 2026-04-01 14:53:24,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:53:24,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8e580e33d030878aa1f9 HTTP/1.1" 200 None 2026-04-01 14:53:24,468 - lava_callback - DEBUG - Processing node 69ca8e580e33d030878aa1f9: baseline-arm-clabbe 2026-04-01 14:53:24,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8e580e33d030878aa1f9 2026-04-01 14:53:24,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:53:24,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8e580e33d030878aa1f9 HTTP/1.1" 200 None 2026-04-01 14:53:24,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:53:24,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 14:53:24,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:53:24,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8e580e33d030878aa1f9 HTTP/1.1" 200 None 2026-04-01 14:53:24,537 - lava_callback - ERROR - Error processing callback for node 69ca8e580e33d030878aa1f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:54:04,442 - lava_callback - INFO - Received callback for node 69ca8e7b0e33d030878aa206 INFO: 172.21.0.1:50618 - "POST /node/69ca8e7b0e33d030878aa206 HTTP/1.0" 202 Accepted 2026-04-01 14:54:04,448 - lava_callback - INFO - Starting async job submit for node 69ca8e7b0e33d030878aa206 2026-04-01 14:54:04,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:54:04,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8e7b0e33d030878aa206 HTTP/1.1" 200 None 2026-04-01 14:54:04,473 - lava_callback - DEBUG - Processing node 69ca8e7b0e33d030878aa206: baseline-arm-clabbe 2026-04-01 14:54:04,473 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8e7b0e33d030878aa206 2026-04-01 14:54:04,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:54:04,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8e7b0e33d030878aa206 HTTP/1.1" 200 None 2026-04-01 14:54:04,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:54:04,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 14:54:04,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:54:04,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8e7b0e33d030878aa206 HTTP/1.1" 200 None 2026-04-01 14:54:04,530 - lava_callback - ERROR - Error processing callback for node 69ca8e7b0e33d030878aa206: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:54:44,522 - lava_callback - INFO - Received callback for node 69ca8ea00e33d030878aa219 INFO: 172.21.0.1:51874 - "POST /node/69ca8ea00e33d030878aa219 HTTP/1.0" 202 Accepted 2026-04-01 14:54:44,527 - lava_callback - INFO - Starting async job submit for node 69ca8ea00e33d030878aa219 2026-04-01 14:54:44,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:54:44,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8ea00e33d030878aa219 HTTP/1.1" 200 None 2026-04-01 14:54:44,543 - lava_callback - DEBUG - Processing node 69ca8ea00e33d030878aa219: baseline-arm-clabbe 2026-04-01 14:54:44,544 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8ea00e33d030878aa219 2026-04-01 14:54:44,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:54:44,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8ea00e33d030878aa219 HTTP/1.1" 200 None 2026-04-01 14:54:44,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:54:44,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eacbe430e18c5d159df HTTP/1.1" 200 None 2026-04-01 14:54:44,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:54:44,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8ea00e33d030878aa219 HTTP/1.1" 200 None 2026-04-01 14:54:44,595 - lava_callback - ERROR - Error processing callback for node 69ca8ea00e33d030878aa219: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:55:04,552 - lava_callback - INFO - Received callback for node 69ca8ec50e33d030878aa225 INFO: 172.21.0.1:46702 - "POST /node/69ca8ec50e33d030878aa225 HTTP/1.0" 202 Accepted 2026-04-01 14:55:04,558 - lava_callback - INFO - Starting async job submit for node 69ca8ec50e33d030878aa225 2026-04-01 14:55:04,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:55:04,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8ec50e33d030878aa225 HTTP/1.1" 200 None 2026-04-01 14:55:04,575 - lava_callback - DEBUG - Processing node 69ca8ec50e33d030878aa225: baseline-arm-clabbe 2026-04-01 14:55:04,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8ec50e33d030878aa225 2026-04-01 14:55:04,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:55:04,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8ec50e33d030878aa225 HTTP/1.1" 200 None 2026-04-01 14:55:04,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:55:04,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 14:55:04,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:55:04,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8ec50e33d030878aa225 HTTP/1.1" 200 None 2026-04-01 14:55:04,631 - lava_callback - ERROR - Error processing callback for node 69ca8ec50e33d030878aa225: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53340 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:55:44,597 - lava_callback - INFO - Received callback for node 69ca8ee90e33d030878aa233 INFO: 172.21.0.1:38282 - "POST /node/69ca8ee90e33d030878aa233 HTTP/1.0" 202 Accepted 2026-04-01 14:55:44,602 - lava_callback - INFO - Starting async job submit for node 69ca8ee90e33d030878aa233 2026-04-01 14:55:44,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:55:44,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8ee90e33d030878aa233 HTTP/1.1" 200 None 2026-04-01 14:55:44,618 - lava_callback - DEBUG - Processing node 69ca8ee90e33d030878aa233: baseline-arm-clabbe 2026-04-01 14:55:44,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8ee90e33d030878aa233 2026-04-01 14:55:44,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:55:44,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8ee90e33d030878aa233 HTTP/1.1" 200 None 2026-04-01 14:55:44,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:55:44,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 14:55:44,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:55:44,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8ee90e33d030878aa233 HTTP/1.1" 200 None 2026-04-01 14:55:44,677 - lava_callback - ERROR - Error processing callback for node 69ca8ee90e33d030878aa233: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:56:24,595 - lava_callback - INFO - Received callback for node 69ca8f0d0e33d030878aa23f INFO: 172.21.0.1:33918 - "POST /node/69ca8f0d0e33d030878aa23f HTTP/1.0" 202 Accepted 2026-04-01 14:56:24,601 - lava_callback - INFO - Starting async job submit for node 69ca8f0d0e33d030878aa23f 2026-04-01 14:56:24,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:56:24,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8f0d0e33d030878aa23f HTTP/1.1" 200 None 2026-04-01 14:56:24,616 - lava_callback - DEBUG - Processing node 69ca8f0d0e33d030878aa23f: baseline-arm-clabbe 2026-04-01 14:56:24,617 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8f0d0e33d030878aa23f 2026-04-01 14:56:24,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:56:24,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8f0d0e33d030878aa23f HTTP/1.1" 200 None 2026-04-01 14:56:24,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:56:24,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 14:56:24,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:56:24,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8f0d0e33d030878aa23f HTTP/1.1" 200 None 2026-04-01 14:56:24,681 - lava_callback - ERROR - Error processing callback for node 69ca8f0d0e33d030878aa23f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:57:04,746 - lava_callback - INFO - Received callback for node 69ca8f330e33d030878aa24b INFO: 172.21.0.1:41150 - "POST /node/69ca8f330e33d030878aa24b HTTP/1.0" 202 Accepted 2026-04-01 14:57:04,751 - lava_callback - INFO - Starting async job submit for node 69ca8f330e33d030878aa24b 2026-04-01 14:57:04,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:57:04,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8f330e33d030878aa24b HTTP/1.1" 200 None 2026-04-01 14:57:04,777 - lava_callback - DEBUG - Processing node 69ca8f330e33d030878aa24b: baseline-arm-clabbe 2026-04-01 14:57:04,778 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8f330e33d030878aa24b 2026-04-01 14:57:04,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:57:04,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8f330e33d030878aa24b HTTP/1.1" 200 None 2026-04-01 14:57:04,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:57:04,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 14:57:04,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:57:04,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8f330e33d030878aa24b HTTP/1.1" 200 None 2026-04-01 14:57:04,833 - lava_callback - ERROR - Error processing callback for node 69ca8f330e33d030878aa24b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52772 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:57:44,654 - lava_callback - INFO - Received callback for node 69ca8f580e33d030878aa258 INFO: 172.21.0.1:34168 - "POST /node/69ca8f580e33d030878aa258 HTTP/1.0" 202 Accepted 2026-04-01 14:57:44,660 - lava_callback - INFO - Starting async job submit for node 69ca8f580e33d030878aa258 2026-04-01 14:57:44,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:57:44,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8f580e33d030878aa258 HTTP/1.1" 200 None 2026-04-01 14:57:44,676 - lava_callback - DEBUG - Processing node 69ca8f580e33d030878aa258: baseline-arm-clabbe 2026-04-01 14:57:44,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8f580e33d030878aa258 2026-04-01 14:57:44,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:57:44,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8f580e33d030878aa258 HTTP/1.1" 200 None 2026-04-01 14:57:44,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:57:44,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 14:57:44,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:57:44,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8f580e33d030878aa258 HTTP/1.1" 200 None 2026-04-01 14:57:44,736 - lava_callback - ERROR - Error processing callback for node 69ca8f580e33d030878aa258: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59130 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:58:24,897 - lava_callback - INFO - Received callback for node 69ca8f7d0e33d030878aa260 INFO: 172.21.0.1:57694 - "POST /node/69ca8f7d0e33d030878aa260 HTTP/1.0" 202 Accepted 2026-04-01 14:58:24,903 - lava_callback - INFO - Starting async job submit for node 69ca8f7d0e33d030878aa260 2026-04-01 14:58:24,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:58:24,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8f7d0e33d030878aa260 HTTP/1.1" 200 None 2026-04-01 14:58:24,918 - lava_callback - DEBUG - Processing node 69ca8f7d0e33d030878aa260: baseline-arm-clabbe 2026-04-01 14:58:24,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8f7d0e33d030878aa260 2026-04-01 14:58:24,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:58:24,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8f7d0e33d030878aa260 HTTP/1.1" 200 None 2026-04-01 14:58:24,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:58:24,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 14:58:24,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:58:24,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8f7d0e33d030878aa260 HTTP/1.1" 200 None 2026-04-01 14:58:24,993 - lava_callback - ERROR - Error processing callback for node 69ca8f7d0e33d030878aa260: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK 2026-04-01 14:58:44,687 - lava_callback - INFO - Received callback for node 69ca8fa10e33d030878aa26b INFO: 172.21.0.1:49308 - "POST /node/69ca8fa10e33d030878aa26b HTTP/1.0" 202 Accepted 2026-04-01 14:58:44,692 - lava_callback - INFO - Starting async job submit for node 69ca8fa10e33d030878aa26b 2026-04-01 14:58:44,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:58:44,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8fa10e33d030878aa26b HTTP/1.1" 200 None 2026-04-01 14:58:44,713 - lava_callback - DEBUG - Processing node 69ca8fa10e33d030878aa26b: baseline-arm-clabbe 2026-04-01 14:58:44,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca8fa10e33d030878aa26b 2026-04-01 14:58:44,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:58:44,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca8fa10e33d030878aa26b HTTP/1.1" 200 None 2026-04-01 14:58:44,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:58:44,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 14:58:44,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 14:58:44,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca8fa10e33d030878aa26b HTTP/1.1" 200 None 2026-04-01 14:58:44,773 - lava_callback - ERROR - Error processing callback for node 69ca8fa10e33d030878aa26b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:05:05,748 - lava_callback - INFO - Received callback for node 69ca91130e33d030878aa2ad INFO: 172.21.0.1:48880 - "POST /node/69ca91130e33d030878aa2ad HTTP/1.0" 202 Accepted 2026-04-01 15:05:05,753 - lava_callback - INFO - Starting async job submit for node 69ca91130e33d030878aa2ad 2026-04-01 15:05:05,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:05:05,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca91130e33d030878aa2ad HTTP/1.1" 200 None 2026-04-01 15:05:05,779 - lava_callback - DEBUG - Processing node 69ca91130e33d030878aa2ad: baseline-arm64-baylibre 2026-04-01 15:05:05,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca91130e33d030878aa2ad 2026-04-01 15:05:05,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:05:05,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca91130e33d030878aa2ad HTTP/1.1" 200 None 2026-04-01 15:05:05,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:05:05,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 15:05:05,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:05:05,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca91130e33d030878aa2ad HTTP/1.1" 200 None 2026-04-01 15:05:05,833 - lava_callback - ERROR - Error processing callback for node 69ca91130e33d030878aa2ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51444 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51460 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:06:25,506 - lava_callback - INFO - Received callback for node 69ca91660e33d030878aa2bb INFO: 172.21.0.1:43138 - "POST /node/69ca91660e33d030878aa2bb HTTP/1.0" 202 Accepted 2026-04-01 15:06:25,511 - lava_callback - INFO - Starting async job submit for node 69ca91660e33d030878aa2bb 2026-04-01 15:06:25,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:06:25,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca91660e33d030878aa2bb HTTP/1.1" 200 None 2026-04-01 15:06:25,527 - lava_callback - DEBUG - Processing node 69ca91660e33d030878aa2bb: baseline-arm64-baylibre 2026-04-01 15:06:25,528 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca91660e33d030878aa2bb 2026-04-01 15:06:25,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:06:25,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca91660e33d030878aa2bb HTTP/1.1" 200 None 2026-04-01 15:06:25,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:06:25,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 15:06:25,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:06:25,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca91660e33d030878aa2bb HTTP/1.1" 200 None 2026-04-01 15:06:25,579 - lava_callback - ERROR - Error processing callback for node 69ca91660e33d030878aa2bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48766 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:07:45,826 - lava_callback - INFO - Received callback for node 69ca91b80e33d030878aa2c9 INFO: 172.21.0.1:49010 - "POST /node/69ca91b80e33d030878aa2c9 HTTP/1.0" 202 Accepted 2026-04-01 15:07:45,831 - lava_callback - INFO - Starting async job submit for node 69ca91b80e33d030878aa2c9 2026-04-01 15:07:45,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:07:45,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca91b80e33d030878aa2c9 HTTP/1.1" 200 None 2026-04-01 15:07:45,852 - lava_callback - DEBUG - Processing node 69ca91b80e33d030878aa2c9: baseline-arm64-baylibre 2026-04-01 15:07:45,852 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca91b80e33d030878aa2c9 2026-04-01 15:07:45,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:07:45,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca91b80e33d030878aa2c9 HTTP/1.1" 200 None 2026-04-01 15:07:45,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:07:45,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 15:07:45,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:07:45,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca91b80e33d030878aa2c9 HTTP/1.1" 200 None 2026-04-01 15:07:45,908 - lava_callback - ERROR - Error processing callback for node 69ca91b80e33d030878aa2c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52984 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:09:05,660 - lava_callback - INFO - Received callback for node 69ca92090e33d030878aa2d8 INFO: 172.21.0.1:45286 - "POST /node/69ca92090e33d030878aa2d8 HTTP/1.0" 202 Accepted 2026-04-01 15:09:05,665 - lava_callback - INFO - Starting async job submit for node 69ca92090e33d030878aa2d8 2026-04-01 15:09:05,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:09:05,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca92090e33d030878aa2d8 HTTP/1.1" 200 None 2026-04-01 15:09:05,684 - lava_callback - DEBUG - Processing node 69ca92090e33d030878aa2d8: baseline-arm64-baylibre 2026-04-01 15:09:05,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca92090e33d030878aa2d8 2026-04-01 15:09:05,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:09:05,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca92090e33d030878aa2d8 HTTP/1.1" 200 None 2026-04-01 15:09:05,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:09:05,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 15:09:05,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:09:05,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca92090e33d030878aa2d8 HTTP/1.1" 200 None 2026-04-01 15:09:05,779 - lava_callback - ERROR - Error processing callback for node 69ca92090e33d030878aa2d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40960 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:10:25,772 - lava_callback - INFO - Received callback for node 69ca925d0e33d030878aa2e4 INFO: 172.21.0.1:52790 - "POST /node/69ca925d0e33d030878aa2e4 HTTP/1.0" 202 Accepted 2026-04-01 15:10:25,777 - lava_callback - INFO - Starting async job submit for node 69ca925d0e33d030878aa2e4 2026-04-01 15:10:25,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:10:25,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca925d0e33d030878aa2e4 HTTP/1.1" 200 None 2026-04-01 15:10:25,793 - lava_callback - DEBUG - Processing node 69ca925d0e33d030878aa2e4: baseline-arm64-baylibre 2026-04-01 15:10:25,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca925d0e33d030878aa2e4 2026-04-01 15:10:25,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:10:25,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca925d0e33d030878aa2e4 HTTP/1.1" 200 None 2026-04-01 15:10:25,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:10:25,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 15:10:25,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:10:25,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca925d0e33d030878aa2e4 HTTP/1.1" 200 None 2026-04-01 15:10:25,853 - lava_callback - ERROR - Error processing callback for node 69ca925d0e33d030878aa2e4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:11:45,310 - lava_callback - INFO - Received callback for node 69ca92a50e33d030878aa2f1 INFO: 172.21.0.1:38000 - "POST /node/69ca92a50e33d030878aa2f1 HTTP/1.0" 202 Accepted 2026-04-01 15:11:45,316 - lava_callback - INFO - Starting async job submit for node 69ca92a50e33d030878aa2f1 2026-04-01 15:11:45,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:11:45,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca92a50e33d030878aa2f1 HTTP/1.1" 200 None 2026-04-01 15:11:45,332 - lava_callback - DEBUG - Processing node 69ca92a50e33d030878aa2f1: baseline-arm-clabbe 2026-04-01 15:11:45,332 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca92a50e33d030878aa2f1 2026-04-01 15:11:45,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:11:45,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca92a50e33d030878aa2f1 HTTP/1.1" 200 None 2026-04-01 15:11:45,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:11:45,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 15:11:45,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:11:45,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca92a50e33d030878aa2f1 HTTP/1.1" 200 None 2026-04-01 15:11:45,386 - lava_callback - ERROR - Error processing callback for node 69ca92a50e33d030878aa2f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43598 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:12:25,276 - lava_callback - INFO - Received callback for node 69ca92cb0e33d030878aa2fc INFO: 172.21.0.1:60390 - "POST /node/69ca92cb0e33d030878aa2fc HTTP/1.0" 202 Accepted 2026-04-01 15:12:25,281 - lava_callback - INFO - Starting async job submit for node 69ca92cb0e33d030878aa2fc 2026-04-01 15:12:25,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:12:25,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca92cb0e33d030878aa2fc HTTP/1.1" 200 None 2026-04-01 15:12:25,298 - lava_callback - DEBUG - Processing node 69ca92cb0e33d030878aa2fc: baseline-arm-clabbe 2026-04-01 15:12:25,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca92cb0e33d030878aa2fc 2026-04-01 15:12:25,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:12:25,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca92cb0e33d030878aa2fc HTTP/1.1" 200 None 2026-04-01 15:12:25,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:12:25,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 15:12:25,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:12:25,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca92cb0e33d030878aa2fc HTTP/1.1" 200 None 2026-04-01 15:12:25,351 - lava_callback - ERROR - Error processing callback for node 69ca92cb0e33d030878aa2fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51428 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:13:25,412 - lava_callback - INFO - Received callback for node 69ca92ff0e33d030878aa30d INFO: 172.21.0.1:52470 - "POST /node/69ca92ff0e33d030878aa30d HTTP/1.0" 202 Accepted 2026-04-01 15:13:25,421 - lava_callback - INFO - Starting async job submit for node 69ca92ff0e33d030878aa30d 2026-04-01 15:13:25,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:13:25,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca92ff0e33d030878aa30d HTTP/1.1" 200 None 2026-04-01 15:13:25,444 - lava_callback - DEBUG - Processing node 69ca92ff0e33d030878aa30d: baseline-arm64-clabbe 2026-04-01 15:13:25,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca92ff0e33d030878aa30d 2026-04-01 15:13:25,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:13:25,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca92ff0e33d030878aa30d HTTP/1.1" 200 None 2026-04-01 15:13:25,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:13:25,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 15:13:25,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:13:25,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca92ff0e33d030878aa30d HTTP/1.1" 200 None 2026-04-01 15:13:25,528 - lava_callback - ERROR - Error processing callback for node 69ca92ff0e33d030878aa30d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36374 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:14:45,436 - lava_callback - INFO - Received callback for node 69ca93520e33d030878aa324 INFO: 172.21.0.1:44020 - "POST /node/69ca93520e33d030878aa324 HTTP/1.0" 202 Accepted 2026-04-01 15:14:45,445 - lava_callback - INFO - Starting async job submit for node 69ca93520e33d030878aa324 2026-04-01 15:14:45,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:14:45,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca93520e33d030878aa324 HTTP/1.1" 200 None 2026-04-01 15:14:45,461 - lava_callback - DEBUG - Processing node 69ca93520e33d030878aa324: baseline-arm64-clabbe 2026-04-01 15:14:45,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca93520e33d030878aa324 2026-04-01 15:14:45,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:14:45,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca93520e33d030878aa324 HTTP/1.1" 200 None 2026-04-01 15:14:45,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:14:45,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 15:14:45,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:14:45,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca93520e33d030878aa324 HTTP/1.1" 200 None 2026-04-01 15:14:45,520 - lava_callback - ERROR - Error processing callback for node 69ca93520e33d030878aa324: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36934 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:16:05,483 - lava_callback - INFO - Received callback for node 69ca93a30e33d030878aa32e INFO: 172.21.0.1:33992 - "POST /node/69ca93a30e33d030878aa32e HTTP/1.0" 202 Accepted 2026-04-01 15:16:05,489 - lava_callback - INFO - Starting async job submit for node 69ca93a30e33d030878aa32e 2026-04-01 15:16:05,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:16:05,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca93a30e33d030878aa32e HTTP/1.1" 200 None 2026-04-01 15:16:05,508 - lava_callback - DEBUG - Processing node 69ca93a30e33d030878aa32e: baseline-arm64-clabbe 2026-04-01 15:16:05,508 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca93a30e33d030878aa32e 2026-04-01 15:16:05,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:16:05,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca93a30e33d030878aa32e HTTP/1.1" 200 None 2026-04-01 15:16:05,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:16:05,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 15:16:05,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:16:05,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca93a30e33d030878aa32e HTTP/1.1" 200 None 2026-04-01 15:16:05,560 - lava_callback - ERROR - Error processing callback for node 69ca93a30e33d030878aa32e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48700 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:17:25,543 - lava_callback - INFO - Received callback for node 69ca93f50e33d030878aa341 INFO: 172.21.0.1:43356 - "POST /node/69ca93f50e33d030878aa341 HTTP/1.0" 202 Accepted 2026-04-01 15:17:25,549 - lava_callback - INFO - Starting async job submit for node 69ca93f50e33d030878aa341 2026-04-01 15:17:25,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:17:25,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca93f50e33d030878aa341 HTTP/1.1" 200 None 2026-04-01 15:17:25,565 - lava_callback - DEBUG - Processing node 69ca93f50e33d030878aa341: baseline-arm64-clabbe 2026-04-01 15:17:25,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca93f50e33d030878aa341 2026-04-01 15:17:25,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:17:25,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca93f50e33d030878aa341 HTTP/1.1" 200 None 2026-04-01 15:17:25,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:17:25,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 15:17:25,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:17:25,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca93f50e33d030878aa341 HTTP/1.1" 200 None 2026-04-01 15:17:25,620 - lava_callback - ERROR - Error processing callback for node 69ca93f50e33d030878aa341: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46564 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:18:45,543 - lava_callback - INFO - Received callback for node 69ca94460e33d030878aa355 INFO: 172.21.0.1:41310 - "POST /node/69ca94460e33d030878aa355 HTTP/1.0" 202 Accepted 2026-04-01 15:18:45,549 - lava_callback - INFO - Starting async job submit for node 69ca94460e33d030878aa355 2026-04-01 15:18:45,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:18:45,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca94460e33d030878aa355 HTTP/1.1" 200 None 2026-04-01 15:18:45,573 - lava_callback - DEBUG - Processing node 69ca94460e33d030878aa355: baseline-arm64-clabbe 2026-04-01 15:18:45,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca94460e33d030878aa355 2026-04-01 15:18:45,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:18:45,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca94460e33d030878aa355 HTTP/1.1" 200 None 2026-04-01 15:18:45,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:18:45,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 15:18:45,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:18:45,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca94460e33d030878aa355 HTTP/1.1" 200 None 2026-04-01 15:18:45,631 - lava_callback - ERROR - Error processing callback for node 69ca94460e33d030878aa355: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40104 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:20:05,655 - lava_callback - INFO - Received callback for node 69ca94990e33d030878aa367 INFO: 172.21.0.1:52690 - "POST /node/69ca94990e33d030878aa367 HTTP/1.0" 202 Accepted 2026-04-01 15:20:05,663 - lava_callback - INFO - Starting async job submit for node 69ca94990e33d030878aa367 2026-04-01 15:20:05,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:20:05,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca94990e33d030878aa367 HTTP/1.1" 200 None 2026-04-01 15:20:05,681 - lava_callback - DEBUG - Processing node 69ca94990e33d030878aa367: baseline-arm64-clabbe 2026-04-01 15:20:05,682 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca94990e33d030878aa367 2026-04-01 15:20:05,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:20:05,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca94990e33d030878aa367 HTTP/1.1" 200 None 2026-04-01 15:20:05,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:20:05,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca31ff0e33d030878a87ff HTTP/1.1" 200 None 2026-04-01 15:20:05,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:20:05,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca94990e33d030878aa367 HTTP/1.1" 200 None 2026-04-01 15:20:05,733 - lava_callback - ERROR - Error processing callback for node 69ca94990e33d030878aa367: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:22:26,461 - lava_callback - INFO - Received callback for node 69ca95270e33d030878aa385 INFO: 172.21.0.1:44156 - "POST /node/69ca95270e33d030878aa385 HTTP/1.0" 202 Accepted 2026-04-01 15:22:26,467 - lava_callback - INFO - Starting async job submit for node 69ca95270e33d030878aa385 2026-04-01 15:22:26,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:22:26,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca95270e33d030878aa385 HTTP/1.1" 200 None 2026-04-01 15:22:26,483 - lava_callback - DEBUG - Processing node 69ca95270e33d030878aa385: baseline-arm-baylibre 2026-04-01 15:22:26,483 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca95270e33d030878aa385 2026-04-01 15:22:26,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:22:26,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca95270e33d030878aa385 HTTP/1.1" 200 None 2026-04-01 15:22:26,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:22:26,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None INFO: 172.21.0.1:44168 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:22:26,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:22:26,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca95270e33d030878aa385 HTTP/1.1" 200 None 2026-04-01 15:22:26,542 - lava_callback - ERROR - Error processing callback for node 69ca95270e33d030878aa385: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53210 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:23:05,701 - lava_callback - INFO - Received callback for node 69ca95510e33d030878aa396 INFO: 172.21.0.1:36836 - "POST /node/69ca95510e33d030878aa396 HTTP/1.0" 202 Accepted 2026-04-01 15:23:05,706 - lava_callback - INFO - Starting async job submit for node 69ca95510e33d030878aa396 2026-04-01 15:23:05,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:23:05,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca95510e33d030878aa396 HTTP/1.1" 200 None 2026-04-01 15:23:05,722 - lava_callback - DEBUG - Processing node 69ca95510e33d030878aa396: baseline-arm-clabbe 2026-04-01 15:23:05,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca95510e33d030878aa396 2026-04-01 15:23:05,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:23:05,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca95510e33d030878aa396 HTTP/1.1" 200 None 2026-04-01 15:23:05,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:23:05,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 15:23:05,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:23:05,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca95510e33d030878aa396 HTTP/1.1" 200 None 2026-04-01 15:23:05,784 - lava_callback - ERROR - Error processing callback for node 69ca95510e33d030878aa396: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:23:45,689 - lava_callback - INFO - Received callback for node 69ca95760e33d030878aa3a0 INFO: 172.21.0.1:41816 - "POST /node/69ca95760e33d030878aa3a0 HTTP/1.0" 202 Accepted 2026-04-01 15:23:45,695 - lava_callback - INFO - Starting async job submit for node 69ca95760e33d030878aa3a0 2026-04-01 15:23:45,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:23:45,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca95760e33d030878aa3a0 HTTP/1.1" 200 None 2026-04-01 15:23:45,727 - lava_callback - DEBUG - Processing node 69ca95760e33d030878aa3a0: baseline-arm-clabbe 2026-04-01 15:23:45,728 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca95760e33d030878aa3a0 2026-04-01 15:23:45,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:23:45,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca95760e33d030878aa3a0 HTTP/1.1" 200 None 2026-04-01 15:23:45,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:23:45,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 15:23:45,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:23:45,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca95760e33d030878aa3a0 HTTP/1.1" 200 None 2026-04-01 15:23:45,789 - lava_callback - ERROR - Error processing callback for node 69ca95760e33d030878aa3a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:24:25,731 - lava_callback - INFO - Received callback for node 69ca959f0e33d030878aa3ac INFO: 172.21.0.1:54194 - "POST /node/69ca959f0e33d030878aa3ac HTTP/1.0" 202 Accepted 2026-04-01 15:24:25,736 - lava_callback - INFO - Starting async job submit for node 69ca959f0e33d030878aa3ac 2026-04-01 15:24:25,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:24:25,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca959f0e33d030878aa3ac HTTP/1.1" 200 None 2026-04-01 15:24:25,755 - lava_callback - DEBUG - Processing node 69ca959f0e33d030878aa3ac: baseline-arm-clabbe 2026-04-01 15:24:25,755 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca959f0e33d030878aa3ac 2026-04-01 15:24:25,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:24:25,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca959f0e33d030878aa3ac HTTP/1.1" 200 None 2026-04-01 15:24:25,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:24:25,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 15:24:25,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:24:25,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca959f0e33d030878aa3ac HTTP/1.1" 200 None 2026-04-01 15:24:25,808 - lava_callback - ERROR - Error processing callback for node 69ca959f0e33d030878aa3ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:25:05,764 - lava_callback - INFO - Received callback for node 69ca95c40e33d030878aa3ba INFO: 172.21.0.1:43918 - "POST /node/69ca95c40e33d030878aa3ba HTTP/1.0" 202 Accepted 2026-04-01 15:25:05,769 - lava_callback - INFO - Starting async job submit for node 69ca95c40e33d030878aa3ba 2026-04-01 15:25:05,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:25:05,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca95c40e33d030878aa3ba HTTP/1.1" 200 None 2026-04-01 15:25:05,784 - lava_callback - DEBUG - Processing node 69ca95c40e33d030878aa3ba: baseline-arm-clabbe 2026-04-01 15:25:05,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca95c40e33d030878aa3ba 2026-04-01 15:25:05,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:25:05,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca95c40e33d030878aa3ba HTTP/1.1" 200 None 2026-04-01 15:25:05,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:25:05,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 15:25:05,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:25:05,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca95c40e33d030878aa3ba HTTP/1.1" 200 None 2026-04-01 15:25:05,842 - lava_callback - ERROR - Error processing callback for node 69ca95c40e33d030878aa3ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:25:45,805 - lava_callback - INFO - Received callback for node 69ca95ea0e33d030878aa3c8 INFO: 172.21.0.1:52768 - "POST /node/69ca95ea0e33d030878aa3c8 HTTP/1.0" 202 Accepted 2026-04-01 15:25:45,811 - lava_callback - INFO - Starting async job submit for node 69ca95ea0e33d030878aa3c8 2026-04-01 15:25:45,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:25:45,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca95ea0e33d030878aa3c8 HTTP/1.1" 200 None 2026-04-01 15:25:45,830 - lava_callback - DEBUG - Processing node 69ca95ea0e33d030878aa3c8: baseline-arm-clabbe 2026-04-01 15:25:45,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca95ea0e33d030878aa3c8 2026-04-01 15:25:45,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:25:45,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca95ea0e33d030878aa3c8 HTTP/1.1" 200 None 2026-04-01 15:25:45,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:25:45,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 15:25:45,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:25:45,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca95ea0e33d030878aa3c8 HTTP/1.1" 200 None 2026-04-01 15:25:45,885 - lava_callback - ERROR - Error processing callback for node 69ca95ea0e33d030878aa3c8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34870 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:26:25,777 - lava_callback - INFO - Received callback for node 69ca960f0e33d030878aa3d6 INFO: 172.21.0.1:49174 - "POST /node/69ca960f0e33d030878aa3d6 HTTP/1.0" 202 Accepted 2026-04-01 15:26:25,783 - lava_callback - INFO - Starting async job submit for node 69ca960f0e33d030878aa3d6 2026-04-01 15:26:25,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:26:25,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca960f0e33d030878aa3d6 HTTP/1.1" 200 None 2026-04-01 15:26:25,799 - lava_callback - DEBUG - Processing node 69ca960f0e33d030878aa3d6: baseline-arm-clabbe 2026-04-01 15:26:25,799 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca960f0e33d030878aa3d6 2026-04-01 15:26:25,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:26:25,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca960f0e33d030878aa3d6 HTTP/1.1" 200 None 2026-04-01 15:26:25,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:26:25,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebcbf63ce05331e2a47f HTTP/1.1" 200 None 2026-04-01 15:26:25,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:26:25,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca960f0e33d030878aa3d6 HTTP/1.1" 200 None 2026-04-01 15:26:25,848 - lava_callback - ERROR - Error processing callback for node 69ca960f0e33d030878aa3d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55860 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33184 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:29:46,782 - lava_callback - INFO - Received callback for node 69ca96d90e33d030878aa3ff INFO: 172.21.0.1:33190 - "POST /node/69ca96d90e33d030878aa3ff HTTP/1.0" 202 Accepted 2026-04-01 15:29:46,788 - lava_callback - INFO - Starting async job submit for node 69ca96d90e33d030878aa3ff 2026-04-01 15:29:46,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:29:46,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca96d90e33d030878aa3ff HTTP/1.1" 200 None 2026-04-01 15:29:46,804 - lava_callback - DEBUG - Processing node 69ca96d90e33d030878aa3ff: baseline-arm64-baylibre 2026-04-01 15:29:46,804 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca96d90e33d030878aa3ff 2026-04-01 15:29:46,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:29:46,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca96d90e33d030878aa3ff HTTP/1.1" 200 None 2026-04-01 15:29:46,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:29:46,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:29:46,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:29:46,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca96d90e33d030878aa3ff HTTP/1.1" 200 None 2026-04-01 15:29:46,870 - lava_callback - ERROR - Error processing callback for node 69ca96d90e33d030878aa3ff: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33124 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:33:46,939 - lava_callback - INFO - Received callback for node 69ca97ce0e33d030878aa424 INFO: 172.21.0.1:33128 - "POST /node/69ca97ce0e33d030878aa424 HTTP/1.0" 202 Accepted 2026-04-01 15:33:46,946 - lava_callback - INFO - Starting async job submit for node 69ca97ce0e33d030878aa424 2026-04-01 15:33:46,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:33:46,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca97ce0e33d030878aa424 HTTP/1.1" 200 None 2026-04-01 15:33:46,971 - lava_callback - DEBUG - Processing node 69ca97ce0e33d030878aa424: baseline-arm64-baylibre 2026-04-01 15:33:46,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca97ce0e33d030878aa424 2026-04-01 15:33:46,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:33:46,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca97ce0e33d030878aa424 HTTP/1.1" 200 None 2026-04-01 15:33:46,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:33:47,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:33:47,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:33:47,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca97ce0e33d030878aa424 HTTP/1.1" 200 None 2026-04-01 15:33:47,027 - lava_callback - ERROR - Error processing callback for node 69ca97ce0e33d030878aa424: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:35:06,221 - lava_callback - INFO - Received callback for node 69ca98260e33d030878aa433 INFO: 172.21.0.1:56848 - "POST /node/69ca98260e33d030878aa433 HTTP/1.0" 202 Accepted 2026-04-01 15:35:06,226 - lava_callback - INFO - Starting async job submit for node 69ca98260e33d030878aa433 2026-04-01 15:35:06,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:35:06,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca98260e33d030878aa433 HTTP/1.1" 200 None 2026-04-01 15:35:06,242 - lava_callback - DEBUG - Processing node 69ca98260e33d030878aa433: baseline-arm64-clabbe 2026-04-01 15:35:06,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca98260e33d030878aa433 2026-04-01 15:35:06,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:35:06,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca98260e33d030878aa433 HTTP/1.1" 200 None 2026-04-01 15:35:06,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:35:06,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:35:06,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:35:06,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca98260e33d030878aa433 HTTP/1.1" 200 None 2026-04-01 15:35:06,301 - lava_callback - ERROR - Error processing callback for node 69ca98260e33d030878aa433: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43668 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:36:27,558 - lava_callback - INFO - Received callback for node 69ca98700e33d030878aa43b INFO: 172.21.0.1:43670 - "POST /node/69ca98700e33d030878aa43b HTTP/1.0" 202 Accepted 2026-04-01 15:36:27,563 - lava_callback - INFO - Starting async job submit for node 69ca98700e33d030878aa43b 2026-04-01 15:36:27,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:36:27,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca98700e33d030878aa43b HTTP/1.1" 200 None 2026-04-01 15:36:27,580 - lava_callback - DEBUG - Processing node 69ca98700e33d030878aa43b: baseline-arm64-baylibre 2026-04-01 15:36:27,581 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca98700e33d030878aa43b 2026-04-01 15:36:27,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:36:27,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca98700e33d030878aa43b HTTP/1.1" 200 None 2026-04-01 15:36:27,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:36:27,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:36:27,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:36:27,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca98700e33d030878aa43b HTTP/1.1" 200 None 2026-04-01 15:36:27,638 - lava_callback - ERROR - Error processing callback for node 69ca98700e33d030878aa43b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60458 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:38:06,326 - lava_callback - INFO - Received callback for node 69ca98c90e33d030878aa44a INFO: 172.21.0.1:35602 - "POST /node/69ca98c90e33d030878aa44a HTTP/1.0" 202 Accepted 2026-04-01 15:38:06,332 - lava_callback - INFO - Starting async job submit for node 69ca98c90e33d030878aa44a 2026-04-01 15:38:06,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:38:06,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca98c90e33d030878aa44a HTTP/1.1" 200 None 2026-04-01 15:38:06,348 - lava_callback - DEBUG - Processing node 69ca98c90e33d030878aa44a: baseline-arm64-clabbe 2026-04-01 15:38:06,349 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca98c90e33d030878aa44a 2026-04-01 15:38:06,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:38:06,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca98c90e33d030878aa44a HTTP/1.1" 200 None 2026-04-01 15:38:06,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:38:06,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:38:06,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:38:06,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca98c90e33d030878aa44a HTTP/1.1" 200 None 2026-04-01 15:38:06,418 - lava_callback - ERROR - Error processing callback for node 69ca98c90e33d030878aa44a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39516 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:39:07,206 - lava_callback - INFO - Received callback for node 69ca99110e33d030878aa45a INFO: 172.21.0.1:39534 - "POST /node/69ca99110e33d030878aa45a HTTP/1.0" 202 Accepted 2026-04-01 15:39:07,212 - lava_callback - INFO - Starting async job submit for node 69ca99110e33d030878aa45a 2026-04-01 15:39:07,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:39:07,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca99110e33d030878aa45a HTTP/1.1" 200 None 2026-04-01 15:39:07,230 - lava_callback - DEBUG - Processing node 69ca99110e33d030878aa45a: baseline-arm64-baylibre 2026-04-01 15:39:07,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca99110e33d030878aa45a 2026-04-01 15:39:07,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:39:07,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca99110e33d030878aa45a HTTP/1.1" 200 None 2026-04-01 15:39:07,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:39:07,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:39:07,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:39:07,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca99110e33d030878aa45a HTTP/1.1" 200 None 2026-04-01 15:39:07,291 - lava_callback - ERROR - Error processing callback for node 69ca99110e33d030878aa45a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47930 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:40:47,284 - lava_callback - INFO - Received callback for node 69ca99780e33d030878aa463 INFO: 172.21.0.1:47932 - "POST /node/69ca99780e33d030878aa463 HTTP/1.0" 202 Accepted 2026-04-01 15:40:47,289 - lava_callback - INFO - Starting async job submit for node 69ca99780e33d030878aa463 2026-04-01 15:40:47,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:40:47,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca99780e33d030878aa463 HTTP/1.1" 200 None 2026-04-01 15:40:47,305 - lava_callback - DEBUG - Processing node 69ca99780e33d030878aa463: baseline-arm64-baylibre 2026-04-01 15:40:47,305 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca99780e33d030878aa463 2026-04-01 15:40:47,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:40:47,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca99780e33d030878aa463 HTTP/1.1" 200 None 2026-04-01 15:40:47,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:40:47,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:40:47,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:40:47,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca99780e33d030878aa463 HTTP/1.1" 200 None 2026-04-01 15:40:47,368 - lava_callback - ERROR - Error processing callback for node 69ca99780e33d030878aa463: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48918 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:48920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53754 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:42:26,512 - lava_callback - INFO - Received callback for node 69ca99d10e33d030878aa472 INFO: 172.21.0.1:53756 - "POST /node/69ca99d10e33d030878aa472 HTTP/1.0" 202 Accepted 2026-04-01 15:42:26,519 - lava_callback - INFO - Starting async job submit for node 69ca99d10e33d030878aa472 2026-04-01 15:42:26,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:42:26,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca99d10e33d030878aa472 HTTP/1.1" 200 None 2026-04-01 15:42:26,569 - lava_callback - DEBUG - Processing node 69ca99d10e33d030878aa472: baseline-arm64-clabbe 2026-04-01 15:42:26,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca99d10e33d030878aa472 2026-04-01 15:42:26,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:42:26,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca99d10e33d030878aa472 HTTP/1.1" 200 None 2026-04-01 15:42:26,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:42:26,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:42:26,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:42:26,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca99d10e33d030878aa472 HTTP/1.1" 200 None 2026-04-01 15:42:26,635 - lava_callback - ERROR - Error processing callback for node 69ca99d10e33d030878aa472: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51284 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:43:46,516 - lava_callback - INFO - Received callback for node 69ca9a220e33d030878aa47e INFO: 172.21.0.1:42506 - "POST /node/69ca9a220e33d030878aa47e HTTP/1.0" 202 Accepted 2026-04-01 15:43:46,521 - lava_callback - INFO - Starting async job submit for node 69ca9a220e33d030878aa47e 2026-04-01 15:43:46,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:43:46,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9a220e33d030878aa47e HTTP/1.1" 200 None 2026-04-01 15:43:46,538 - lava_callback - DEBUG - Processing node 69ca9a220e33d030878aa47e: baseline-arm64-clabbe 2026-04-01 15:43:46,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9a220e33d030878aa47e 2026-04-01 15:43:46,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:43:46,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9a220e33d030878aa47e HTTP/1.1" 200 None 2026-04-01 15:43:46,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:43:46,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:43:46,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:43:46,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9a220e33d030878aa47e HTTP/1.1" 200 None 2026-04-01 15:43:46,592 - lava_callback - ERROR - Error processing callback for node 69ca9a220e33d030878aa47e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:44:47,589 - lava_callback - INFO - Received callback for node 69ca9a690e33d030878aa486 INFO: 172.21.0.1:43874 - "POST /node/69ca9a690e33d030878aa486 HTTP/1.0" 202 Accepted 2026-04-01 15:44:47,595 - lava_callback - INFO - Starting async job submit for node 69ca9a690e33d030878aa486 2026-04-01 15:44:47,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:44:47,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9a690e33d030878aa486 HTTP/1.1" 200 None 2026-04-01 15:44:47,616 - lava_callback - DEBUG - Processing node 69ca9a690e33d030878aa486: baseline-arm64-baylibre 2026-04-01 15:44:47,616 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9a690e33d030878aa486 2026-04-01 15:44:47,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:44:47,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9a690e33d030878aa486 HTTP/1.1" 200 None 2026-04-01 15:44:47,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:44:47,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:44:47,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:44:47,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9a690e33d030878aa486 HTTP/1.1" 200 None 2026-04-01 15:44:47,685 - lava_callback - ERROR - Error processing callback for node 69ca9a690e33d030878aa486: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39594 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:46:26,650 - lava_callback - INFO - Received callback for node 69ca9ac20e33d030878aa492 INFO: 172.21.0.1:39604 - "POST /node/69ca9ac20e33d030878aa492 HTTP/1.0" 202 Accepted 2026-04-01 15:46:26,655 - lava_callback - INFO - Starting async job submit for node 69ca9ac20e33d030878aa492 2026-04-01 15:46:26,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:46:26,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9ac20e33d030878aa492 HTTP/1.1" 200 None 2026-04-01 15:46:26,680 - lava_callback - DEBUG - Processing node 69ca9ac20e33d030878aa492: baseline-arm64-clabbe 2026-04-01 15:46:26,680 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9ac20e33d030878aa492 2026-04-01 15:46:26,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:46:26,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9ac20e33d030878aa492 HTTP/1.1" 200 None 2026-04-01 15:46:26,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:46:26,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:46:26,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:46:26,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9ac20e33d030878aa492 HTTP/1.1" 200 None 2026-04-01 15:46:26,743 - lava_callback - ERROR - Error processing callback for node 69ca9ac20e33d030878aa492: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36222 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:47:27,684 - lava_callback - INFO - Received callback for node 69ca9b0b0e33d030878aa49b INFO: 172.21.0.1:36238 - "POST /node/69ca9b0b0e33d030878aa49b HTTP/1.0" 202 Accepted 2026-04-01 15:47:27,689 - lava_callback - INFO - Starting async job submit for node 69ca9b0b0e33d030878aa49b 2026-04-01 15:47:27,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:47:27,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9b0b0e33d030878aa49b HTTP/1.1" 200 None 2026-04-01 15:47:27,733 - lava_callback - DEBUG - Processing node 69ca9b0b0e33d030878aa49b: baseline-arm64-baylibre 2026-04-01 15:47:27,733 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9b0b0e33d030878aa49b 2026-04-01 15:47:27,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:47:27,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9b0b0e33d030878aa49b HTTP/1.1" 200 None 2026-04-01 15:47:27,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:47:27,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:47:27,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:47:27,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9b0b0e33d030878aa49b HTTP/1.1" 200 None 2026-04-01 15:47:27,786 - lava_callback - ERROR - Error processing callback for node 69ca9b0b0e33d030878aa49b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:49:06,844 - lava_callback - INFO - Received callback for node 69ca9b610e33d030878aa4aa INFO: 172.21.0.1:45624 - "POST /node/69ca9b610e33d030878aa4aa HTTP/1.0" 202 Accepted 2026-04-01 15:49:06,850 - lava_callback - INFO - Starting async job submit for node 69ca9b610e33d030878aa4aa 2026-04-01 15:49:06,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:49:06,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9b610e33d030878aa4aa HTTP/1.1" 200 None 2026-04-01 15:49:06,866 - lava_callback - DEBUG - Processing node 69ca9b610e33d030878aa4aa: baseline-arm64-clabbe 2026-04-01 15:49:06,866 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9b610e33d030878aa4aa 2026-04-01 15:49:06,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:49:06,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9b610e33d030878aa4aa HTTP/1.1" 200 None 2026-04-01 15:49:06,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:49:06,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:49:06,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:49:06,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9b610e33d030878aa4aa HTTP/1.1" 200 None 2026-04-01 15:49:06,927 - lava_callback - ERROR - Error processing callback for node 69ca9b610e33d030878aa4aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44624 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:50:07,915 - lava_callback - INFO - Received callback for node 69ca9ba90e33d030878aa4b9 INFO: 172.21.0.1:44634 - "POST /node/69ca9ba90e33d030878aa4b9 HTTP/1.0" 202 Accepted 2026-04-01 15:50:07,921 - lava_callback - INFO - Starting async job submit for node 69ca9ba90e33d030878aa4b9 2026-04-01 15:50:07,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:50:07,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9ba90e33d030878aa4b9 HTTP/1.1" 200 None 2026-04-01 15:50:07,936 - lava_callback - DEBUG - Processing node 69ca9ba90e33d030878aa4b9: baseline-arm64-baylibre 2026-04-01 15:50:07,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9ba90e33d030878aa4b9 2026-04-01 15:50:07,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:50:07,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9ba90e33d030878aa4b9 HTTP/1.1" 200 None 2026-04-01 15:50:07,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:50:07,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:50:07,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:50:07,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9ba90e33d030878aa4b9 HTTP/1.1" 200 None 2026-04-01 15:50:07,988 - lava_callback - ERROR - Error processing callback for node 69ca9ba90e33d030878aa4b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42362 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47636 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:51:46,896 - lava_callback - INFO - Received callback for node 69ca9c040e33d030878aa4c7 INFO: 172.21.0.1:47648 - "POST /node/69ca9c040e33d030878aa4c7 HTTP/1.0" 202 Accepted 2026-04-01 15:51:46,902 - lava_callback - INFO - Starting async job submit for node 69ca9c040e33d030878aa4c7 2026-04-01 15:51:46,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:51:46,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9c040e33d030878aa4c7 HTTP/1.1" 200 None 2026-04-01 15:51:46,918 - lava_callback - DEBUG - Processing node 69ca9c040e33d030878aa4c7: baseline-arm64-clabbe 2026-04-01 15:51:46,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9c040e33d030878aa4c7 2026-04-01 15:51:46,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:51:46,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9c040e33d030878aa4c7 HTTP/1.1" 200 None 2026-04-01 15:51:46,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:51:46,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:51:46,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:51:46,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9c040e33d030878aa4c7 HTTP/1.1" 200 None 2026-04-01 15:51:46,975 - lava_callback - ERROR - Error processing callback for node 69ca9c040e33d030878aa4c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54918 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:53:07,020 - lava_callback - INFO - Received callback for node 69ca9c560e33d030878aa4d6 INFO: 172.21.0.1:60472 - "POST /node/69ca9c560e33d030878aa4d6 HTTP/1.0" 202 Accepted 2026-04-01 15:53:07,025 - lava_callback - INFO - Starting async job submit for node 69ca9c560e33d030878aa4d6 2026-04-01 15:53:07,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:53:07,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9c560e33d030878aa4d6 HTTP/1.1" 200 None 2026-04-01 15:53:07,044 - lava_callback - DEBUG - Processing node 69ca9c560e33d030878aa4d6: baseline-arm64-clabbe 2026-04-01 15:53:07,044 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9c560e33d030878aa4d6 2026-04-01 15:53:07,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:53:07,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9c560e33d030878aa4d6 HTTP/1.1" 200 None 2026-04-01 15:53:07,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:53:07,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:53:07,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:53:07,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9c560e33d030878aa4d6 HTTP/1.1" 200 None 2026-04-01 15:53:07,181 - lava_callback - ERROR - Error processing callback for node 69ca9c560e33d030878aa4d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52914 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:54:26,995 - lava_callback - INFO - Received callback for node 69ca9ca60e33d030878aa4e1 INFO: 172.21.0.1:52926 - "POST /node/69ca9ca60e33d030878aa4e1 HTTP/1.0" 202 Accepted 2026-04-01 15:54:27,001 - lava_callback - INFO - Starting async job submit for node 69ca9ca60e33d030878aa4e1 2026-04-01 15:54:27,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:54:27,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9ca60e33d030878aa4e1 HTTP/1.1" 200 None 2026-04-01 15:54:27,020 - lava_callback - DEBUG - Processing node 69ca9ca60e33d030878aa4e1: baseline-arm64-clabbe 2026-04-01 15:54:27,020 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9ca60e33d030878aa4e1 2026-04-01 15:54:27,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:54:27,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9ca60e33d030878aa4e1 HTTP/1.1" 200 None 2026-04-01 15:54:27,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:54:27,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:54:27,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:54:27,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9ca60e33d030878aa4e1 HTTP/1.1" 200 None 2026-04-01 15:54:27,076 - lava_callback - ERROR - Error processing callback for node 69ca9ca60e33d030878aa4e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:55:47,116 - lava_callback - INFO - Received callback for node 69ca9cf70e33d030878aa4ec INFO: 172.21.0.1:59548 - "POST /node/69ca9cf70e33d030878aa4ec HTTP/1.0" 202 Accepted 2026-04-01 15:55:47,121 - lava_callback - INFO - Starting async job submit for node 69ca9cf70e33d030878aa4ec 2026-04-01 15:55:47,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:55:47,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9cf70e33d030878aa4ec HTTP/1.1" 200 None 2026-04-01 15:55:47,141 - lava_callback - DEBUG - Processing node 69ca9cf70e33d030878aa4ec: baseline-arm64-clabbe 2026-04-01 15:55:47,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9cf70e33d030878aa4ec 2026-04-01 15:55:47,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:55:47,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9cf70e33d030878aa4ec HTTP/1.1" 200 None 2026-04-01 15:55:47,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:55:47,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:55:47,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:55:47,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9cf70e33d030878aa4ec HTTP/1.1" 200 None 2026-04-01 15:55:47,196 - lava_callback - ERROR - Error processing callback for node 69ca9cf70e33d030878aa4ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:57:07,122 - lava_callback - INFO - Received callback for node 69ca9d470e33d030878aa4f9 INFO: 172.21.0.1:48172 - "POST /node/69ca9d470e33d030878aa4f9 HTTP/1.0" 202 Accepted 2026-04-01 15:57:07,130 - lava_callback - INFO - Starting async job submit for node 69ca9d470e33d030878aa4f9 2026-04-01 15:57:07,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:57:07,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9d470e33d030878aa4f9 HTTP/1.1" 200 None 2026-04-01 15:57:07,149 - lava_callback - DEBUG - Processing node 69ca9d470e33d030878aa4f9: baseline-arm64-clabbe 2026-04-01 15:57:07,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9d470e33d030878aa4f9 2026-04-01 15:57:07,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:57:07,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9d470e33d030878aa4f9 HTTP/1.1" 200 None 2026-04-01 15:57:07,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:57:07,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:57:07,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:57:07,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9d470e33d030878aa4f9 HTTP/1.1" 200 None 2026-04-01 15:57:07,222 - lava_callback - ERROR - Error processing callback for node 69ca9d470e33d030878aa4f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54856 - "GET / HTTP/1.0" 200 OK 2026-04-01 15:58:27,166 - lava_callback - INFO - Received callback for node 69ca9d980e33d030878aa504 INFO: 172.21.0.1:54860 - "POST /node/69ca9d980e33d030878aa504 HTTP/1.0" 202 Accepted 2026-04-01 15:58:27,171 - lava_callback - INFO - Starting async job submit for node 69ca9d980e33d030878aa504 2026-04-01 15:58:27,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:58:27,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9d980e33d030878aa504 HTTP/1.1" 200 None 2026-04-01 15:58:27,212 - lava_callback - DEBUG - Processing node 69ca9d980e33d030878aa504: baseline-arm64-clabbe 2026-04-01 15:58:27,212 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9d980e33d030878aa504 2026-04-01 15:58:27,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:58:27,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9d980e33d030878aa504 HTTP/1.1" 200 None 2026-04-01 15:58:27,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:58:27,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c78eb9be430e18c5d159ee HTTP/1.1" 200 None 2026-04-01 15:58:27,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 15:58:27,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9d980e33d030878aa504 HTTP/1.1" 200 None 2026-04-01 15:58:27,265 - lava_callback - ERROR - Error processing callback for node 69ca9d980e33d030878aa504: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:00:28,302 - lava_callback - INFO - Received callback for node 69ca9e180e33d030878aa50d INFO: 172.21.0.1:35820 - "POST /node/69ca9e180e33d030878aa50d HTTP/1.0" 202 Accepted 2026-04-01 16:00:28,309 - lava_callback - INFO - Starting async job submit for node 69ca9e180e33d030878aa50d 2026-04-01 16:00:28,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:00:28,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9e180e33d030878aa50d HTTP/1.1" 200 None 2026-04-01 16:00:28,339 - lava_callback - DEBUG - Processing node 69ca9e180e33d030878aa50d: baseline-arm64-baylibre 2026-04-01 16:00:28,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9e180e33d030878aa50d 2026-04-01 16:00:28,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:00:28,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9e180e33d030878aa50d HTTP/1.1" 200 None 2026-04-01 16:00:28,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:00:28,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 16:00:28,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:00:28,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9e180e33d030878aa50d HTTP/1.1" 200 None 2026-04-01 16:00:28,409 - lava_callback - ERROR - Error processing callback for node 69ca9e180e33d030878aa50d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:01:48,361 - lava_callback - INFO - Received callback for node 69ca9e660e33d030878aa51d INFO: 172.21.0.1:57096 - "POST /node/69ca9e660e33d030878aa51d HTTP/1.0" 202 Accepted 2026-04-01 16:01:48,367 - lava_callback - INFO - Starting async job submit for node 69ca9e660e33d030878aa51d 2026-04-01 16:01:48,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:01:48,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9e660e33d030878aa51d HTTP/1.1" 200 None 2026-04-01 16:01:48,383 - lava_callback - DEBUG - Processing node 69ca9e660e33d030878aa51d: baseline-arm64-baylibre 2026-04-01 16:01:48,383 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9e660e33d030878aa51d 2026-04-01 16:01:48,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:01:48,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9e660e33d030878aa51d HTTP/1.1" 200 None 2026-04-01 16:01:48,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:01:48,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 16:01:48,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:01:48,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9e660e33d030878aa51d HTTP/1.1" 200 None 2026-04-01 16:01:48,448 - lava_callback - ERROR - Error processing callback for node 69ca9e660e33d030878aa51d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58958 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:03:08,420 - lava_callback - INFO - Received callback for node 69ca9eb50e33d030878aa52d INFO: 172.21.0.1:58960 - "POST /node/69ca9eb50e33d030878aa52d HTTP/1.0" 202 Accepted 2026-04-01 16:03:08,427 - lava_callback - INFO - Starting async job submit for node 69ca9eb50e33d030878aa52d 2026-04-01 16:03:08,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:03:08,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9eb50e33d030878aa52d HTTP/1.1" 200 None 2026-04-01 16:03:08,444 - lava_callback - DEBUG - Processing node 69ca9eb50e33d030878aa52d: baseline-arm64-baylibre 2026-04-01 16:03:08,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9eb50e33d030878aa52d 2026-04-01 16:03:08,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:03:08,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9eb50e33d030878aa52d HTTP/1.1" 200 None 2026-04-01 16:03:08,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:03:08,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 16:03:08,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:03:08,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9eb50e33d030878aa52d HTTP/1.1" 200 None 2026-04-01 16:03:08,513 - lava_callback - ERROR - Error processing callback for node 69ca9eb50e33d030878aa52d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41766 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:04:28,449 - lava_callback - INFO - Received callback for node 69ca9f040e33d030878aa535 INFO: 172.21.0.1:41782 - "POST /node/69ca9f040e33d030878aa535 HTTP/1.0" 202 Accepted 2026-04-01 16:04:28,455 - lava_callback - INFO - Starting async job submit for node 69ca9f040e33d030878aa535 2026-04-01 16:04:28,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:04:28,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9f040e33d030878aa535 HTTP/1.1" 200 None 2026-04-01 16:04:28,471 - lava_callback - DEBUG - Processing node 69ca9f040e33d030878aa535: baseline-arm64-baylibre 2026-04-01 16:04:28,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9f040e33d030878aa535 2026-04-01 16:04:28,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:04:28,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9f040e33d030878aa535 HTTP/1.1" 200 None 2026-04-01 16:04:28,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:04:28,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 16:04:28,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:04:28,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9f040e33d030878aa535 HTTP/1.1" 200 None 2026-04-01 16:04:28,549 - lava_callback - ERROR - Error processing callback for node 69ca9f040e33d030878aa535: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34292 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:05:48,600 - lava_callback - INFO - Received callback for node 69ca9f500e33d030878aa544 INFO: 172.21.0.1:34298 - "POST /node/69ca9f500e33d030878aa544 HTTP/1.0" 202 Accepted 2026-04-01 16:05:48,606 - lava_callback - INFO - Starting async job submit for node 69ca9f500e33d030878aa544 2026-04-01 16:05:48,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:05:48,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9f500e33d030878aa544 HTTP/1.1" 200 None 2026-04-01 16:05:48,622 - lava_callback - DEBUG - Processing node 69ca9f500e33d030878aa544: baseline-arm64-baylibre 2026-04-01 16:05:48,622 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9f500e33d030878aa544 2026-04-01 16:05:48,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:05:48,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9f500e33d030878aa544 HTTP/1.1" 200 None 2026-04-01 16:05:48,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:05:48,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 16:05:48,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:05:48,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9f500e33d030878aa544 HTTP/1.1" 200 None 2026-04-01 16:05:48,685 - lava_callback - ERROR - Error processing callback for node 69ca9f500e33d030878aa544: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:07:08,643 - lava_callback - INFO - Received callback for node 69ca9f9f0e33d030878aa557 INFO: 172.21.0.1:38986 - "POST /node/69ca9f9f0e33d030878aa557 HTTP/1.0" 202 Accepted 2026-04-01 16:07:08,649 - lava_callback - INFO - Starting async job submit for node 69ca9f9f0e33d030878aa557 2026-04-01 16:07:08,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:07:08,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9f9f0e33d030878aa557 HTTP/1.1" 200 None 2026-04-01 16:07:08,665 - lava_callback - DEBUG - Processing node 69ca9f9f0e33d030878aa557: baseline-arm64-baylibre 2026-04-01 16:07:08,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9f9f0e33d030878aa557 2026-04-01 16:07:08,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:07:08,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9f9f0e33d030878aa557 HTTP/1.1" 200 None 2026-04-01 16:07:08,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:07:08,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 16:07:08,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:07:08,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9f9f0e33d030878aa557 HTTP/1.1" 200 None 2026-04-01 16:07:08,734 - lava_callback - ERROR - Error processing callback for node 69ca9f9f0e33d030878aa557: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52530 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:08:28,734 - lava_callback - INFO - Received callback for node 69ca9fed0e33d030878aa55e INFO: 172.21.0.1:52546 - "POST /node/69ca9fed0e33d030878aa55e HTTP/1.0" 202 Accepted 2026-04-01 16:08:28,740 - lava_callback - INFO - Starting async job submit for node 69ca9fed0e33d030878aa55e 2026-04-01 16:08:28,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:08:28,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9fed0e33d030878aa55e HTTP/1.1" 200 None 2026-04-01 16:08:28,756 - lava_callback - DEBUG - Processing node 69ca9fed0e33d030878aa55e: baseline-arm64-baylibre 2026-04-01 16:08:28,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ca9fed0e33d030878aa55e 2026-04-01 16:08:28,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:08:28,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ca9fed0e33d030878aa55e HTTP/1.1" 200 None 2026-04-01 16:08:28,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:08:28,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 16:08:28,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:08:28,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ca9fed0e33d030878aa55e HTTP/1.1" 200 None 2026-04-01 16:08:28,817 - lava_callback - ERROR - Error processing callback for node 69ca9fed0e33d030878aa55e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39336 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:11:07,774 - lava_callback - INFO - Received callback for node 69caa0900e33d030878aa578 INFO: 172.21.0.1:39344 - "POST /node/69caa0900e33d030878aa578 HTTP/1.0" 202 Accepted 2026-04-01 16:11:07,780 - lava_callback - INFO - Starting async job submit for node 69caa0900e33d030878aa578 2026-04-01 16:11:07,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:11:07,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa0900e33d030878aa578 HTTP/1.1" 200 None 2026-04-01 16:11:07,801 - lava_callback - DEBUG - Processing node 69caa0900e33d030878aa578: baseline-arm64-clabbe 2026-04-01 16:11:07,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa0900e33d030878aa578 2026-04-01 16:11:07,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:11:07,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa0900e33d030878aa578 HTTP/1.1" 200 None 2026-04-01 16:11:07,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:11:07,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 16:11:07,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:11:07,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa0900e33d030878aa578 HTTP/1.1" 200 None 2026-04-01 16:11:07,864 - lava_callback - ERROR - Error processing callback for node 69caa0900e33d030878aa578: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51886 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52224 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:12:09,232 - lava_callback - INFO - Received callback for node 69caa0d50e33d030878aa57f INFO: 172.21.0.1:52230 - "POST /node/69caa0d50e33d030878aa57f HTTP/1.0" 202 Accepted 2026-04-01 16:12:09,237 - lava_callback - INFO - Starting async job submit for node 69caa0d50e33d030878aa57f 2026-04-01 16:12:09,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:12:09,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa0d50e33d030878aa57f HTTP/1.1" 200 None 2026-04-01 16:12:09,254 - lava_callback - DEBUG - Processing node 69caa0d50e33d030878aa57f: baseline-arm64-baylibre 2026-04-01 16:12:09,254 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa0d50e33d030878aa57f 2026-04-01 16:12:09,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:12:09,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa0d50e33d030878aa57f HTTP/1.1" 200 None 2026-04-01 16:12:09,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:12:09,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 16:12:09,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:12:09,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa0d50e33d030878aa57f HTTP/1.1" 200 None 2026-04-01 16:12:09,310 - lava_callback - ERROR - Error processing callback for node 69caa0d50e33d030878aa57f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45042 - "GET / HTTP/1.0" 200 OK 2026-04-01 16:13:28,941 - lava_callback - INFO - Received callback for node 69caa1250e33d030878aa590 INFO: 172.21.0.1:45048 - "POST /node/69caa1250e33d030878aa590 HTTP/1.0" 202 Accepted 2026-04-01 16:13:28,951 - lava_callback - INFO - Starting async job submit for node 69caa1250e33d030878aa590 2026-04-01 16:13:28,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:13:28,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa1250e33d030878aa590 HTTP/1.1" 200 None 2026-04-01 16:13:28,975 - lava_callback - DEBUG - Processing node 69caa1250e33d030878aa590: baseline-arm64-baylibre 2026-04-01 16:13:28,975 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69caa1250e33d030878aa590 2026-04-01 16:13:28,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:13:28,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa1250e33d030878aa590 HTTP/1.1" 200 None 2026-04-01 16:13:29,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:13:29,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c4ebd8f63ce05331e2a492 HTTP/1.1" 200 None 2026-04-01 16:13:29,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-01 16:13:29,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69caa1250e33d030878aa590 HTTP/1.1" 200 None 2026-04-01 16:13:29,051 - lava_callback - ERROR - Error processing callback for node 69caa1250e33d030878aa590: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44982 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]