INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:46814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:36:24,223 - lava_callback - INFO - Received callback for node 69ce2a0ecb08ea23a1f6827e 2026-04-02 08:36:24,234 - lava_callback - INFO - Starting async job submit for node 69ce2a0ecb08ea23a1f6827e INFO: 172.21.0.1:34672 - "POST /node/69ce2a0ecb08ea23a1f6827e HTTP/1.0" 202 Accepted 2026-04-02 08:36:24,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:36:24,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2a0ecb08ea23a1f6827e HTTP/1.1" 200 None 2026-04-02 08:36:24,324 - lava_callback - DEBUG - Processing node 69ce2a0ecb08ea23a1f6827e: baseline-arm 2026-04-02 08:36:24,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:36:25,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:36:25,007 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2a0ecb08ea23a1f6827e/log.txt.gz 2026-04-02 08:36:25,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:36:25,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:36:25,727 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2a0ecb08ea23a1f6827e/lava-logs.yaml 2026-04-02 08:36:25,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:36:26,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:36:26,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2a0ecb08ea23a1f6827e/lava_callback.json.gz 2026-04-02 08:36:26,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:36:26,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2a0ecb08ea23a1f6827e HTTP/1.1" 200 None 2026-04-02 08:36:26,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:36:26,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce266ecb08ea23a1f68074 HTTP/1.1" 200 None 2026-04-02 08:36:26,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:36:26,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2a0ecb08ea23a1f6827e HTTP/1.1" 200 None 2026-04-02 08:36:26,384 - lava_callback - INFO - Completed processing callback for node 69ce2a0ecb08ea23a1f6827e INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:36:56,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:36:56,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:37:01,710 - lava_callback - INFO - Received callback for node 69cb87a22a64fa9aff936f5f INFO: 172.21.0.1:54736 - "POST /node/69cb87a22a64fa9aff936f5f HTTP/1.0" 202 Accepted 2026-04-02 08:37:01,722 - lava_callback - INFO - Starting async job submit for node 69cb87a22a64fa9aff936f5f 2026-04-02 08:37:01,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:01,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87a22a64fa9aff936f5f HTTP/1.1" 200 None 2026-04-02 08:37:01,760 - lava_callback - DEBUG - Processing node 69cb87a22a64fa9aff936f5f: baseline-arm-baylibre 2026-04-02 08:37:01,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87a22a64fa9aff936f5f 2026-04-02 08:37:01,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:01,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87a22a64fa9aff936f5f HTTP/1.1" 200 None 2026-04-02 08:37:01,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:01,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:37:01,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:01,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87a22a64fa9aff936f5f HTTP/1.1" 200 None 2026-04-02 08:37:01,868 - lava_callback - ERROR - Error processing callback for node 69cb87a22a64fa9aff936f5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:02,370 - lava_callback - INFO - Received callback for node 69cb87aa2a64fa9aff936f7c INFO: 172.21.0.1:54744 - "POST /node/69cb87aa2a64fa9aff936f7c HTTP/1.0" 202 Accepted 2026-04-02 08:37:02,380 - lava_callback - INFO - Starting async job submit for node 69cb87aa2a64fa9aff936f7c 2026-04-02 08:37:02,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:02,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87aa2a64fa9aff936f7c HTTP/1.1" 200 None 2026-04-02 08:37:02,406 - lava_callback - DEBUG - Processing node 69cb87aa2a64fa9aff936f7c: baseline-arm-baylibre 2026-04-02 08:37:02,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87aa2a64fa9aff936f7c 2026-04-02 08:37:02,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:02,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87aa2a64fa9aff936f7c HTTP/1.1" 200 None 2026-04-02 08:37:02,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:02,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:02,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:02,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87aa2a64fa9aff936f7c HTTP/1.1" 200 None 2026-04-02 08:37:02,505 - lava_callback - ERROR - Error processing callback for node 69cb87aa2a64fa9aff936f7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:03,040 - lava_callback - INFO - Received callback for node 69cb87ab2a64fa9aff936f7f INFO: 172.21.0.1:54760 - "POST /node/69cb87ab2a64fa9aff936f7f HTTP/1.0" 202 Accepted 2026-04-02 08:37:03,050 - lava_callback - INFO - Starting async job submit for node 69cb87ab2a64fa9aff936f7f 2026-04-02 08:37:03,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:03,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ab2a64fa9aff936f7f HTTP/1.1" 200 None 2026-04-02 08:37:03,087 - lava_callback - DEBUG - Processing node 69cb87ab2a64fa9aff936f7f: baseline-arm-baylibre 2026-04-02 08:37:03,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87ab2a64fa9aff936f7f 2026-04-02 08:37:03,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:03,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ab2a64fa9aff936f7f HTTP/1.1" 200 None 2026-04-02 08:37:03,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:03,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:03,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:03,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87ab2a64fa9aff936f7f HTTP/1.1" 200 None 2026-04-02 08:37:03,190 - lava_callback - ERROR - Error processing callback for node 69cb87ab2a64fa9aff936f7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34200 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:37:21,623 - lava_callback - INFO - Received callback for node 69cb87b12a64fa9aff936f90 INFO: 172.21.0.1:56244 - "POST /node/69cb87b12a64fa9aff936f90 HTTP/1.0" 202 Accepted 2026-04-02 08:37:21,629 - lava_callback - INFO - Starting async job submit for node 69cb87b12a64fa9aff936f90 2026-04-02 08:37:21,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:21,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87b12a64fa9aff936f90 HTTP/1.1" 200 None 2026-04-02 08:37:21,645 - lava_callback - DEBUG - Processing node 69cb87b12a64fa9aff936f90: baseline-arm-baylibre 2026-04-02 08:37:21,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87b12a64fa9aff936f90 2026-04-02 08:37:21,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:21,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87b12a64fa9aff936f90 HTTP/1.1" 200 None 2026-04-02 08:37:21,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:21,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:21,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:21,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87b12a64fa9aff936f90 HTTP/1.1" 200 None 2026-04-02 08:37:21,722 - lava_callback - ERROR - Error processing callback for node 69cb87b12a64fa9aff936f90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:22,310 - lava_callback - INFO - Received callback for node 69cb87ad2a64fa9aff936f82 INFO: 172.21.0.1:56258 - "POST /node/69cb87ad2a64fa9aff936f82 HTTP/1.0" 202 Accepted 2026-04-02 08:37:22,317 - lava_callback - INFO - Starting async job submit for node 69cb87ad2a64fa9aff936f82 2026-04-02 08:37:22,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:22,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ad2a64fa9aff936f82 HTTP/1.1" 200 None 2026-04-02 08:37:22,341 - lava_callback - DEBUG - Processing node 69cb87ad2a64fa9aff936f82: baseline-arm-baylibre 2026-04-02 08:37:22,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87ad2a64fa9aff936f82 2026-04-02 08:37:22,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:22,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ad2a64fa9aff936f82 HTTP/1.1" 200 None 2026-04-02 08:37:22,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:22,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:22,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:22,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87ad2a64fa9aff936f82 HTTP/1.1" 200 None 2026-04-02 08:37:22,419 - lava_callback - ERROR - Error processing callback for node 69cb87ad2a64fa9aff936f82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:22,954 - lava_callback - INFO - Received callback for node 69cb87ae2a64fa9aff936f85 INFO: 172.21.0.1:56272 - "POST /node/69cb87ae2a64fa9aff936f85 HTTP/1.0" 202 Accepted 2026-04-02 08:37:22,961 - lava_callback - INFO - Starting async job submit for node 69cb87ae2a64fa9aff936f85 2026-04-02 08:37:22,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:22,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ae2a64fa9aff936f85 HTTP/1.1" 200 None 2026-04-02 08:37:22,979 - lava_callback - DEBUG - Processing node 69cb87ae2a64fa9aff936f85: baseline-arm-baylibre 2026-04-02 08:37:22,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87ae2a64fa9aff936f85 2026-04-02 08:37:22,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ae2a64fa9aff936f85 HTTP/1.1" 200 None 2026-04-02 08:37:23,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:23,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87ae2a64fa9aff936f85 HTTP/1.1" 200 None 2026-04-02 08:37:23,045 - lava_callback - ERROR - Error processing callback for node 69cb87ae2a64fa9aff936f85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:23,615 - lava_callback - INFO - Received callback for node 69cb87b22a64fa9aff936f98 INFO: 172.21.0.1:56288 - "POST /node/69cb87b22a64fa9aff936f98 HTTP/1.0" 202 Accepted 2026-04-02 08:37:23,621 - lava_callback - INFO - Starting async job submit for node 69cb87b22a64fa9aff936f98 2026-04-02 08:37:23,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87b22a64fa9aff936f98 HTTP/1.1" 200 None 2026-04-02 08:37:23,637 - lava_callback - DEBUG - Processing node 69cb87b22a64fa9aff936f98: baseline-arm-baylibre 2026-04-02 08:37:23,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87b22a64fa9aff936f98 2026-04-02 08:37:23,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87b22a64fa9aff936f98 HTTP/1.1" 200 None 2026-04-02 08:37:23,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:23,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87b22a64fa9aff936f98 HTTP/1.1" 200 None 2026-04-02 08:37:23,699 - lava_callback - ERROR - Error processing callback for node 69cb87b22a64fa9aff936f98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:37:30,462 - lava_callback - INFO - Received callback for node 69cb87bb2a64fa9aff936fd6 INFO: 172.21.0.1:34976 - "POST /node/69cb87bb2a64fa9aff936fd6 HTTP/1.0" 202 Accepted 2026-04-02 08:37:30,479 - lava_callback - INFO - Starting async job submit for node 69cb87bb2a64fa9aff936fd6 2026-04-02 08:37:30,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:30,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87bb2a64fa9aff936fd6 HTTP/1.1" 200 None 2026-04-02 08:37:30,538 - lava_callback - DEBUG - Processing node 69cb87bb2a64fa9aff936fd6: baseline-arm-clabbe 2026-04-02 08:37:30,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87bb2a64fa9aff936fd6 2026-04-02 08:37:30,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:30,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87bb2a64fa9aff936fd6 HTTP/1.1" 200 None 2026-04-02 08:37:30,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:30,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:30,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:30,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87bb2a64fa9aff936fd6 HTTP/1.1" 200 None 2026-04-02 08:37:30,669 - lava_callback - ERROR - Error processing callback for node 69cb87bb2a64fa9aff936fd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:31,143 - lava_callback - INFO - Received callback for node 69cb87c02a64fa9aff936fe3 INFO: 172.21.0.1:34980 - "POST /node/69cb87c02a64fa9aff936fe3 HTTP/1.0" 202 Accepted 2026-04-02 08:37:31,149 - lava_callback - INFO - Starting async job submit for node 69cb87c02a64fa9aff936fe3 2026-04-02 08:37:31,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c02a64fa9aff936fe3 HTTP/1.1" 200 None 2026-04-02 08:37:31,166 - lava_callback - DEBUG - Processing node 69cb87c02a64fa9aff936fe3: baseline-arm-clabbe 2026-04-02 08:37:31,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87c02a64fa9aff936fe3 2026-04-02 08:37:31,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c02a64fa9aff936fe3 HTTP/1.1" 200 None 2026-04-02 08:37:31,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:31,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87c02a64fa9aff936fe3 HTTP/1.1" 200 None 2026-04-02 08:37:31,261 - lava_callback - ERROR - Error processing callback for node 69cb87c02a64fa9aff936fe3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:31,809 - lava_callback - INFO - Received callback for node 69cb87c12a64fa9aff936fe6 INFO: 172.21.0.1:34996 - "POST /node/69cb87c12a64fa9aff936fe6 HTTP/1.0" 202 Accepted 2026-04-02 08:37:31,815 - lava_callback - INFO - Starting async job submit for node 69cb87c12a64fa9aff936fe6 2026-04-02 08:37:31,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c12a64fa9aff936fe6 HTTP/1.1" 200 None 2026-04-02 08:37:31,834 - lava_callback - DEBUG - Processing node 69cb87c12a64fa9aff936fe6: baseline-arm-clabbe 2026-04-02 08:37:31,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87c12a64fa9aff936fe6 2026-04-02 08:37:31,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c12a64fa9aff936fe6 HTTP/1.1" 200 None 2026-04-02 08:37:31,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:31,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87c12a64fa9aff936fe6 HTTP/1.1" 200 None 2026-04-02 08:37:31,889 - lava_callback - ERROR - Error processing callback for node 69cb87c12a64fa9aff936fe6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:32,479 - lava_callback - INFO - Received callback for node 69cb87c22a64fa9aff936fe9 INFO: 172.21.0.1:35010 - "POST /node/69cb87c22a64fa9aff936fe9 HTTP/1.0" 202 Accepted 2026-04-02 08:37:32,485 - lava_callback - INFO - Starting async job submit for node 69cb87c22a64fa9aff936fe9 2026-04-02 08:37:32,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:32,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c22a64fa9aff936fe9 HTTP/1.1" 200 None 2026-04-02 08:37:32,504 - lava_callback - DEBUG - Processing node 69cb87c22a64fa9aff936fe9: baseline-arm-clabbe 2026-04-02 08:37:32,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87c22a64fa9aff936fe9 2026-04-02 08:37:32,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:32,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c22a64fa9aff936fe9 HTTP/1.1" 200 None 2026-04-02 08:37:32,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:32,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:32,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:32,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87c22a64fa9aff936fe9 HTTP/1.1" 200 None 2026-04-02 08:37:32,560 - lava_callback - ERROR - Error processing callback for node 69cb87c22a64fa9aff936fe9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:33,170 - lava_callback - INFO - Received callback for node 69cb87c52a64fa9aff936ff2 INFO: 172.21.0.1:35026 - "POST /node/69cb87c52a64fa9aff936ff2 HTTP/1.0" 202 Accepted 2026-04-02 08:37:33,176 - lava_callback - INFO - Starting async job submit for node 69cb87c52a64fa9aff936ff2 2026-04-02 08:37:33,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:33,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c52a64fa9aff936ff2 HTTP/1.1" 200 None 2026-04-02 08:37:33,195 - lava_callback - DEBUG - Processing node 69cb87c52a64fa9aff936ff2: baseline-arm-clabbe 2026-04-02 08:37:33,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87c52a64fa9aff936ff2 2026-04-02 08:37:33,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:33,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c52a64fa9aff936ff2 HTTP/1.1" 200 None 2026-04-02 08:37:33,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:33,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:33,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:33,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87c52a64fa9aff936ff2 HTTP/1.1" 200 None 2026-04-02 08:37:33,272 - lava_callback - ERROR - Error processing callback for node 69cb87c52a64fa9aff936ff2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:37:41,642 - lava_callback - INFO - Received callback for node 69cb87c82a64fa9aff936ffd INFO: 172.21.0.1:33222 - "POST /node/69cb87c82a64fa9aff936ffd HTTP/1.0" 202 Accepted 2026-04-02 08:37:41,649 - lava_callback - INFO - Starting async job submit for node 69cb87c82a64fa9aff936ffd 2026-04-02 08:37:41,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:41,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c82a64fa9aff936ffd HTTP/1.1" 200 None 2026-04-02 08:37:41,667 - lava_callback - DEBUG - Processing node 69cb87c82a64fa9aff936ffd: baseline-arm-baylibre 2026-04-02 08:37:41,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87c82a64fa9aff936ffd 2026-04-02 08:37:41,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:41,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c82a64fa9aff936ffd HTTP/1.1" 200 None 2026-04-02 08:37:41,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:41,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:37:41,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:41,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87c82a64fa9aff936ffd HTTP/1.1" 200 None 2026-04-02 08:37:41,757 - lava_callback - ERROR - Error processing callback for node 69cb87c82a64fa9aff936ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:38:49,731 - lava_callback - INFO - Received callback for node 69ce2b09cb08ea23a1f682cf INFO: 172.21.0.1:44218 - "POST /node/69ce2b09cb08ea23a1f682cf HTTP/1.0" 202 Accepted 2026-04-02 08:38:49,737 - lava_callback - INFO - Starting async job submit for node 69ce2b09cb08ea23a1f682cf 2026-04-02 08:38:49,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:38:49,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b09cb08ea23a1f682cf HTTP/1.1" 200 None 2026-04-02 08:38:49,755 - lava_callback - DEBUG - Processing node 69ce2b09cb08ea23a1f682cf: baseline-arm 2026-04-02 08:38:49,760 - lava_callback - WARNING - Failed to upload log 2026-04-02 08:38:49,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:38:49,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:38:49,882 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b09cb08ea23a1f682cf/lava-logs.yaml 2026-04-02 08:38:49,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:38:49,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:38:49,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b09cb08ea23a1f682cf/lava_callback.json.gz 2026-04-02 08:38:50,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:38:50,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b09cb08ea23a1f682cf HTTP/1.1" 200 None 2026-04-02 08:38:50,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:38:50,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:38:50,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:38:50,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b09cb08ea23a1f682cf HTTP/1.1" 200 None 2026-04-02 08:38:50,096 - lava_callback - INFO - Completed processing callback for node 69ce2b09cb08ea23a1f682cf 2026-04-02 08:38:56,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:38:56,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:39:05,835 - lava_callback - INFO - Received callback for node 69ce2b0acb08ea23a1f682d2 INFO: 172.21.0.1:60382 - "POST /node/69ce2b0acb08ea23a1f682d2 HTTP/1.0" 202 Accepted 2026-04-02 08:39:05,882 - lava_callback - INFO - Starting async job submit for node 69ce2b0acb08ea23a1f682d2 2026-04-02 08:39:05,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:05,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0acb08ea23a1f682d2 HTTP/1.1" 200 None 2026-04-02 08:39:05,916 - lava_callback - DEBUG - Processing node 69ce2b0acb08ea23a1f682d2: baseline-arm 2026-04-02 08:39:06,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:39:06,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:06,188 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0acb08ea23a1f682d2/log.txt.gz 2026-04-02 08:39:06,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:39:06,620 - lava_callback - INFO - Received callback for node 69ce2b0dcb08ea23a1f682db 2026-04-02 08:39:06,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:06,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0acb08ea23a1f682d2/lava-logs.yaml 2026-04-02 08:39:06,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:39:06,677 - lava_callback - INFO - Starting async job submit for node 69ce2b0dcb08ea23a1f682db INFO: 172.21.0.1:60412 - "POST /node/69ce2b0dcb08ea23a1f682db HTTP/1.0" 202 Accepted 2026-04-02 08:39:06,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:06,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0dcb08ea23a1f682db HTTP/1.1" 200 None 2026-04-02 08:39:06,772 - lava_callback - DEBUG - Processing node 69ce2b0dcb08ea23a1f682db: baseline-arm 2026-04-02 08:39:06,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:06,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0acb08ea23a1f682d2/lava_callback.json.gz 2026-04-02 08:39:06,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:06,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:39:06,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0acb08ea23a1f682d2 HTTP/1.1" 200 None 2026-04-02 08:39:06,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:06,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:39:07,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:07,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b0acb08ea23a1f682d2 HTTP/1.1" 200 None 2026-04-02 08:39:07,039 - lava_callback - INFO - Completed processing callback for node 69ce2b0acb08ea23a1f682d2 2026-04-02 08:39:07,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:07,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0dcb08ea23a1f682db/log.txt.gz 2026-04-02 08:39:07,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:39:07,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:07,494 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0dcb08ea23a1f682db/lava-logs.yaml 2026-04-02 08:39:07,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:39:07,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:07,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0dcb08ea23a1f682db/lava_callback.json.gz 2026-04-02 08:39:07,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:07,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0dcb08ea23a1f682db HTTP/1.1" 200 None 2026-04-02 08:39:07,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:07,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:39:07,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:07,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b0dcb08ea23a1f682db HTTP/1.1" 200 None 2026-04-02 08:39:07,715 - lava_callback - INFO - Completed processing callback for node 69ce2b0dcb08ea23a1f682db INFO: 172.21.0.1:36254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:39:26,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:26,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:39:41,836 - lava_callback - INFO - Received callback for node 69cb883b2a64fa9aff9370d2 INFO: 172.21.0.1:52088 - "POST /node/69cb883b2a64fa9aff9370d2 HTTP/1.0" 202 Accepted 2026-04-02 08:39:41,845 - lava_callback - INFO - Starting async job submit for node 69cb883b2a64fa9aff9370d2 2026-04-02 08:39:41,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:41,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb883b2a64fa9aff9370d2 HTTP/1.1" 200 None 2026-04-02 08:39:41,871 - lava_callback - DEBUG - Processing node 69cb883b2a64fa9aff9370d2: baseline-arm-baylibre 2026-04-02 08:39:41,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb883b2a64fa9aff9370d2 2026-04-02 08:39:41,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:41,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb883b2a64fa9aff9370d2 HTTP/1.1" 200 None 2026-04-02 08:39:41,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:41,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:39:41,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:41,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb883b2a64fa9aff9370d2 HTTP/1.1" 200 None 2026-04-02 08:39:41,937 - lava_callback - ERROR - Error processing callback for node 69cb883b2a64fa9aff9370d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45388 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:40:08,538 - lava_callback - INFO - Received callback for node 69ce2b09cb08ea23a1f682cc INFO: 172.21.0.1:45402 - "POST /node/69ce2b09cb08ea23a1f682cc HTTP/1.0" 202 Accepted 2026-04-02 08:40:08,544 - lava_callback - INFO - Starting async job submit for node 69ce2b09cb08ea23a1f682cc 2026-04-02 08:40:08,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:08,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b09cb08ea23a1f682cc HTTP/1.1" 200 None 2026-04-02 08:40:08,580 - lava_callback - DEBUG - Processing node 69ce2b09cb08ea23a1f682cc: baseline-arm 2026-04-02 08:40:08,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:08,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:08,934 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b09cb08ea23a1f682cc/log.txt.gz 2026-04-02 08:40:09,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:09,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:09,234 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b09cb08ea23a1f682cc/lava-logs.yaml 2026-04-02 08:40:09,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:09,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:09,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b09cb08ea23a1f682cc/lava_callback.json.gz 2026-04-02 08:40:09,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:09,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b09cb08ea23a1f682cc HTTP/1.1" 200 None 2026-04-02 08:40:09,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:09,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:40:09,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:09,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b09cb08ea23a1f682cc HTTP/1.1" 200 None 2026-04-02 08:40:09,585 - lava_callback - INFO - Completed processing callback for node 69ce2b09cb08ea23a1f682cc 2026-04-02 08:40:10,755 - lava_callback - INFO - Received callback for node 69cb88652a64fa9aff9370ec INFO: 172.21.0.1:59644 - "POST /node/69cb88652a64fa9aff9370ec HTTP/1.0" 202 Accepted 2026-04-02 08:40:10,761 - lava_callback - INFO - Starting async job submit for node 69cb88652a64fa9aff9370ec 2026-04-02 08:40:10,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:10,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88652a64fa9aff9370ec HTTP/1.1" 200 None 2026-04-02 08:40:10,777 - lava_callback - DEBUG - Processing node 69cb88652a64fa9aff9370ec: baseline-arm-clabbe 2026-04-02 08:40:10,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb88652a64fa9aff9370ec 2026-04-02 08:40:10,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:10,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88652a64fa9aff9370ec HTTP/1.1" 200 None 2026-04-02 08:40:10,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:10,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:40:10,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:10,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb88652a64fa9aff9370ec HTTP/1.1" 200 None 2026-04-02 08:40:10,869 - lava_callback - ERROR - Error processing callback for node 69cb88652a64fa9aff9370ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:40:17,778 - lava_callback - INFO - Received callback for node 69ce2b30cb08ea23a1f6836f INFO: 172.21.0.1:59674 - "POST /node/69ce2b30cb08ea23a1f6836f HTTP/1.0" 202 Accepted 2026-04-02 08:40:17,825 - lava_callback - INFO - Starting async job submit for node 69ce2b30cb08ea23a1f6836f 2026-04-02 08:40:17,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:17,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b30cb08ea23a1f6836f HTTP/1.1" 200 None 2026-04-02 08:40:17,860 - lava_callback - DEBUG - Processing node 69ce2b30cb08ea23a1f6836f: baseline-arm-pengutronix 2026-04-02 08:40:17,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:18,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:18,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b30cb08ea23a1f6836f/log.txt.gz 2026-04-02 08:40:18,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:18,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:18,301 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b30cb08ea23a1f6836f/lava-logs.yaml 2026-04-02 08:40:18,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:18,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:18,423 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b30cb08ea23a1f6836f/lava_callback.json.gz 2026-04-02 08:40:18,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:18,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b30cb08ea23a1f6836f HTTP/1.1" 200 None 2026-04-02 08:40:18,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:18,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:40:18,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:18,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b30cb08ea23a1f6836f HTTP/1.1" 200 None 2026-04-02 08:40:18,504 - lava_callback - INFO - Completed processing callback for node 69ce2b30cb08ea23a1f6836f 2026-04-02 08:40:23,504 - lava_callback - INFO - Received callback for node 69ce2b2dcb08ea23a1f68369 INFO: 172.21.0.1:49602 - "POST /node/69ce2b2dcb08ea23a1f68369 HTTP/1.0" 202 Accepted 2026-04-02 08:40:23,510 - lava_callback - INFO - Starting async job submit for node 69ce2b2dcb08ea23a1f68369 2026-04-02 08:40:23,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:23,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2dcb08ea23a1f68369 HTTP/1.1" 200 None 2026-04-02 08:40:23,544 - lava_callback - DEBUG - Processing node 69ce2b2dcb08ea23a1f68369: baseline-arm-pengutronix 2026-04-02 08:40:23,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:23,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:23,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2dcb08ea23a1f68369/log.txt.gz 2026-04-02 08:40:23,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:24,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:24,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2dcb08ea23a1f68369/lava-logs.yaml 2026-04-02 08:40:24,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:24,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:24,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2dcb08ea23a1f68369/lava_callback.json.gz 2026-04-02 08:40:24,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:24,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2dcb08ea23a1f68369 HTTP/1.1" 200 None 2026-04-02 08:40:24,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:24,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:40:24,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:24,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b2dcb08ea23a1f68369 HTTP/1.1" 200 None 2026-04-02 08:40:24,338 - lava_callback - INFO - Completed processing callback for node 69ce2b2dcb08ea23a1f68369 2026-04-02 08:40:26,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:26,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:40:43,982 - lava_callback - INFO - Received callback for node 69ce2b23cb08ea23a1f68322 INFO: 172.21.0.1:40016 - "POST /node/69ce2b23cb08ea23a1f68322 HTTP/1.0" 202 Accepted 2026-04-02 08:40:43,988 - lava_callback - INFO - Starting async job submit for node 69ce2b23cb08ea23a1f68322 2026-04-02 08:40:44,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:44,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b23cb08ea23a1f68322 HTTP/1.1" 200 None 2026-04-02 08:40:44,025 - lava_callback - DEBUG - Processing node 69ce2b23cb08ea23a1f68322: baseline-arm-clabbe 2026-04-02 08:40:44,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:44,338 - lava_callback - INFO - Received callback for node 69ce2b1bcb08ea23a1f68308 INFO: 172.21.0.1:40018 - "POST /node/69ce2b1bcb08ea23a1f68308 HTTP/1.0" 202 Accepted 2026-04-02 08:40:44,344 - lava_callback - INFO - Starting async job submit for node 69ce2b1bcb08ea23a1f68308 2026-04-02 08:40:44,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:44,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:44,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b23cb08ea23a1f68322/log.txt.gz 2026-04-02 08:40:44,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1bcb08ea23a1f68308 HTTP/1.1" 200 None 2026-04-02 08:40:44,463 - lava_callback - DEBUG - Processing node 69ce2b1bcb08ea23a1f68308: baseline-arm-broonie 2026-04-02 08:40:44,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:44,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:44,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:44,932 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1bcb08ea23a1f68308/log.txt.gz 2026-04-02 08:40:44,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:44,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b23cb08ea23a1f68322/lava-logs.yaml 2026-04-02 08:40:45,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:45,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:45,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:45,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b23cb08ea23a1f68322/lava_callback.json.gz 2026-04-02 08:40:45,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:45,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1bcb08ea23a1f68308/lava-logs.yaml 2026-04-02 08:40:45,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:45,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b23cb08ea23a1f68322 HTTP/1.1" 200 None 2026-04-02 08:40:45,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:40:45,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b23cb08ea23a1f68322 HTTP/1.1" 200 None 2026-04-02 08:40:45,349 - lava_callback - INFO - Completed processing callback for node 69ce2b23cb08ea23a1f68322 2026-04-02 08:40:45,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:45,482 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1bcb08ea23a1f68308/lava_callback.json.gz 2026-04-02 08:40:45,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1bcb08ea23a1f68308 HTTP/1.1" 200 None 2026-04-02 08:40:45,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:40:45,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b1bcb08ea23a1f68308 HTTP/1.1" 200 None 2026-04-02 08:40:45,575 - lava_callback - INFO - Completed processing callback for node 69ce2b1bcb08ea23a1f68308 INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:40:56,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:56,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:01,814 - lava_callback - INFO - Received callback for node 69cb888a2a64fa9aff937107 INFO: 172.21.0.1:58710 - "POST /node/69cb888a2a64fa9aff937107 HTTP/1.0" 202 Accepted 2026-04-02 08:41:01,820 - lava_callback - INFO - Starting async job submit for node 69cb888a2a64fa9aff937107 2026-04-02 08:41:01,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:01,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb888a2a64fa9aff937107 HTTP/1.1" 200 None 2026-04-02 08:41:01,837 - lava_callback - DEBUG - Processing node 69cb888a2a64fa9aff937107: baseline-arm-baylibre 2026-04-02 08:41:01,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb888a2a64fa9aff937107 2026-04-02 08:41:01,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:01,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb888a2a64fa9aff937107 HTTP/1.1" 200 None 2026-04-02 08:41:01,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:01,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:41:01,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:01,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb888a2a64fa9aff937107 HTTP/1.1" 200 None 2026-04-02 08:41:01,893 - lava_callback - ERROR - Error processing callback for node 69cb888a2a64fa9aff937107: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:41:05,591 - lava_callback - INFO - Received callback for node 69ce2b1dcb08ea23a1f6830b INFO: 172.21.0.1:58724 - "POST /node/69ce2b1dcb08ea23a1f6830b HTTP/1.0" 202 Accepted 2026-04-02 08:41:05,597 - lava_callback - INFO - Starting async job submit for node 69ce2b1dcb08ea23a1f6830b 2026-04-02 08:41:05,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:05,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1dcb08ea23a1f6830b HTTP/1.1" 200 None 2026-04-02 08:41:05,636 - lava_callback - DEBUG - Processing node 69ce2b1dcb08ea23a1f6830b: baseline-arm-broonie 2026-04-02 08:41:05,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:41:06,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:06,146 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1dcb08ea23a1f6830b/log.txt.gz 2026-04-02 08:41:06,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:41:06,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:06,482 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1dcb08ea23a1f6830b/lava-logs.yaml 2026-04-02 08:41:06,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58736 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:06,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:06,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1dcb08ea23a1f6830b/lava_callback.json.gz 2026-04-02 08:41:06,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:06,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1dcb08ea23a1f6830b HTTP/1.1" 200 None 2026-04-02 08:41:06,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:06,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:41:06,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:06,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b1dcb08ea23a1f6830b HTTP/1.1" 200 None 2026-04-02 08:41:06,748 - lava_callback - INFO - Completed processing callback for node 69ce2b1dcb08ea23a1f6830b INFO: 172.21.0.1:43902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:26,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:26,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:30,446 - lava_callback - INFO - Received callback for node 69cb88b42a64fa9aff937111 INFO: 172.21.0.1:39576 - "POST /node/69cb88b42a64fa9aff937111 HTTP/1.0" 202 Accepted 2026-04-02 08:41:30,454 - lava_callback - INFO - Starting async job submit for node 69cb88b42a64fa9aff937111 2026-04-02 08:41:30,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:30,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88b42a64fa9aff937111 HTTP/1.1" 200 None 2026-04-02 08:41:30,484 - lava_callback - DEBUG - Processing node 69cb88b42a64fa9aff937111: baseline-arm-clabbe 2026-04-02 08:41:30,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb88b42a64fa9aff937111 2026-04-02 08:41:30,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:30,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88b42a64fa9aff937111 HTTP/1.1" 200 None 2026-04-02 08:41:30,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:30,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:41:30,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:30,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb88b42a64fa9aff937111 HTTP/1.1" 200 None 2026-04-02 08:41:30,544 - lava_callback - ERROR - Error processing callback for node 69cb88b42a64fa9aff937111: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:38,062 - lava_callback - INFO - Received callback for node 69ce2b2ccb08ea23a1f68366 INFO: 172.21.0.1:39596 - "POST /node/69ce2b2ccb08ea23a1f68366 HTTP/1.0" 202 Accepted 2026-04-02 08:41:38,068 - lava_callback - INFO - Starting async job submit for node 69ce2b2ccb08ea23a1f68366 2026-04-02 08:41:38,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:38,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2ccb08ea23a1f68366 HTTP/1.1" 200 None 2026-04-02 08:41:38,104 - lava_callback - DEBUG - Processing node 69ce2b2ccb08ea23a1f68366: baseline-arm-pengutronix 2026-04-02 08:41:38,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:41:38,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:38,585 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ccb08ea23a1f68366/log.txt.gz 2026-04-02 08:41:38,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:41:38,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:38,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ccb08ea23a1f68366/lava-logs.yaml 2026-04-02 08:41:38,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:41:39,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:39,370 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ccb08ea23a1f68366/lava_callback.json.gz 2026-04-02 08:41:39,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:39,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2ccb08ea23a1f68366 HTTP/1.1" 200 None 2026-04-02 08:41:39,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:39,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:41:39,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:39,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b2ccb08ea23a1f68366 HTTP/1.1" 200 None 2026-04-02 08:41:39,495 - lava_callback - INFO - Completed processing callback for node 69ce2b2ccb08ea23a1f68366 INFO: 172.21.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:56,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:56,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57726 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:14,069 - lava_callback - INFO - Received callback for node 69ce2b0ccb08ea23a1f682d8 INFO: 172.21.0.1:53260 - "POST /node/69ce2b0ccb08ea23a1f682d8 HTTP/1.0" 202 Accepted 2026-04-02 08:42:14,079 - lava_callback - INFO - Starting async job submit for node 69ce2b0ccb08ea23a1f682d8 2026-04-02 08:42:14,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:14,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0ccb08ea23a1f682d8 HTTP/1.1" 200 None 2026-04-02 08:42:14,160 - lava_callback - DEBUG - Processing node 69ce2b0ccb08ea23a1f682d8: baseline-arm 2026-04-02 08:42:14,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53264 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 08:42:15,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:15,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0ccb08ea23a1f682d8/log.txt.gz 2026-04-02 08:42:15,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:16,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:16,013 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0ccb08ea23a1f682d8/lava-logs.yaml 2026-04-02 08:42:16,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:16,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:16,766 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0ccb08ea23a1f682d8/lava_callback.json.gz 2026-04-02 08:42:16,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:16,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0ccb08ea23a1f682d8 HTTP/1.1" 200 None 2026-04-02 08:42:16,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:16,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:42:16,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:16,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b0ccb08ea23a1f682d8 HTTP/1.1" 200 None 2026-04-02 08:42:16,899 - lava_callback - INFO - Completed processing callback for node 69ce2b0ccb08ea23a1f682d8 2026-04-02 08:42:19,005 - lava_callback - INFO - Received callback for node 69ce2b26cb08ea23a1f6832e INFO: 172.21.0.1:53276 - "POST /node/69ce2b26cb08ea23a1f6832e HTTP/1.0" 202 Accepted 2026-04-02 08:42:19,018 - lava_callback - INFO - Starting async job submit for node 69ce2b26cb08ea23a1f6832e 2026-04-02 08:42:19,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:19,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b26cb08ea23a1f6832e HTTP/1.1" 200 None 2026-04-02 08:42:19,084 - lava_callback - DEBUG - Processing node 69ce2b26cb08ea23a1f6832e: baseline-arm-clabbe 2026-04-02 08:42:19,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:20,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:20,293 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b26cb08ea23a1f6832e/log.txt.gz 2026-04-02 08:42:20,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:21,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:21,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b26cb08ea23a1f6832e/lava-logs.yaml 2026-04-02 08:42:21,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:21,939 - lava_callback - INFO - Received callback for node 69cb88db2a64fa9aff93711e INFO: 172.21.0.1:36878 - "POST /node/69cb88db2a64fa9aff93711e HTTP/1.0" 202 Accepted 2026-04-02 08:42:21,949 - lava_callback - INFO - Starting async job submit for node 69cb88db2a64fa9aff93711e 2026-04-02 08:42:21,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:21,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88db2a64fa9aff93711e HTTP/1.1" 200 None 2026-04-02 08:42:21,982 - lava_callback - DEBUG - Processing node 69cb88db2a64fa9aff93711e: baseline-arm-baylibre 2026-04-02 08:42:21,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb88db2a64fa9aff93711e 2026-04-02 08:42:21,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88db2a64fa9aff93711e HTTP/1.1" 200 None 2026-04-02 08:42:22,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:42:22,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb88db2a64fa9aff93711e HTTP/1.1" 200 None 2026-04-02 08:42:22,089 - lava_callback - ERROR - Error processing callback for node 69cb88db2a64fa9aff93711e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:42:22,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:22,526 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b26cb08ea23a1f6832e/lava_callback.json.gz 2026-04-02 08:42:22,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b26cb08ea23a1f6832e HTTP/1.1" 200 None 2026-04-02 08:42:22,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:42:22,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b26cb08ea23a1f6832e HTTP/1.1" 200 None 2026-04-02 08:42:22,699 - lava_callback - INFO - Completed processing callback for node 69ce2b26cb08ea23a1f6832e INFO: 172.21.0.1:36880 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:26,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:26,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:41,202 - lava_callback - INFO - Received callback for node 69ce2be1cb08ea23a1f68445 INFO: 172.21.0.1:45864 - "POST /node/69ce2be1cb08ea23a1f68445 HTTP/1.0" 202 Accepted 2026-04-02 08:42:41,211 - lava_callback - INFO - Starting async job submit for node 69ce2be1cb08ea23a1f68445 2026-04-02 08:42:41,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:41,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be1cb08ea23a1f68445 HTTP/1.1" 200 None 2026-04-02 08:42:41,272 - lava_callback - DEBUG - Processing node 69ce2be1cb08ea23a1f68445: baseline-x86 2026-04-02 08:42:41,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:41,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:41,777 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be1cb08ea23a1f68445/log.txt.gz 2026-04-02 08:42:41,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:42,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:42,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be1cb08ea23a1f68445/lava-logs.yaml 2026-04-02 08:42:42,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:42,952 - lava_callback - INFO - Received callback for node 69ce2bdecb08ea23a1f68437 INFO: 172.21.0.1:45870 - "POST /node/69ce2bdecb08ea23a1f68437 HTTP/1.0" 202 Accepted 2026-04-02 08:42:42,962 - lava_callback - INFO - Starting async job submit for node 69ce2bdecb08ea23a1f68437 2026-04-02 08:42:42,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:43,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2bdecb08ea23a1f68437 HTTP/1.1" 200 None 2026-04-02 08:42:43,023 - lava_callback - DEBUG - Processing node 69ce2bdecb08ea23a1f68437: baseline-x86 2026-04-02 08:42:43,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:43,130 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be1cb08ea23a1f68445/lava_callback.json.gz 2026-04-02 08:42:43,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:43,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be1cb08ea23a1f68445 HTTP/1.1" 200 None 2026-04-02 08:42:43,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:43,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:43,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce268acb08ea23a1f68099 HTTP/1.1" 200 None 2026-04-02 08:42:43,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:43,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2be1cb08ea23a1f68445 HTTP/1.1" 200 None 2026-04-02 08:42:43,375 - lava_callback - INFO - Completed processing callback for node 69ce2be1cb08ea23a1f68445 2026-04-02 08:42:44,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:44,147 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdecb08ea23a1f68437/log.txt.gz 2026-04-02 08:42:44,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:44,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:44,572 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdecb08ea23a1f68437/lava-logs.yaml 2026-04-02 08:42:44,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:45,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:45,358 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdecb08ea23a1f68437/lava_callback.json.gz 2026-04-02 08:42:45,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:45,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2bdecb08ea23a1f68437 HTTP/1.1" 200 None 2026-04-02 08:42:45,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:45,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce268acb08ea23a1f68099 HTTP/1.1" 200 None 2026-04-02 08:42:45,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:45,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2bdecb08ea23a1f68437 HTTP/1.1" 200 None 2026-04-02 08:42:45,491 - lava_callback - INFO - Completed processing callback for node 69ce2bdecb08ea23a1f68437 INFO: 172.21.0.1:45876 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:51,402 - lava_callback - INFO - Received callback for node 69cb89072a64fa9aff93714b INFO: 172.21.0.1:32770 - "POST /node/69cb89072a64fa9aff93714b HTTP/1.0" 202 Accepted 2026-04-02 08:42:51,411 - lava_callback - INFO - Starting async job submit for node 69cb89072a64fa9aff93714b 2026-04-02 08:42:51,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:51,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89072a64fa9aff93714b HTTP/1.1" 200 None 2026-04-02 08:42:51,430 - lava_callback - DEBUG - Processing node 69cb89072a64fa9aff93714b: baseline-arm-clabbe 2026-04-02 08:42:51,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb89072a64fa9aff93714b 2026-04-02 08:42:51,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:51,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89072a64fa9aff93714b HTTP/1.1" 200 None 2026-04-02 08:42:51,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:51,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:42:51,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:51,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb89072a64fa9aff93714b HTTP/1.1" 200 None 2026-04-02 08:42:51,508 - lava_callback - ERROR - Error processing callback for node 69cb89072a64fa9aff93714b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:56,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:56,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:43:01,064 - lava_callback - INFO - Received callback for node 69ce2b4acb08ea23a1f683a0 INFO: 172.21.0.1:57266 - "POST /node/69ce2b4acb08ea23a1f683a0 HTTP/1.0" 202 Accepted 2026-04-02 08:43:01,075 - lava_callback - INFO - Starting async job submit for node 69ce2b4acb08ea23a1f683a0 2026-04-02 08:43:01,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:01,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4acb08ea23a1f683a0 HTTP/1.1" 200 None 2026-04-02 08:43:01,138 - lava_callback - DEBUG - Processing node 69ce2b4acb08ea23a1f683a0: ltp-dio 2026-04-02 08:43:01,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:02,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:02,572 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69ce2b4acb08ea23a1f683a0/log.txt.gz 2026-04-02 08:43:02,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:03,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:03,774 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69ce2b4acb08ea23a1f683a0/lava-logs.yaml 2026-04-02 08:43:03,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:04,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:04,537 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69ce2b4acb08ea23a1f683a0/lava_callback.json.gz 2026-04-02 08:43:04,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:04,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4acb08ea23a1f683a0 HTTP/1.1" 200 None 2026-04-02 08:43:04,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:04,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:43:04,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:04,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b4acb08ea23a1f683a0 HTTP/1.1" 200 None 2026-04-02 08:43:04,663 - lava_callback - INFO - Completed processing callback for node 69ce2b4acb08ea23a1f683a0 INFO: 172.21.0.1:57270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:43:26,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:26,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:43:34,520 - lava_callback - INFO - Received callback for node 69ce2bdfcb08ea23a1f6843f INFO: 172.21.0.1:46710 - "POST /node/69ce2bdfcb08ea23a1f6843f HTTP/1.0" 202 Accepted 2026-04-02 08:43:34,534 - lava_callback - INFO - Starting async job submit for node 69ce2bdfcb08ea23a1f6843f 2026-04-02 08:43:34,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:34,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2bdfcb08ea23a1f6843f HTTP/1.1" 200 None 2026-04-02 08:43:34,592 - lava_callback - DEBUG - Processing node 69ce2bdfcb08ea23a1f6843f: baseline-x86 2026-04-02 08:43:34,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:35,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:35,331 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdfcb08ea23a1f6843f/log.txt.gz 2026-04-02 08:43:35,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:36,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:36,130 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdfcb08ea23a1f6843f/lava-logs.yaml 2026-04-02 08:43:36,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:36,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:36,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdfcb08ea23a1f6843f/lava_callback.json.gz 2026-04-02 08:43:36,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:36,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2bdfcb08ea23a1f6843f HTTP/1.1" 200 None 2026-04-02 08:43:36,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:36,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce268acb08ea23a1f68099 HTTP/1.1" 200 None 2026-04-02 08:43:36,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:36,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2bdfcb08ea23a1f6843f HTTP/1.1" 200 None 2026-04-02 08:43:36,345 - lava_callback - INFO - Completed processing callback for node 69ce2bdfcb08ea23a1f6843f INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:43:48,474 - lava_callback - INFO - Received callback for node 69ce2be0cb08ea23a1f68442 INFO: 172.21.0.1:52832 - "POST /node/69ce2be0cb08ea23a1f68442 HTTP/1.0" 202 Accepted 2026-04-02 08:43:48,484 - lava_callback - INFO - Starting async job submit for node 69ce2be0cb08ea23a1f68442 2026-04-02 08:43:48,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:48,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be0cb08ea23a1f68442 HTTP/1.1" 200 None 2026-04-02 08:43:48,544 - lava_callback - DEBUG - Processing node 69ce2be0cb08ea23a1f68442: baseline-x86 2026-04-02 08:43:48,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:49,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:49,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be0cb08ea23a1f68442/log.txt.gz 2026-04-02 08:43:49,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:49,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:49,837 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be0cb08ea23a1f68442/lava-logs.yaml 2026-04-02 08:43:49,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:50,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:50,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be0cb08ea23a1f68442/lava_callback.json.gz 2026-04-02 08:43:50,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be0cb08ea23a1f68442 HTTP/1.1" 200 None 2026-04-02 08:43:50,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce268acb08ea23a1f68099 HTTP/1.1" 200 None 2026-04-02 08:43:50,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2be0cb08ea23a1f68442 HTTP/1.1" 200 None 2026-04-02 08:43:50,536 - lava_callback - INFO - Completed processing callback for node 69ce2be0cb08ea23a1f68442 2026-04-02 08:43:50,614 - lava_callback - INFO - Received callback for node 69cb89312a64fa9aff93715a INFO: 172.21.0.1:43822 - "POST /node/69cb89312a64fa9aff93715a HTTP/1.0" 202 Accepted 2026-04-02 08:43:50,632 - lava_callback - INFO - Starting async job submit for node 69cb89312a64fa9aff93715a 2026-04-02 08:43:50,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89312a64fa9aff93715a HTTP/1.1" 200 None 2026-04-02 08:43:50,671 - lava_callback - DEBUG - Processing node 69cb89312a64fa9aff93715a: baseline-arm-clabbe 2026-04-02 08:43:50,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb89312a64fa9aff93715a 2026-04-02 08:43:50,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89312a64fa9aff93715a HTTP/1.1" 200 None 2026-04-02 08:43:50,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:43:50,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb89312a64fa9aff93715a HTTP/1.1" 200 None 2026-04-02 08:43:50,759 - lava_callback - ERROR - Error processing callback for node 69cb89312a64fa9aff93715a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43828 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:43:56,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:56,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:44:02,028 - lava_callback - INFO - Received callback for node 69ce2b27cb08ea23a1f68331 INFO: 172.21.0.1:48096 - "POST /node/69ce2b27cb08ea23a1f68331 HTTP/1.0" 202 Accepted 2026-04-02 08:44:02,034 - lava_callback - INFO - Starting async job submit for node 69ce2b27cb08ea23a1f68331 2026-04-02 08:44:02,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:02,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b27cb08ea23a1f68331 HTTP/1.1" 200 None 2026-04-02 08:44:02,070 - lava_callback - DEBUG - Processing node 69ce2b27cb08ea23a1f68331: baseline-arm-clabbe 2026-04-02 08:44:02,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:02,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:02,456 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b27cb08ea23a1f68331/log.txt.gz 2026-04-02 08:44:02,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:02,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:02,750 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b27cb08ea23a1f68331/lava-logs.yaml 2026-04-02 08:44:02,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:02,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:02,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b27cb08ea23a1f68331/lava_callback.json.gz 2026-04-02 08:44:02,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:02,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b27cb08ea23a1f68331 HTTP/1.1" 200 None 2026-04-02 08:44:02,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:02,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:44:02,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:02,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b27cb08ea23a1f68331 HTTP/1.1" 200 None 2026-04-02 08:44:02,982 - lava_callback - INFO - Completed processing callback for node 69ce2b27cb08ea23a1f68331 INFO: 172.21.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:44:26,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:26,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:44:28,037 - lava_callback - INFO - Received callback for node 69ce2b1ecb08ea23a1f6830e INFO: 172.21.0.1:40900 - "POST /node/69ce2b1ecb08ea23a1f6830e HTTP/1.0" 202 Accepted 2026-04-02 08:44:28,043 - lava_callback - INFO - Starting async job submit for node 69ce2b1ecb08ea23a1f6830e 2026-04-02 08:44:28,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:28,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1ecb08ea23a1f6830e HTTP/1.1" 200 None 2026-04-02 08:44:28,081 - lava_callback - DEBUG - Processing node 69ce2b1ecb08ea23a1f6830e: baseline-arm-broonie 2026-04-02 08:44:28,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:28,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:28,431 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1ecb08ea23a1f6830e/log.txt.gz 2026-04-02 08:44:28,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:28,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:28,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1ecb08ea23a1f6830e/lava-logs.yaml 2026-04-02 08:44:28,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:28,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:28,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1ecb08ea23a1f6830e/lava_callback.json.gz 2026-04-02 08:44:28,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:28,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1ecb08ea23a1f6830e HTTP/1.1" 200 None 2026-04-02 08:44:28,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:28,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:44:28,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:28,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b1ecb08ea23a1f6830e HTTP/1.1" 200 None 2026-04-02 08:44:28,984 - lava_callback - INFO - Completed processing callback for node 69ce2b1ecb08ea23a1f6830e INFO: 172.21.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38630 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:44:56,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:56,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:45:30,834 - lava_callback - INFO - Received callback for node 69cb89a62a64fa9aff937187 INFO: 172.21.0.1:60078 - "POST /node/69cb89a62a64fa9aff937187 HTTP/1.0" 202 Accepted 2026-04-02 08:45:30,843 - lava_callback - INFO - Starting async job submit for node 69cb89a62a64fa9aff937187 2026-04-02 08:45:30,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:45:30,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89a62a64fa9aff937187 HTTP/1.1" 200 None 2026-04-02 08:45:30,872 - lava_callback - DEBUG - Processing node 69cb89a62a64fa9aff937187: baseline-arm-clabbe 2026-04-02 08:45:30,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb89a62a64fa9aff937187 2026-04-02 08:45:30,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:45:30,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89a62a64fa9aff937187 HTTP/1.1" 200 None 2026-04-02 08:45:30,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:45:30,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:45:30,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:45:30,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb89a62a64fa9aff937187 HTTP/1.1" 200 None 2026-04-02 08:45:30,994 - lava_callback - ERROR - Error processing callback for node 69cb89a62a64fa9aff937187: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:47:49,840 - lava_callback - INFO - Received callback for node 69ce2b5bcb08ea23a1f683ba INFO: 172.21.0.1:56968 - "POST /node/69ce2b5bcb08ea23a1f683ba HTTP/1.0" 202 Accepted 2026-04-02 08:47:49,848 - lava_callback - INFO - Starting async job submit for node 69ce2b5bcb08ea23a1f683ba 2026-04-02 08:47:49,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:47:49,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5bcb08ea23a1f683ba HTTP/1.1" 200 None 2026-04-02 08:47:49,898 - lava_callback - DEBUG - Processing node 69ce2b5bcb08ea23a1f683ba: ltp-syscalls 2026-04-02 08:47:50,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:47:50,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:47:50,975 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ce2b5bcb08ea23a1f683ba/log.txt.gz 2026-04-02 08:47:51,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:47:51,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:47:51,743 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ce2b5bcb08ea23a1f683ba/lava-logs.yaml 2026-04-02 08:47:51,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:47:51,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:47:51,926 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ce2b5bcb08ea23a1f683ba/lava_callback.json.gz 2026-04-02 08:47:51,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:47:52,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5bcb08ea23a1f683ba HTTP/1.1" 200 None 2026-04-02 08:47:52,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:47:52,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:47:52,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:47:52,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b5bcb08ea23a1f683ba HTTP/1.1" 200 None 2026-04-02 08:47:52,061 - lava_callback - INFO - Completed processing callback for node 69ce2b5bcb08ea23a1f683ba INFO: 172.21.0.1:56972 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:47:56,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:47:56,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:48:13,166 - lava_callback - INFO - Received callback for node 69ce2d37cb08ea23a1f68514 INFO: 172.21.0.1:33546 - "POST /node/69ce2d37cb08ea23a1f68514 HTTP/1.0" 202 Accepted 2026-04-02 08:48:13,171 - lava_callback - INFO - Starting async job submit for node 69ce2d37cb08ea23a1f68514 2026-04-02 08:48:13,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:48:13,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2d37cb08ea23a1f68514 HTTP/1.1" 200 None 2026-04-02 08:48:13,201 - lava_callback - DEBUG - Processing node 69ce2d37cb08ea23a1f68514: baseline-arm 2026-04-02 08:48:13,206 - lava_callback - WARNING - Failed to upload log 2026-04-02 08:48:13,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:48:13,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:48:13,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2d37cb08ea23a1f68514/lava-logs.yaml 2026-04-02 08:48:13,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:48:13,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:48:13,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2d37cb08ea23a1f68514/lava_callback.json.gz 2026-04-02 08:48:13,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:48:13,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2d37cb08ea23a1f68514 HTTP/1.1" 200 None 2026-04-02 08:48:13,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:48:13,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:48:13,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:48:13,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2d37cb08ea23a1f68514 HTTP/1.1" 200 None 2026-04-02 08:48:13,533 - lava_callback - INFO - Completed processing callback for node 69ce2d37cb08ea23a1f68514 INFO: 172.21.0.1:33550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:48:26,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:48:26,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:49:22,261 - lava_callback - INFO - Received callback for node 69cb8a8a2a64fa9aff9371f6 INFO: 172.21.0.1:33350 - "POST /node/69cb8a8a2a64fa9aff9371f6 HTTP/1.0" 202 Accepted 2026-04-02 08:49:22,266 - lava_callback - INFO - Starting async job submit for node 69cb8a8a2a64fa9aff9371f6 2026-04-02 08:49:22,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:49:22,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8a8a2a64fa9aff9371f6 HTTP/1.1" 200 None 2026-04-02 08:49:22,282 - lava_callback - DEBUG - Processing node 69cb8a8a2a64fa9aff9371f6: baseline-arm-baylibre 2026-04-02 08:49:22,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8a8a2a64fa9aff9371f6 2026-04-02 08:49:22,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:49:22,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8a8a2a64fa9aff9371f6 HTTP/1.1" 200 None 2026-04-02 08:49:22,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:49:22,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:49:22,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:49:22,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8a8a2a64fa9aff9371f6 HTTP/1.1" 200 None 2026-04-02 08:49:22,366 - lava_callback - ERROR - Error processing callback for node 69cb8a8a2a64fa9aff9371f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:50:02,258 - lava_callback - INFO - Received callback for node 69cb8ab32a64fa9aff937201 INFO: 172.21.0.1:55952 - "POST /node/69cb8ab32a64fa9aff937201 HTTP/1.0" 202 Accepted 2026-04-02 08:50:02,267 - lava_callback - INFO - Starting async job submit for node 69cb8ab32a64fa9aff937201 2026-04-02 08:50:02,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:02,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8ab32a64fa9aff937201 HTTP/1.1" 200 None 2026-04-02 08:50:02,284 - lava_callback - DEBUG - Processing node 69cb8ab32a64fa9aff937201: baseline-arm-baylibre 2026-04-02 08:50:02,284 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8ab32a64fa9aff937201 2026-04-02 08:50:02,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:02,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8ab32a64fa9aff937201 HTTP/1.1" 200 None 2026-04-02 08:50:02,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:02,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:50:02,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:02,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8ab32a64fa9aff937201 HTTP/1.1" 200 None 2026-04-02 08:50:02,347 - lava_callback - ERROR - Error processing callback for node 69cb8ab32a64fa9aff937201: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55966 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:50:08,336 - lava_callback - INFO - Received callback for node 69ce2b1acb08ea23a1f68305 INFO: 172.21.0.1:55968 - "POST /node/69ce2b1acb08ea23a1f68305 HTTP/1.0" 202 Accepted 2026-04-02 08:50:08,343 - lava_callback - INFO - Starting async job submit for node 69ce2b1acb08ea23a1f68305 2026-04-02 08:50:08,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:08,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1acb08ea23a1f68305 HTTP/1.1" 200 None 2026-04-02 08:50:08,392 - lava_callback - DEBUG - Processing node 69ce2b1acb08ea23a1f68305: baseline-arm-broonie 2026-04-02 08:50:08,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:50:08,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:50:08,836 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1acb08ea23a1f68305/log.txt.gz 2026-04-02 08:50:08,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:50:09,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:50:09,172 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1acb08ea23a1f68305/lava-logs.yaml 2026-04-02 08:50:09,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:50:09,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:50:09,325 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1acb08ea23a1f68305/lava_callback.json.gz 2026-04-02 08:50:09,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:09,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1acb08ea23a1f68305 HTTP/1.1" 200 None 2026-04-02 08:50:09,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:09,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:50:09,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:09,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b1acb08ea23a1f68305 HTTP/1.1" 200 None 2026-04-02 08:50:09,406 - lava_callback - INFO - Completed processing callback for node 69ce2b1acb08ea23a1f68305 INFO: 172.21.0.1:43112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:50:26,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:26,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46568 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:51:22,384 - lava_callback - INFO - Received callback for node 69cb8b032a64fa9aff937223 INFO: 172.21.0.1:49948 - "POST /node/69cb8b032a64fa9aff937223 HTTP/1.0" 202 Accepted 2026-04-02 08:51:22,389 - lava_callback - INFO - Starting async job submit for node 69cb8b032a64fa9aff937223 2026-04-02 08:51:22,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:51:22,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b032a64fa9aff937223 HTTP/1.1" 200 None 2026-04-02 08:51:22,414 - lava_callback - DEBUG - Processing node 69cb8b032a64fa9aff937223: baseline-arm-baylibre 2026-04-02 08:51:22,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8b032a64fa9aff937223 2026-04-02 08:51:22,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:51:22,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b032a64fa9aff937223 HTTP/1.1" 200 None 2026-04-02 08:51:22,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:51:22,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:51:22,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:51:22,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8b032a64fa9aff937223 HTTP/1.1" 200 None 2026-04-02 08:51:22,497 - lava_callback - ERROR - Error processing callback for node 69cb8b032a64fa9aff937223: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38474 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:52:42,451 - lava_callback - INFO - Received callback for node 69cb8b4f2a64fa9aff937258 INFO: 172.21.0.1:37060 - "POST /node/69cb8b4f2a64fa9aff937258 HTTP/1.0" 202 Accepted 2026-04-02 08:52:42,461 - lava_callback - INFO - Starting async job submit for node 69cb8b4f2a64fa9aff937258 2026-04-02 08:52:42,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:52:42,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b4f2a64fa9aff937258 HTTP/1.1" 200 None 2026-04-02 08:52:42,488 - lava_callback - DEBUG - Processing node 69cb8b4f2a64fa9aff937258: baseline-arm-baylibre 2026-04-02 08:52:42,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8b4f2a64fa9aff937258 2026-04-02 08:52:42,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:52:42,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b4f2a64fa9aff937258 HTTP/1.1" 200 None 2026-04-02 08:52:42,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:52:42,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:52:42,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:52:42,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8b4f2a64fa9aff937258 HTTP/1.1" 200 None 2026-04-02 08:52:42,564 - lava_callback - ERROR - Error processing callback for node 69cb8b4f2a64fa9aff937258: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:53:22,451 - lava_callback - INFO - Received callback for node 69cb8b762a64fa9aff937270 INFO: 172.21.0.1:50448 - "POST /node/69cb8b762a64fa9aff937270 HTTP/1.0" 202 Accepted 2026-04-02 08:53:22,457 - lava_callback - INFO - Starting async job submit for node 69cb8b762a64fa9aff937270 2026-04-02 08:53:22,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:53:22,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b762a64fa9aff937270 HTTP/1.1" 200 None 2026-04-02 08:53:22,484 - lava_callback - DEBUG - Processing node 69cb8b762a64fa9aff937270: baseline-arm-baylibre 2026-04-02 08:53:22,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8b762a64fa9aff937270 2026-04-02 08:53:22,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:53:22,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b762a64fa9aff937270 HTTP/1.1" 200 None 2026-04-02 08:53:22,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:53:22,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:53:22,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:53:22,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8b762a64fa9aff937270 HTTP/1.1" 200 None 2026-04-02 08:53:22,573 - lava_callback - ERROR - Error processing callback for node 69cb8b762a64fa9aff937270: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44644 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:54:05,627 - lava_callback - INFO - Received callback for node 69ce2a0fcb08ea23a1f68281 INFO: 172.21.0.1:35318 - "POST /node/69ce2a0fcb08ea23a1f68281 HTTP/1.0" 202 Accepted 2026-04-02 08:54:05,639 - lava_callback - INFO - Starting async job submit for node 69ce2a0fcb08ea23a1f68281 2026-04-02 08:54:05,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:05,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2a0fcb08ea23a1f68281 HTTP/1.1" 200 None 2026-04-02 08:54:05,769 - lava_callback - DEBUG - Processing node 69ce2a0fcb08ea23a1f68281: ltp-smoke 2026-04-02 08:54:06,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:54:06,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:06,650 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2a0fcb08ea23a1f68281/log.txt.gz 2026-04-02 08:54:07,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:07,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:07,274 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2a0fcb08ea23a1f68281/lava-logs.yaml 2026-04-02 08:54:07,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:07,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:07,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2a0fcb08ea23a1f68281/lava_callback.json.gz 2026-04-02 08:54:07,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:07,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2a0fcb08ea23a1f68281 HTTP/1.1" 200 None 2026-04-02 08:54:07,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:07,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce266ecb08ea23a1f68074 HTTP/1.1" 200 None 2026-04-02 08:54:07,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:07,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2a0fcb08ea23a1f68281 HTTP/1.1" 200 None 2026-04-02 08:54:07,986 - lava_callback - INFO - Completed processing callback for node 69ce2a0fcb08ea23a1f68281 INFO: 172.21.0.1:36206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:54:26,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:26,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:54:28,879 - lava_callback - INFO - Received callback for node 69ce2b43cb08ea23a1f6837f INFO: 172.21.0.1:42162 - "POST /node/69ce2b43cb08ea23a1f6837f HTTP/1.0" 202 Accepted 2026-04-02 08:54:28,887 - lava_callback - INFO - Starting async job submit for node 69ce2b43cb08ea23a1f6837f 2026-04-02 08:54:28,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:28,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b43cb08ea23a1f6837f HTTP/1.1" 200 None 2026-04-02 08:54:28,927 - lava_callback - DEBUG - Processing node 69ce2b43cb08ea23a1f6837f: ltp-cap_bounds 2026-04-02 08:54:29,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:29,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:29,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ce2b43cb08ea23a1f6837f/log.txt.gz 2026-04-02 08:54:29,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:29,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:29,994 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ce2b43cb08ea23a1f6837f/lava-logs.yaml 2026-04-02 08:54:30,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:30,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:30,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ce2b43cb08ea23a1f6837f/lava_callback.json.gz 2026-04-02 08:54:30,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:30,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b43cb08ea23a1f6837f HTTP/1.1" 200 None 2026-04-02 08:54:30,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:30,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:54:30,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:30,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b43cb08ea23a1f6837f HTTP/1.1" 200 None 2026-04-02 08:54:30,296 - lava_callback - INFO - Completed processing callback for node 69ce2b43cb08ea23a1f6837f INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57270 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:54:56,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:56,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:54:58,013 - lava_callback - INFO - Received callback for node 69ce2b0bcb08ea23a1f682d5 INFO: 172.21.0.1:57274 - "POST /node/69ce2b0bcb08ea23a1f682d5 HTTP/1.0" 202 Accepted 2026-04-02 08:54:58,020 - lava_callback - INFO - Starting async job submit for node 69ce2b0bcb08ea23a1f682d5 2026-04-02 08:54:58,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:58,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0bcb08ea23a1f682d5 HTTP/1.1" 200 None 2026-04-02 08:54:58,091 - lava_callback - DEBUG - Processing node 69ce2b0bcb08ea23a1f682d5: baseline-arm 2026-04-02 08:54:58,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:58,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:58,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0bcb08ea23a1f682d5/log.txt.gz 2026-04-02 08:54:59,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:59,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:59,491 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0bcb08ea23a1f682d5/lava-logs.yaml 2026-04-02 08:54:59,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:59,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:59,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0bcb08ea23a1f682d5/lava_callback.json.gz DEBUG: Setup failed for 69ce2b0bcb08ea23a1f682d5. Transitting job node result: incomplete -> fail 2026-04-02 08:54:59,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:59,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0bcb08ea23a1f682d5 HTTP/1.1" 200 None 2026-04-02 08:54:59,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:59,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:54:59,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:59,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b0bcb08ea23a1f682d5 HTTP/1.1" 200 None 2026-04-02 08:55:00,092 - lava_callback - INFO - Completed processing callback for node 69ce2b0bcb08ea23a1f682d5 INFO: 172.21.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:55:22,774 - lava_callback - INFO - Received callback for node 69cb8bec2a64fa9aff9372d1 INFO: 172.21.0.1:33852 - "POST /node/69cb8bec2a64fa9aff9372d1 HTTP/1.0" 202 Accepted 2026-04-02 08:55:22,779 - lava_callback - INFO - Starting async job submit for node 69cb8bec2a64fa9aff9372d1 2026-04-02 08:55:22,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:22,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8bec2a64fa9aff9372d1 HTTP/1.1" 200 None 2026-04-02 08:55:22,800 - lava_callback - DEBUG - Processing node 69cb8bec2a64fa9aff9372d1: baseline-arm-baylibre 2026-04-02 08:55:22,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8bec2a64fa9aff9372d1 2026-04-02 08:55:22,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:22,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8bec2a64fa9aff9372d1 HTTP/1.1" 200 None 2026-04-02 08:55:22,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:22,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:55:22,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:22,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8bec2a64fa9aff9372d1 HTTP/1.1" 200 None 2026-04-02 08:55:22,855 - lava_callback - ERROR - Error processing callback for node 69cb8bec2a64fa9aff9372d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:55:26,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:26,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:55:42,548 - lava_callback - INFO - Received callback for node 69cb8c052a64fa9aff937338 INFO: 172.21.0.1:32958 - "POST /node/69cb8c052a64fa9aff937338 HTTP/1.0" 202 Accepted 2026-04-02 08:55:42,554 - lava_callback - INFO - Starting async job submit for node 69cb8c052a64fa9aff937338 2026-04-02 08:55:42,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:42,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c052a64fa9aff937338 HTTP/1.1" 200 None 2026-04-02 08:55:42,570 - lava_callback - DEBUG - Processing node 69cb8c052a64fa9aff937338: baseline-arm64-baylibre 2026-04-02 08:55:42,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c052a64fa9aff937338 2026-04-02 08:55:42,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:42,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c052a64fa9aff937338 HTTP/1.1" 200 None 2026-04-02 08:55:42,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:42,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:55:42,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:42,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c052a64fa9aff937338 HTTP/1.1" 200 None 2026-04-02 08:55:42,629 - lava_callback - ERROR - Error processing callback for node 69cb8c052a64fa9aff937338: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:55:43,213 - lava_callback - INFO - Received callback for node 69cb8c072a64fa9aff93733b INFO: 172.21.0.1:32966 - "POST /node/69cb8c072a64fa9aff93733b HTTP/1.0" 202 Accepted 2026-04-02 08:55:43,219 - lava_callback - INFO - Starting async job submit for node 69cb8c072a64fa9aff93733b 2026-04-02 08:55:43,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c072a64fa9aff93733b HTTP/1.1" 200 None 2026-04-02 08:55:43,238 - lava_callback - DEBUG - Processing node 69cb8c072a64fa9aff93733b: baseline-arm64-baylibre 2026-04-02 08:55:43,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c072a64fa9aff93733b 2026-04-02 08:55:43,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c072a64fa9aff93733b HTTP/1.1" 200 None 2026-04-02 08:55:43,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:55:43,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c072a64fa9aff93733b HTTP/1.1" 200 None 2026-04-02 08:55:43,303 - lava_callback - ERROR - Error processing callback for node 69cb8c072a64fa9aff93733b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:55:43,884 - lava_callback - INFO - Received callback for node 69cb8c082a64fa9aff93733e INFO: 172.21.0.1:32976 - "POST /node/69cb8c082a64fa9aff93733e HTTP/1.0" 202 Accepted 2026-04-02 08:55:43,890 - lava_callback - INFO - Starting async job submit for node 69cb8c082a64fa9aff93733e 2026-04-02 08:55:43,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c082a64fa9aff93733e HTTP/1.1" 200 None 2026-04-02 08:55:43,905 - lava_callback - DEBUG - Processing node 69cb8c082a64fa9aff93733e: baseline-arm64-baylibre 2026-04-02 08:55:43,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c082a64fa9aff93733e 2026-04-02 08:55:43,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c082a64fa9aff93733e HTTP/1.1" 200 None 2026-04-02 08:55:43,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:55:43,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c082a64fa9aff93733e HTTP/1.1" 200 None 2026-04-02 08:55:43,957 - lava_callback - ERROR - Error processing callback for node 69cb8c082a64fa9aff93733e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:55:44,524 - lava_callback - INFO - Received callback for node 69cb8c0b2a64fa9aff93734f INFO: 172.21.0.1:32978 - "POST /node/69cb8c0b2a64fa9aff93734f HTTP/1.0" 202 Accepted 2026-04-02 08:55:44,529 - lava_callback - INFO - Starting async job submit for node 69cb8c0b2a64fa9aff93734f 2026-04-02 08:55:44,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:44,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0b2a64fa9aff93734f HTTP/1.1" 200 None 2026-04-02 08:55:44,544 - lava_callback - DEBUG - Processing node 69cb8c0b2a64fa9aff93734f: baseline-arm64-baylibre 2026-04-02 08:55:44,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c0b2a64fa9aff93734f 2026-04-02 08:55:44,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:44,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0b2a64fa9aff93734f HTTP/1.1" 200 None 2026-04-02 08:55:44,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:44,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:55:44,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:44,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c0b2a64fa9aff93734f HTTP/1.1" 200 None 2026-04-02 08:55:44,602 - lava_callback - ERROR - Error processing callback for node 69cb8c0b2a64fa9aff93734f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:55:45,170 - lava_callback - INFO - Received callback for node 69cb8c0c2a64fa9aff937352 INFO: 172.21.0.1:32984 - "POST /node/69cb8c0c2a64fa9aff937352 HTTP/1.0" 202 Accepted 2026-04-02 08:55:45,175 - lava_callback - INFO - Starting async job submit for node 69cb8c0c2a64fa9aff937352 2026-04-02 08:55:45,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:45,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0c2a64fa9aff937352 HTTP/1.1" 200 None 2026-04-02 08:55:45,198 - lava_callback - DEBUG - Processing node 69cb8c0c2a64fa9aff937352: baseline-arm64-baylibre 2026-04-02 08:55:45,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c0c2a64fa9aff937352 2026-04-02 08:55:45,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:45,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0c2a64fa9aff937352 HTTP/1.1" 200 None 2026-04-02 08:55:45,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:45,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:55:45,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:45,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c0c2a64fa9aff937352 HTTP/1.1" 200 None 2026-04-02 08:55:45,254 - lava_callback - ERROR - Error processing callback for node 69cb8c0c2a64fa9aff937352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:56:02,558 - lava_callback - INFO - Received callback for node 69cb8c0e2a64fa9aff937355 INFO: 172.21.0.1:42742 - "POST /node/69cb8c0e2a64fa9aff937355 HTTP/1.0" 202 Accepted 2026-04-02 08:56:02,563 - lava_callback - INFO - Starting async job submit for node 69cb8c0e2a64fa9aff937355 2026-04-02 08:56:02,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:02,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0e2a64fa9aff937355 HTTP/1.1" 200 None 2026-04-02 08:56:02,579 - lava_callback - DEBUG - Processing node 69cb8c0e2a64fa9aff937355: baseline-arm64-baylibre 2026-04-02 08:56:02,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c0e2a64fa9aff937355 2026-04-02 08:56:02,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:02,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0e2a64fa9aff937355 HTTP/1.1" 200 None 2026-04-02 08:56:02,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:02,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:02,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:02,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c0e2a64fa9aff937355 HTTP/1.1" 200 None 2026-04-02 08:56:02,646 - lava_callback - ERROR - Error processing callback for node 69cb8c0e2a64fa9aff937355: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:56:11,147 - lava_callback - INFO - Received callback for node 69cb8c1f2a64fa9aff937394 INFO: 172.21.0.1:36288 - "POST /node/69cb8c1f2a64fa9aff937394 HTTP/1.0" 202 Accepted 2026-04-02 08:56:11,153 - lava_callback - INFO - Starting async job submit for node 69cb8c1f2a64fa9aff937394 2026-04-02 08:56:11,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c1f2a64fa9aff937394 HTTP/1.1" 200 None 2026-04-02 08:56:11,169 - lava_callback - DEBUG - Processing node 69cb8c1f2a64fa9aff937394: baseline-arm64-clabbe 2026-04-02 08:56:11,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c1f2a64fa9aff937394 2026-04-02 08:56:11,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c1f2a64fa9aff937394 HTTP/1.1" 200 None 2026-04-02 08:56:11,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:11,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c1f2a64fa9aff937394 HTTP/1.1" 200 None 2026-04-02 08:56:11,250 - lava_callback - ERROR - Error processing callback for node 69cb8c1f2a64fa9aff937394: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:56:11,786 - lava_callback - INFO - Received callback for node 69cb8c202a64fa9aff937397 INFO: 172.21.0.1:36302 - "POST /node/69cb8c202a64fa9aff937397 HTTP/1.0" 202 Accepted 2026-04-02 08:56:11,792 - lava_callback - INFO - Starting async job submit for node 69cb8c202a64fa9aff937397 2026-04-02 08:56:11,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c202a64fa9aff937397 HTTP/1.1" 200 None 2026-04-02 08:56:11,807 - lava_callback - DEBUG - Processing node 69cb8c202a64fa9aff937397: baseline-arm64-clabbe 2026-04-02 08:56:11,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c202a64fa9aff937397 2026-04-02 08:56:11,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c202a64fa9aff937397 HTTP/1.1" 200 None 2026-04-02 08:56:11,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:11,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c202a64fa9aff937397 HTTP/1.1" 200 None 2026-04-02 08:56:11,871 - lava_callback - ERROR - Error processing callback for node 69cb8c202a64fa9aff937397: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:56:12,427 - lava_callback - INFO - Received callback for node 69cb8c212a64fa9aff93739a INFO: 172.21.0.1:36310 - "POST /node/69cb8c212a64fa9aff93739a HTTP/1.0" 202 Accepted 2026-04-02 08:56:12,433 - lava_callback - INFO - Starting async job submit for node 69cb8c212a64fa9aff93739a 2026-04-02 08:56:12,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:12,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c212a64fa9aff93739a HTTP/1.1" 200 None 2026-04-02 08:56:12,449 - lava_callback - DEBUG - Processing node 69cb8c212a64fa9aff93739a: baseline-arm64-clabbe 2026-04-02 08:56:12,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c212a64fa9aff93739a 2026-04-02 08:56:12,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:12,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c212a64fa9aff93739a HTTP/1.1" 200 None 2026-04-02 08:56:12,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:12,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:12,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:12,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c212a64fa9aff93739a HTTP/1.1" 200 None 2026-04-02 08:56:12,503 - lava_callback - ERROR - Error processing callback for node 69cb8c212a64fa9aff93739a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:56:13,097 - lava_callback - INFO - Received callback for node 69cb8c222a64fa9aff93739d INFO: 172.21.0.1:36318 - "POST /node/69cb8c222a64fa9aff93739d HTTP/1.0" 202 Accepted 2026-04-02 08:56:13,102 - lava_callback - INFO - Starting async job submit for node 69cb8c222a64fa9aff93739d 2026-04-02 08:56:13,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c222a64fa9aff93739d HTTP/1.1" 200 None 2026-04-02 08:56:13,118 - lava_callback - DEBUG - Processing node 69cb8c222a64fa9aff93739d: baseline-arm64-clabbe 2026-04-02 08:56:13,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c222a64fa9aff93739d 2026-04-02 08:56:13,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c222a64fa9aff93739d HTTP/1.1" 200 None 2026-04-02 08:56:13,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:13,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c222a64fa9aff93739d HTTP/1.1" 200 None 2026-04-02 08:56:13,210 - lava_callback - ERROR - Error processing callback for node 69cb8c222a64fa9aff93739d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:56:13,764 - lava_callback - INFO - Received callback for node 69cb8c252a64fa9aff9373a6 INFO: 172.21.0.1:36324 - "POST /node/69cb8c252a64fa9aff9373a6 HTTP/1.0" 202 Accepted 2026-04-02 08:56:13,769 - lava_callback - INFO - Starting async job submit for node 69cb8c252a64fa9aff9373a6 2026-04-02 08:56:13,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c252a64fa9aff9373a6 HTTP/1.1" 200 None 2026-04-02 08:56:13,786 - lava_callback - DEBUG - Processing node 69cb8c252a64fa9aff9373a6: baseline-arm64-clabbe 2026-04-02 08:56:13,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c252a64fa9aff9373a6 2026-04-02 08:56:13,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c252a64fa9aff9373a6 HTTP/1.1" 200 None 2026-04-02 08:56:13,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:13,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c252a64fa9aff9373a6 HTTP/1.1" 200 None 2026-04-02 08:56:13,847 - lava_callback - ERROR - Error processing callback for node 69cb8c252a64fa9aff9373a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:56:14,414 - lava_callback - INFO - Received callback for node 69cb8c242a64fa9aff9373a3 INFO: 172.21.0.1:36328 - "POST /node/69cb8c242a64fa9aff9373a3 HTTP/1.0" 202 Accepted 2026-04-02 08:56:14,419 - lava_callback - INFO - Starting async job submit for node 69cb8c242a64fa9aff9373a3 2026-04-02 08:56:14,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:14,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c242a64fa9aff9373a3 HTTP/1.1" 200 None 2026-04-02 08:56:14,435 - lava_callback - DEBUG - Processing node 69cb8c242a64fa9aff9373a3: baseline-arm64-clabbe 2026-04-02 08:56:14,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c242a64fa9aff9373a3 2026-04-02 08:56:14,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:14,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c242a64fa9aff9373a3 HTTP/1.1" 200 None 2026-04-02 08:56:14,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:14,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:14,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:14,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c242a64fa9aff9373a3 HTTP/1.1" 200 None 2026-04-02 08:56:14,492 - lava_callback - ERROR - Error processing callback for node 69cb8c242a64fa9aff9373a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:56:28,529 - lava_callback - INFO - Received callback for node 69ce2b44cb08ea23a1f68382 INFO: 172.21.0.1:56922 - "POST /node/69ce2b44cb08ea23a1f68382 HTTP/1.0" 202 Accepted 2026-04-02 08:56:28,536 - lava_callback - INFO - Starting async job submit for node 69ce2b44cb08ea23a1f68382 2026-04-02 08:56:28,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:28,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b44cb08ea23a1f68382 HTTP/1.1" 200 None 2026-04-02 08:56:28,577 - lava_callback - DEBUG - Processing node 69ce2b44cb08ea23a1f68382: ltp-containers 2026-04-02 08:56:28,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:56:29,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:56:29,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69ce2b44cb08ea23a1f68382/log.txt.gz 2026-04-02 08:56:29,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:56:29,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:56:29,653 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69ce2b44cb08ea23a1f68382/lava-logs.yaml 2026-04-02 08:56:29,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:56:29,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:56:29,928 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69ce2b44cb08ea23a1f68382/lava_callback.json.gz 2026-04-02 08:56:29,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:29,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b44cb08ea23a1f68382 HTTP/1.1" 200 None 2026-04-02 08:56:29,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:29,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:56:29,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:30,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b44cb08ea23a1f68382 HTTP/1.1" 200 None 2026-04-02 08:56:30,015 - lava_callback - INFO - Completed processing callback for node 69ce2b44cb08ea23a1f68382 INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:56:51,143 - lava_callback - INFO - Received callback for node 69cb8c3c2a64fa9aff9373e5 INFO: 172.21.0.1:39070 - "POST /node/69cb8c3c2a64fa9aff9373e5 HTTP/1.0" 202 Accepted 2026-04-02 08:56:51,148 - lava_callback - INFO - Starting async job submit for node 69cb8c3c2a64fa9aff9373e5 2026-04-02 08:56:51,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:51,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c3c2a64fa9aff9373e5 HTTP/1.1" 200 None 2026-04-02 08:56:51,168 - lava_callback - DEBUG - Processing node 69cb8c3c2a64fa9aff9373e5: baseline-arm-clabbe 2026-04-02 08:56:51,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c3c2a64fa9aff9373e5 2026-04-02 08:56:51,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:51,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c3c2a64fa9aff9373e5 HTTP/1.1" 200 None 2026-04-02 08:56:51,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:51,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:56:51,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:51,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c3c2a64fa9aff9373e5 HTTP/1.1" 200 None 2026-04-02 08:56:51,223 - lava_callback - ERROR - Error processing callback for node 69cb8c3c2a64fa9aff9373e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:56:56,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:56,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42356 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:57:45,328 - lava_callback - INFO - Received callback for node 69ce2b46cb08ea23a1f68386 INFO: 172.21.0.1:46084 - "POST /node/69ce2b46cb08ea23a1f68386 HTTP/1.0" 202 Accepted 2026-04-02 08:57:45,335 - lava_callback - INFO - Starting async job submit for node 69ce2b46cb08ea23a1f68386 2026-04-02 08:57:45,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:45,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b46cb08ea23a1f68386 HTTP/1.1" 200 None 2026-04-02 08:57:45,377 - lava_callback - DEBUG - Processing node 69ce2b46cb08ea23a1f68386: ltp-controllers 2026-04-02 08:57:45,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:57:45,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:57:45,996 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69ce2b46cb08ea23a1f68386/log.txt.gz 2026-04-02 08:57:46,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:57:46,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:57:46,478 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69ce2b46cb08ea23a1f68386/lava-logs.yaml 2026-04-02 08:57:46,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:46100 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:57:46,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:57:46,647 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69ce2b46cb08ea23a1f68386/lava_callback.json.gz 2026-04-02 08:57:46,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:46,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b46cb08ea23a1f68386 HTTP/1.1" 200 None 2026-04-02 08:57:46,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:46,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:57:46,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:46,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b46cb08ea23a1f68386 HTTP/1.1" 200 None 2026-04-02 08:57:46,749 - lava_callback - INFO - Completed processing callback for node 69ce2b46cb08ea23a1f68386 2026-04-02 08:57:51,222 - lava_callback - INFO - Received callback for node 69cb8c892a64fa9aff93749e INFO: 172.21.0.1:57512 - "POST /node/69cb8c892a64fa9aff93749e HTTP/1.0" 202 Accepted 2026-04-02 08:57:51,227 - lava_callback - INFO - Starting async job submit for node 69cb8c892a64fa9aff93749e 2026-04-02 08:57:51,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:51,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c892a64fa9aff93749e HTTP/1.1" 200 None 2026-04-02 08:57:51,273 - lava_callback - DEBUG - Processing node 69cb8c892a64fa9aff93749e: baseline-arm-clabbe 2026-04-02 08:57:51,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c892a64fa9aff93749e 2026-04-02 08:57:51,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:51,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c892a64fa9aff93749e HTTP/1.1" 200 None 2026-04-02 08:57:51,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:51,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:57:51,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:51,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c892a64fa9aff93749e HTTP/1.1" 200 None 2026-04-02 08:57:51,333 - lava_callback - ERROR - Error processing callback for node 69cb8c892a64fa9aff93749e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57526 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:57:56,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:56,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:58:08,547 - lava_callback - INFO - Received callback for node 69ce2b48cb08ea23a1f68389 INFO: 172.21.0.1:41192 - "POST /node/69ce2b48cb08ea23a1f68389 HTTP/1.0" 202 Accepted 2026-04-02 08:58:08,553 - lava_callback - INFO - Starting async job submit for node 69ce2b48cb08ea23a1f68389 2026-04-02 08:58:08,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:08,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b48cb08ea23a1f68389 HTTP/1.1" 200 None 2026-04-02 08:58:08,593 - lava_callback - DEBUG - Processing node 69ce2b48cb08ea23a1f68389: ltp-cve 2026-04-02 08:58:08,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:58:09,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:09,096 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69ce2b48cb08ea23a1f68389/log.txt.gz 2026-04-02 08:58:09,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:58:09,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:09,558 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69ce2b48cb08ea23a1f68389/lava-logs.yaml 2026-04-02 08:58:09,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:58:09,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:09,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69ce2b48cb08ea23a1f68389/lava_callback.json.gz 2026-04-02 08:58:09,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:09,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b48cb08ea23a1f68389 HTTP/1.1" 200 None 2026-04-02 08:58:09,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:09,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:58:09,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:09,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b48cb08ea23a1f68389 HTTP/1.1" 200 None 2026-04-02 08:58:09,845 - lava_callback - INFO - Completed processing callback for node 69ce2b48cb08ea23a1f68389 INFO: 172.21.0.1:38234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:58:26,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:26,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:58:29,359 - lava_callback - INFO - Received callback for node 69ce2b4bcb08ea23a1f683a3 INFO: 172.21.0.1:51808 - "POST /node/69ce2b4bcb08ea23a1f683a3 HTTP/1.0" 202 Accepted 2026-04-02 08:58:29,365 - lava_callback - INFO - Starting async job submit for node 69ce2b4bcb08ea23a1f683a3 2026-04-02 08:58:29,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:29,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4bcb08ea23a1f683a3 HTTP/1.1" 200 None 2026-04-02 08:58:29,410 - lava_callback - DEBUG - Processing node 69ce2b4bcb08ea23a1f683a3: ltp-fs_bind 2026-04-02 08:58:29,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:58:29,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:29,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ce2b4bcb08ea23a1f683a3/log.txt.gz 2026-04-02 08:58:30,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:58:30,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:30,390 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ce2b4bcb08ea23a1f683a3/lava-logs.yaml 2026-04-02 08:58:30,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:58:30,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:30,561 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ce2b4bcb08ea23a1f683a3/lava_callback.json.gz 2026-04-02 08:58:30,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:30,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4bcb08ea23a1f683a3 HTTP/1.1" 200 None 2026-04-02 08:58:30,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:30,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:58:30,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:30,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b4bcb08ea23a1f683a3 HTTP/1.1" 200 None 2026-04-02 08:58:30,660 - lava_callback - INFO - Completed processing callback for node 69ce2b4bcb08ea23a1f683a3 INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:58:56,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:56,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:59:08,699 - lava_callback - INFO - Received callback for node 69ce2fcacb08ea23a1f68640 INFO: 172.21.0.1:58954 - "POST /node/69ce2fcacb08ea23a1f68640 HTTP/1.0" 202 Accepted 2026-04-02 08:59:08,705 - lava_callback - INFO - Starting async job submit for node 69ce2fcacb08ea23a1f68640 2026-04-02 08:59:08,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:08,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2fcacb08ea23a1f68640 HTTP/1.1" 200 None 2026-04-02 08:59:08,734 - lava_callback - DEBUG - Processing node 69ce2fcacb08ea23a1f68640: baseline-arm 2026-04-02 08:59:08,739 - lava_callback - WARNING - Failed to upload log 2026-04-02 08:59:08,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:59:08,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:59:08,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2fcacb08ea23a1f68640/lava-logs.yaml 2026-04-02 08:59:08,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:59:09,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:59:09,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2fcacb08ea23a1f68640/lava_callback.json.gz 2026-04-02 08:59:09,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:09,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2fcacb08ea23a1f68640 HTTP/1.1" 200 None 2026-04-02 08:59:09,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:09,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:59:09,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:09,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2fcacb08ea23a1f68640 HTTP/1.1" 200 None 2026-04-02 08:59:09,086 - lava_callback - INFO - Completed processing callback for node 69ce2fcacb08ea23a1f68640 2026-04-02 08:59:11,369 - lava_callback - INFO - Received callback for node 69cb8cd52a64fa9aff9374f5 INFO: 172.21.0.1:48780 - "POST /node/69cb8cd52a64fa9aff9374f5 HTTP/1.0" 202 Accepted 2026-04-02 08:59:11,375 - lava_callback - INFO - Starting async job submit for node 69cb8cd52a64fa9aff9374f5 2026-04-02 08:59:11,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:11,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8cd52a64fa9aff9374f5 HTTP/1.1" 200 None 2026-04-02 08:59:11,392 - lava_callback - DEBUG - Processing node 69cb8cd52a64fa9aff9374f5: baseline-arm-clabbe 2026-04-02 08:59:11,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8cd52a64fa9aff9374f5 2026-04-02 08:59:11,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:11,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8cd52a64fa9aff9374f5 HTTP/1.1" 200 None 2026-04-02 08:59:11,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:11,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:59:11,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:11,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8cd52a64fa9aff9374f5 HTTP/1.1" 200 None 2026-04-02 08:59:11,450 - lava_callback - ERROR - Error processing callback for node 69cb8cd52a64fa9aff9374f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:59:26,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:26,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:59:51,253 - lava_callback - INFO - Received callback for node 69cb8cfb2a64fa9aff937505 INFO: 172.21.0.1:39482 - "POST /node/69cb8cfb2a64fa9aff937505 HTTP/1.0" 202 Accepted 2026-04-02 08:59:51,258 - lava_callback - INFO - Starting async job submit for node 69cb8cfb2a64fa9aff937505 2026-04-02 08:59:51,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:51,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8cfb2a64fa9aff937505 HTTP/1.1" 200 None 2026-04-02 08:59:51,282 - lava_callback - DEBUG - Processing node 69cb8cfb2a64fa9aff937505: baseline-arm-clabbe 2026-04-02 08:59:51,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8cfb2a64fa9aff937505 2026-04-02 08:59:51,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:51,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8cfb2a64fa9aff937505 HTTP/1.1" 200 None 2026-04-02 08:59:51,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:51,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:59:51,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:51,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8cfb2a64fa9aff937505 HTTP/1.1" 200 None 2026-04-02 08:59:51,353 - lava_callback - ERROR - Error processing callback for node 69cb8cfb2a64fa9aff937505: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38220 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:00:31,941 - lava_callback - INFO - Received callback for node 69cb8d222a64fa9aff937521 INFO: 172.21.0.1:38228 - "POST /node/69cb8d222a64fa9aff937521 HTTP/1.0" 202 Accepted 2026-04-02 09:00:31,946 - lava_callback - INFO - Starting async job submit for node 69cb8d222a64fa9aff937521 2026-04-02 09:00:31,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:31,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8d222a64fa9aff937521 HTTP/1.1" 200 None 2026-04-02 09:00:31,996 - lava_callback - DEBUG - Processing node 69cb8d222a64fa9aff937521: baseline-arm-clabbe 2026-04-02 09:00:31,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8d222a64fa9aff937521 2026-04-02 09:00:31,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:32,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8d222a64fa9aff937521 HTTP/1.1" 200 None 2026-04-02 09:00:32,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:32,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 09:00:32,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:32,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8d222a64fa9aff937521 HTTP/1.1" 200 None 2026-04-02 09:00:32,063 - lava_callback - ERROR - Error processing callback for node 69cb8d222a64fa9aff937521: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:00:49,044 - lava_callback - INFO - Received callback for node 69ce2b4ecb08ea23a1f683a7 INFO: 172.21.0.1:54352 - "POST /node/69ce2b4ecb08ea23a1f683a7 HTTP/1.0" 202 Accepted 2026-04-02 09:00:49,051 - lava_callback - INFO - Starting async job submit for node 69ce2b4ecb08ea23a1f683a7 2026-04-02 09:00:49,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:49,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4ecb08ea23a1f683a7 HTTP/1.1" 200 None 2026-04-02 09:00:49,094 - lava_callback - DEBUG - Processing node 69ce2b4ecb08ea23a1f683a7: ltp-fsx 2026-04-02 09:00:49,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:00:49,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:00:49,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69ce2b4ecb08ea23a1f683a7/log.txt.gz 2026-04-02 09:00:49,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:00:50,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:00:50,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69ce2b4ecb08ea23a1f683a7/lava-logs.yaml 2026-04-02 09:00:50,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:00:50,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:00:50,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69ce2b4ecb08ea23a1f683a7/lava_callback.json.gz 2026-04-02 09:00:50,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:50,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4ecb08ea23a1f683a7 HTTP/1.1" 200 None 2026-04-02 09:00:50,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:50,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:00:50,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:50,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b4ecb08ea23a1f683a7 HTTP/1.1" 200 None 2026-04-02 09:00:50,325 - lava_callback - INFO - Completed processing callback for node 69ce2b4ecb08ea23a1f683a7 INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:00:56,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:57,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58468 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:01:45,531 - lava_callback - INFO - Received callback for node 69ce2b51cb08ea23a1f683ab INFO: 172.21.0.1:33470 - "POST /node/69ce2b51cb08ea23a1f683ab HTTP/1.0" 202 Accepted 2026-04-02 09:01:45,538 - lava_callback - INFO - Starting async job submit for node 69ce2b51cb08ea23a1f683ab 2026-04-02 09:01:45,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:01:45,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b51cb08ea23a1f683ab HTTP/1.1" 200 None 2026-04-02 09:01:45,590 - lava_callback - DEBUG - Processing node 69ce2b51cb08ea23a1f683ab: ltp-input 2026-04-02 09:01:45,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:01:46,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:01:46,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69ce2b51cb08ea23a1f683ab/log.txt.gz 2026-04-02 09:01:46,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:01:46,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:01:46,592 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69ce2b51cb08ea23a1f683ab/lava-logs.yaml 2026-04-02 09:01:46,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:01:46,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:01:46,794 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69ce2b51cb08ea23a1f683ab/lava_callback.json.gz 2026-04-02 09:01:46,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:01:46,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b51cb08ea23a1f683ab HTTP/1.1" 200 None 2026-04-02 09:01:46,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:01:46,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:01:46,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:01:46,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b51cb08ea23a1f683ab HTTP/1.1" 200 None 2026-04-02 09:01:46,880 - lava_callback - INFO - Completed processing callback for node 69ce2b51cb08ea23a1f683ab INFO: 172.21.0.1:33778 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:01:57,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:01:57,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38078 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:02:08,692 - lava_callback - INFO - Received callback for node 69ce2b54cb08ea23a1f683ae INFO: 172.21.0.1:38094 - "POST /node/69ce2b54cb08ea23a1f683ae HTTP/1.0" 202 Accepted 2026-04-02 09:02:08,700 - lava_callback - INFO - Starting async job submit for node 69ce2b54cb08ea23a1f683ae 2026-04-02 09:02:08,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:08,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b54cb08ea23a1f683ae HTTP/1.1" 200 None 2026-04-02 09:02:08,748 - lava_callback - DEBUG - Processing node 69ce2b54cb08ea23a1f683ae: ltp-ipc 2026-04-02 09:02:09,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:09,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:09,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69ce2b54cb08ea23a1f683ae/log.txt.gz 2026-04-02 09:02:09,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:09,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:09,778 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69ce2b54cb08ea23a1f683ae/lava-logs.yaml 2026-04-02 09:02:09,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:09,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:09,991 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69ce2b54cb08ea23a1f683ae/lava_callback.json.gz 2026-04-02 09:02:10,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:10,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b54cb08ea23a1f683ae HTTP/1.1" 200 None 2026-04-02 09:02:10,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:10,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:02:10,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:10,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b54cb08ea23a1f683ae HTTP/1.1" 200 None 2026-04-02 09:02:10,109 - lava_callback - INFO - Completed processing callback for node 69ce2b54cb08ea23a1f683ae INFO: 172.21.0.1:48638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48650 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:02:22,986 - lava_callback - INFO - Received callback for node 69cb8d972a64fa9aff937546 INFO: 172.21.0.1:42810 - "POST /node/69cb8d972a64fa9aff937546 HTTP/1.0" 202 Accepted 2026-04-02 09:02:22,992 - lava_callback - INFO - Starting async job submit for node 69cb8d972a64fa9aff937546 2026-04-02 09:02:22,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:23,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8d972a64fa9aff937546 HTTP/1.1" 200 None 2026-04-02 09:02:23,013 - lava_callback - DEBUG - Processing node 69cb8d972a64fa9aff937546: baseline-arm64-baylibre 2026-04-02 09:02:23,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8d972a64fa9aff937546 2026-04-02 09:02:23,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:23,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8d972a64fa9aff937546 HTTP/1.1" 200 None 2026-04-02 09:02:23,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:23,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:02:23,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:23,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8d972a64fa9aff937546 HTTP/1.1" 200 None 2026-04-02 09:02:23,080 - lava_callback - ERROR - Error processing callback for node 69cb8d972a64fa9aff937546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:02:27,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:27,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:02:28,980 - lava_callback - INFO - Received callback for node 69ce2b55cb08ea23a1f683b1 INFO: 172.21.0.1:42820 - "POST /node/69ce2b55cb08ea23a1f683b1 HTTP/1.0" 202 Accepted 2026-04-02 09:02:28,986 - lava_callback - INFO - Starting async job submit for node 69ce2b55cb08ea23a1f683b1 2026-04-02 09:02:29,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:29,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b55cb08ea23a1f683b1 HTTP/1.1" 200 None 2026-04-02 09:02:29,027 - lava_callback - DEBUG - Processing node 69ce2b55cb08ea23a1f683b1: ltp-pty 2026-04-02 09:02:29,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:29,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:29,498 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69ce2b55cb08ea23a1f683b1/log.txt.gz 2026-04-02 09:02:29,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:30,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:30,012 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69ce2b55cb08ea23a1f683b1/lava-logs.yaml 2026-04-02 09:02:30,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:30,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:30,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69ce2b55cb08ea23a1f683b1/lava_callback.json.gz 2026-04-02 09:02:30,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:30,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b55cb08ea23a1f683b1 HTTP/1.1" 200 None 2026-04-02 09:02:30,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:30,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:02:30,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:30,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b55cb08ea23a1f683b1 HTTP/1.1" 200 None 2026-04-02 09:02:30,341 - lava_callback - INFO - Completed processing callback for node 69ce2b55cb08ea23a1f683b1 INFO: 172.21.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:02:57,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:57,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:03:43,029 - lava_callback - INFO - Received callback for node 69cb8de62a64fa9aff93755a INFO: 172.21.0.1:33472 - "POST /node/69cb8de62a64fa9aff93755a HTTP/1.0" 202 Accepted 2026-04-02 09:03:43,035 - lava_callback - INFO - Starting async job submit for node 69cb8de62a64fa9aff93755a 2026-04-02 09:03:43,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:03:43,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8de62a64fa9aff93755a HTTP/1.1" 200 None 2026-04-02 09:03:43,051 - lava_callback - DEBUG - Processing node 69cb8de62a64fa9aff93755a: baseline-arm64-baylibre 2026-04-02 09:03:43,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8de62a64fa9aff93755a 2026-04-02 09:03:43,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:03:43,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8de62a64fa9aff93755a HTTP/1.1" 200 None 2026-04-02 09:03:43,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:03:43,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:03:43,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:03:43,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8de62a64fa9aff93755a HTTP/1.1" 200 None 2026-04-02 09:03:43,123 - lava_callback - ERROR - Error processing callback for node 69cb8de62a64fa9aff93755a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:03,253 - lava_callback - INFO - Received callback for node 69cb8e332a64fa9aff93756b INFO: 172.21.0.1:50486 - "POST /node/69cb8e332a64fa9aff93756b HTTP/1.0" 202 Accepted 2026-04-02 09:05:03,258 - lava_callback - INFO - Starting async job submit for node 69cb8e332a64fa9aff93756b 2026-04-02 09:05:03,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:03,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8e332a64fa9aff93756b HTTP/1.1" 200 None 2026-04-02 09:05:03,275 - lava_callback - DEBUG - Processing node 69cb8e332a64fa9aff93756b: baseline-arm64-baylibre 2026-04-02 09:05:03,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8e332a64fa9aff93756b 2026-04-02 09:05:03,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:03,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8e332a64fa9aff93756b HTTP/1.1" 200 None 2026-04-02 09:05:03,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:03,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:05:03,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:03,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8e332a64fa9aff93756b HTTP/1.1" 200 None 2026-04-02 09:05:03,349 - lava_callback - ERROR - Error processing callback for node 69cb8e332a64fa9aff93756b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50498 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:08,890 - lava_callback - INFO - Received callback for node 69ce2b57cb08ea23a1f683b4 INFO: 172.21.0.1:50512 - "POST /node/69ce2b57cb08ea23a1f683b4 HTTP/1.0" 202 Accepted 2026-04-02 09:05:08,897 - lava_callback - INFO - Starting async job submit for node 69ce2b57cb08ea23a1f683b4 2026-04-02 09:05:08,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:08,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b57cb08ea23a1f683b4 HTTP/1.1" 200 None 2026-04-02 09:05:08,941 - lava_callback - DEBUG - Processing node 69ce2b57cb08ea23a1f683b4: ltp-sched 2026-04-02 09:05:09,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:05:09,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:09,485 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69ce2b57cb08ea23a1f683b4/log.txt.gz 2026-04-02 09:05:09,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:05:09,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:09,948 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69ce2b57cb08ea23a1f683b4/lava-logs.yaml 2026-04-02 09:05:09,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:05:10,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:10,169 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69ce2b57cb08ea23a1f683b4/lava_callback.json.gz 2026-04-02 09:05:10,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:10,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b57cb08ea23a1f683b4 HTTP/1.1" 200 None 2026-04-02 09:05:10,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:10,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:05:10,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:10,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b57cb08ea23a1f683b4 HTTP/1.1" 200 None 2026-04-02 09:05:10,262 - lava_callback - INFO - Completed processing callback for node 69ce2b57cb08ea23a1f683b4 INFO: 172.21.0.1:34892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:27,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:27,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:46,064 - lava_callback - INFO - Received callback for node 69ce2b59cb08ea23a1f683b7 INFO: 172.21.0.1:33132 - "POST /node/69ce2b59cb08ea23a1f683b7 HTTP/1.0" 202 Accepted 2026-04-02 09:05:46,071 - lava_callback - INFO - Starting async job submit for node 69ce2b59cb08ea23a1f683b7 2026-04-02 09:05:46,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:46,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b59cb08ea23a1f683b7 HTTP/1.1" 200 None 2026-04-02 09:05:46,119 - lava_callback - DEBUG - Processing node 69ce2b59cb08ea23a1f683b7: ltp-smoke 2026-04-02 09:05:46,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:46,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:46,785 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2b59cb08ea23a1f683b7/log.txt.gz 2026-04-02 09:05:46,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:05:47,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:47,202 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2b59cb08ea23a1f683b7/lava-logs.yaml 2026-04-02 09:05:47,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:05:47,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:47,372 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2b59cb08ea23a1f683b7/lava_callback.json.gz 2026-04-02 09:05:47,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:47,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b59cb08ea23a1f683b7 HTTP/1.1" 200 None 2026-04-02 09:05:47,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:47,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:05:47,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:47,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b59cb08ea23a1f683b7 HTTP/1.1" 200 None 2026-04-02 09:05:47,461 - lava_callback - INFO - Completed processing callback for node 69ce2b59cb08ea23a1f683b7 INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:57,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:57,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:06:08,816 - lava_callback - INFO - Received callback for node 69ce2b5dcb08ea23a1f683c0 INFO: 172.21.0.1:40498 - "POST /node/69ce2b5dcb08ea23a1f683c0 HTTP/1.0" 202 Accepted 2026-04-02 09:06:08,823 - lava_callback - INFO - Starting async job submit for node 69ce2b5dcb08ea23a1f683c0 2026-04-02 09:06:08,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:08,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5dcb08ea23a1f683c0 HTTP/1.1" 200 None 2026-04-02 09:06:08,865 - lava_callback - DEBUG - Processing node 69ce2b5dcb08ea23a1f683c0: ltp-syscalls-ipc 2026-04-02 09:06:09,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:09,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:09,393 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ce2b5dcb08ea23a1f683c0/log.txt.gz 2026-04-02 09:06:09,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:09,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:09,849 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ce2b5dcb08ea23a1f683c0/lava-logs.yaml 2026-04-02 09:06:09,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:10,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:10,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ce2b5dcb08ea23a1f683c0/lava_callback.json.gz 2026-04-02 09:06:10,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:10,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5dcb08ea23a1f683c0 HTTP/1.1" 200 None 2026-04-02 09:06:10,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:10,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:06:10,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:10,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b5dcb08ea23a1f683c0 HTTP/1.1" 200 None 2026-04-02 09:06:10,133 - lava_callback - INFO - Completed processing callback for node 69ce2b5dcb08ea23a1f683c0 INFO: 172.21.0.1:49466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49472 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:06:23,229 - lava_callback - INFO - Received callback for node 69cb8e812a64fa9aff937572 INFO: 172.21.0.1:37834 - "POST /node/69cb8e812a64fa9aff937572 HTTP/1.0" 202 Accepted 2026-04-02 09:06:23,235 - lava_callback - INFO - Starting async job submit for node 69cb8e812a64fa9aff937572 2026-04-02 09:06:23,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:23,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8e812a64fa9aff937572 HTTP/1.1" 200 None 2026-04-02 09:06:23,251 - lava_callback - DEBUG - Processing node 69cb8e812a64fa9aff937572: baseline-arm64-baylibre 2026-04-02 09:06:23,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8e812a64fa9aff937572 2026-04-02 09:06:23,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:23,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8e812a64fa9aff937572 HTTP/1.1" 200 None 2026-04-02 09:06:23,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:23,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:06:23,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:23,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8e812a64fa9aff937572 HTTP/1.1" 200 None 2026-04-02 09:06:23,304 - lava_callback - ERROR - Error processing callback for node 69cb8e812a64fa9aff937572: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:06:27,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:27,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:06:28,864 - lava_callback - INFO - Received callback for node 69ce2b5fcb08ea23a1f683c3 INFO: 172.21.0.1:37852 - "POST /node/69ce2b5fcb08ea23a1f683c3 HTTP/1.0" 202 Accepted 2026-04-02 09:06:28,870 - lava_callback - INFO - Starting async job submit for node 69ce2b5fcb08ea23a1f683c3 2026-04-02 09:06:28,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:28,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5fcb08ea23a1f683c3 HTTP/1.1" 200 None 2026-04-02 09:06:28,910 - lava_callback - DEBUG - Processing node 69ce2b5fcb08ea23a1f683c3: ltp-timers 2026-04-02 09:06:29,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:29,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:29,461 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69ce2b5fcb08ea23a1f683c3/log.txt.gz 2026-04-02 09:06:29,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:29,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:29,895 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69ce2b5fcb08ea23a1f683c3/lava-logs.yaml 2026-04-02 09:06:29,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:30,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:30,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69ce2b5fcb08ea23a1f683c3/lava_callback.json.gz 2026-04-02 09:06:30,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:30,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5fcb08ea23a1f683c3 HTTP/1.1" 200 None 2026-04-02 09:06:30,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:30,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:06:30,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:30,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b5fcb08ea23a1f683c3 HTTP/1.1" 200 None 2026-04-02 09:06:30,178 - lava_callback - INFO - Completed processing callback for node 69ce2b5fcb08ea23a1f683c3 INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:06:57,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:57,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:07:43,470 - lava_callback - INFO - Received callback for node 69cb8ecf2a64fa9aff937581 INFO: 172.21.0.1:42720 - "POST /node/69cb8ecf2a64fa9aff937581 HTTP/1.0" 202 Accepted 2026-04-02 09:07:43,475 - lava_callback - INFO - Starting async job submit for node 69cb8ecf2a64fa9aff937581 2026-04-02 09:07:43,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:07:43,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8ecf2a64fa9aff937581 HTTP/1.1" 200 None 2026-04-02 09:07:43,491 - lava_callback - DEBUG - Processing node 69cb8ecf2a64fa9aff937581: baseline-arm64-baylibre 2026-04-02 09:07:43,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8ecf2a64fa9aff937581 2026-04-02 09:07:43,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:07:43,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8ecf2a64fa9aff937581 HTTP/1.1" 200 None 2026-04-02 09:07:43,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:07:43,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:07:43,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:07:43,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8ecf2a64fa9aff937581 HTTP/1.1" 200 None 2026-04-02 09:07:43,580 - lava_callback - ERROR - Error processing callback for node 69cb8ecf2a64fa9aff937581: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39586 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:09:03,336 - lava_callback - INFO - Received callback for node 69cb8f1d2a64fa9aff93758a INFO: 172.21.0.1:50360 - "POST /node/69cb8f1d2a64fa9aff93758a HTTP/1.0" 202 Accepted 2026-04-02 09:09:03,342 - lava_callback - INFO - Starting async job submit for node 69cb8f1d2a64fa9aff93758a 2026-04-02 09:09:03,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:03,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8f1d2a64fa9aff93758a HTTP/1.1" 200 None 2026-04-02 09:09:03,360 - lava_callback - DEBUG - Processing node 69cb8f1d2a64fa9aff93758a: baseline-arm64-baylibre 2026-04-02 09:09:03,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8f1d2a64fa9aff93758a 2026-04-02 09:09:03,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:03,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8f1d2a64fa9aff93758a HTTP/1.1" 200 None 2026-04-02 09:09:03,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:03,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:09:03,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:03,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8f1d2a64fa9aff93758a HTTP/1.1" 200 None 2026-04-02 09:09:03,418 - lava_callback - ERROR - Error processing callback for node 69cb8f1d2a64fa9aff93758a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:09:29,172 - lava_callback - INFO - Received callback for node 69ce2b60cb08ea23a1f683c6 INFO: 172.21.0.1:50100 - "POST /node/69ce2b60cb08ea23a1f683c6 HTTP/1.0" 202 Accepted 2026-04-02 09:09:29,179 - lava_callback - INFO - Starting async job submit for node 69ce2b60cb08ea23a1f683c6 2026-04-02 09:09:29,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:29,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b60cb08ea23a1f683c6 HTTP/1.1" 200 None 2026-04-02 09:09:29,227 - lava_callback - DEBUG - Processing node 69ce2b60cb08ea23a1f683c6: ltp-watchqueue 2026-04-02 09:09:29,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:09:29,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:09:29,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ce2b60cb08ea23a1f683c6/log.txt.gz 2026-04-02 09:09:29,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:09:30,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:09:30,306 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ce2b60cb08ea23a1f683c6/lava-logs.yaml 2026-04-02 09:09:30,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:09:30,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:09:30,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ce2b60cb08ea23a1f683c6/lava_callback.json.gz 2026-04-02 09:09:30,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:30,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b60cb08ea23a1f683c6 HTTP/1.1" 200 None 2026-04-02 09:09:30,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:30,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:09:30,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:30,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b60cb08ea23a1f683c6 HTTP/1.1" 200 None 2026-04-02 09:09:30,590 - lava_callback - INFO - Completed processing callback for node 69ce2b60cb08ea23a1f683c6 INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58670 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:09:57,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:57,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:10:32,042 - lava_callback - INFO - Received callback for node 69cb8f712a64fa9aff937598 INFO: 172.21.0.1:35392 - "POST /node/69cb8f712a64fa9aff937598 HTTP/1.0" 202 Accepted 2026-04-02 09:10:32,048 - lava_callback - INFO - Starting async job submit for node 69cb8f712a64fa9aff937598 2026-04-02 09:10:32,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:10:32,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8f712a64fa9aff937598 HTTP/1.1" 200 None 2026-04-02 09:10:32,069 - lava_callback - DEBUG - Processing node 69cb8f712a64fa9aff937598: baseline-arm64-clabbe 2026-04-02 09:10:32,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8f712a64fa9aff937598 2026-04-02 09:10:32,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:10:32,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8f712a64fa9aff937598 HTTP/1.1" 200 None 2026-04-02 09:10:32,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:10:32,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:10:32,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:10:32,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8f712a64fa9aff937598 HTTP/1.1" 200 None 2026-04-02 09:10:32,141 - lava_callback - ERROR - Error processing callback for node 69cb8f712a64fa9aff937598: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57288 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:11:31,819 - lava_callback - INFO - Received callback for node 69cb8fbf2a64fa9aff9375a5 INFO: 172.21.0.1:57292 - "POST /node/69cb8fbf2a64fa9aff9375a5 HTTP/1.0" 202 Accepted 2026-04-02 09:11:31,824 - lava_callback - INFO - Starting async job submit for node 69cb8fbf2a64fa9aff9375a5 2026-04-02 09:11:31,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:11:31,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8fbf2a64fa9aff9375a5 HTTP/1.1" 200 None 2026-04-02 09:11:31,841 - lava_callback - DEBUG - Processing node 69cb8fbf2a64fa9aff9375a5: baseline-arm64-clabbe 2026-04-02 09:11:31,842 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8fbf2a64fa9aff9375a5 2026-04-02 09:11:31,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:11:31,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8fbf2a64fa9aff9375a5 HTTP/1.1" 200 None 2026-04-02 09:11:31,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:11:31,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:11:31,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:11:31,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8fbf2a64fa9aff9375a5 HTTP/1.1" 200 None 2026-04-02 09:11:31,904 - lava_callback - ERROR - Error processing callback for node 69cb8fbf2a64fa9aff9375a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:12:51,856 - lava_callback - INFO - Received callback for node 69cb900c2a64fa9aff9375ae INFO: 172.21.0.1:52086 - "POST /node/69cb900c2a64fa9aff9375ae HTTP/1.0" 202 Accepted 2026-04-02 09:12:51,861 - lava_callback - INFO - Starting async job submit for node 69cb900c2a64fa9aff9375ae 2026-04-02 09:12:51,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:12:51,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb900c2a64fa9aff9375ae HTTP/1.1" 200 None 2026-04-02 09:12:51,877 - lava_callback - DEBUG - Processing node 69cb900c2a64fa9aff9375ae: baseline-arm64-clabbe 2026-04-02 09:12:51,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb900c2a64fa9aff9375ae 2026-04-02 09:12:51,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:12:51,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb900c2a64fa9aff9375ae HTTP/1.1" 200 None 2026-04-02 09:12:51,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:12:51,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:12:51,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:12:51,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb900c2a64fa9aff9375ae HTTP/1.1" 200 None 2026-04-02 09:12:51,940 - lava_callback - ERROR - Error processing callback for node 69cb900c2a64fa9aff9375ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:14:11,938 - lava_callback - INFO - Received callback for node 69cb905a2a64fa9aff9375b9 INFO: 172.21.0.1:41052 - "POST /node/69cb905a2a64fa9aff9375b9 HTTP/1.0" 202 Accepted 2026-04-02 09:14:11,944 - lava_callback - INFO - Starting async job submit for node 69cb905a2a64fa9aff9375b9 2026-04-02 09:14:11,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:14:11,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb905a2a64fa9aff9375b9 HTTP/1.1" 200 None 2026-04-02 09:14:11,959 - lava_callback - DEBUG - Processing node 69cb905a2a64fa9aff9375b9: baseline-arm64-clabbe 2026-04-02 09:14:11,959 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb905a2a64fa9aff9375b9 2026-04-02 09:14:11,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:14:11,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb905a2a64fa9aff9375b9 HTTP/1.1" 200 None 2026-04-02 09:14:11,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:14:11,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:14:11,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:14:12,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb905a2a64fa9aff9375b9 HTTP/1.1" 200 None 2026-04-02 09:14:12,018 - lava_callback - ERROR - Error processing callback for node 69cb905a2a64fa9aff9375b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47908 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:15:31,950 - lava_callback - INFO - Received callback for node 69cb90a82a64fa9aff9375c5 INFO: 172.21.0.1:47920 - "POST /node/69cb90a82a64fa9aff9375c5 HTTP/1.0" 202 Accepted 2026-04-02 09:15:31,957 - lava_callback - INFO - Starting async job submit for node 69cb90a82a64fa9aff9375c5 2026-04-02 09:15:31,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:15:31,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb90a82a64fa9aff9375c5 HTTP/1.1" 200 None 2026-04-02 09:15:31,973 - lava_callback - DEBUG - Processing node 69cb90a82a64fa9aff9375c5: baseline-arm64-clabbe 2026-04-02 09:15:31,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb90a82a64fa9aff9375c5 2026-04-02 09:15:31,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:15:31,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb90a82a64fa9aff9375c5 HTTP/1.1" 200 None 2026-04-02 09:15:31,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:15:32,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:15:32,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:15:32,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb90a82a64fa9aff9375c5 HTTP/1.1" 200 None 2026-04-02 09:15:32,042 - lava_callback - ERROR - Error processing callback for node 69cb90a82a64fa9aff9375c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:16:52,048 - lava_callback - INFO - Received callback for node 69cb90f52a64fa9aff9375d2 INFO: 172.21.0.1:43322 - "POST /node/69cb90f52a64fa9aff9375d2 HTTP/1.0" 202 Accepted 2026-04-02 09:16:52,054 - lava_callback - INFO - Starting async job submit for node 69cb90f52a64fa9aff9375d2 2026-04-02 09:16:52,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:16:52,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb90f52a64fa9aff9375d2 HTTP/1.1" 200 None 2026-04-02 09:16:52,090 - lava_callback - DEBUG - Processing node 69cb90f52a64fa9aff9375d2: baseline-arm64-clabbe 2026-04-02 09:16:52,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb90f52a64fa9aff9375d2 2026-04-02 09:16:52,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:16:52,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb90f52a64fa9aff9375d2 HTTP/1.1" 200 None 2026-04-02 09:16:52,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:16:52,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:16:52,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:16:52,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb90f52a64fa9aff9375d2 HTTP/1.1" 200 None 2026-04-02 09:16:52,153 - lava_callback - ERROR - Error processing callback for node 69cb90f52a64fa9aff9375d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:17:23,883 - lava_callback - INFO - Received callback for node 69ce2b2ecb08ea23a1f6836c INFO: 172.21.0.1:60568 - "POST /node/69ce2b2ecb08ea23a1f6836c HTTP/1.0" 202 Accepted 2026-04-02 09:17:23,929 - lava_callback - INFO - Starting async job submit for node 69ce2b2ecb08ea23a1f6836c 2026-04-02 09:17:23,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:17:23,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2ecb08ea23a1f6836c HTTP/1.1" 200 None 2026-04-02 09:17:23,969 - lava_callback - DEBUG - Processing node 69ce2b2ecb08ea23a1f6836c: baseline-arm-pengutronix 2026-04-02 09:17:24,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:17:24,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:17:24,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ecb08ea23a1f6836c/log.txt.gz 2026-04-02 09:17:24,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:17:24,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:17:24,485 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ecb08ea23a1f6836c/lava-logs.yaml 2026-04-02 09:17:24,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:17:24,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:17:24,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ecb08ea23a1f6836c/lava_callback.json.gz DEBUG: Setup failed for 69ce2b2ecb08ea23a1f6836c. Transitting job node result: incomplete -> fail 2026-04-02 09:17:24,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:17:24,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2ecb08ea23a1f6836c HTTP/1.1" 200 None 2026-04-02 09:17:24,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:17:24,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:17:24,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:17:24,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b2ecb08ea23a1f6836c HTTP/1.1" 200 None 2026-04-02 09:17:24,791 - lava_callback - INFO - Completed processing callback for node 69ce2b2ecb08ea23a1f6836c INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:17:27,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:17:27,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:20:24,715 - lava_callback - INFO - Received callback for node 69ce34bbcb08ea23a1f687a0 INFO: 172.21.0.1:43828 - "POST /node/69ce34bbcb08ea23a1f687a0 HTTP/1.0" 202 Accepted 2026-04-02 09:20:24,728 - lava_callback - INFO - Starting async job submit for node 69ce34bbcb08ea23a1f687a0 2026-04-02 09:20:24,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:24,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bbcb08ea23a1f687a0 HTTP/1.1" 200 None 2026-04-02 09:20:24,802 - lava_callback - DEBUG - Processing node 69ce34bbcb08ea23a1f687a0: baseline-arm64 2026-04-02 09:20:24,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:25,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:25,076 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bbcb08ea23a1f687a0/log.txt.gz 2026-04-02 09:20:25,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:25,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:25,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bbcb08ea23a1f687a0/lava-logs.yaml 2026-04-02 09:20:25,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:25,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:25,577 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bbcb08ea23a1f687a0/lava_callback.json.gz 2026-04-02 09:20:25,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:25,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bbcb08ea23a1f687a0 HTTP/1.1" 200 None 2026-04-02 09:20:25,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:25,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:20:25,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:25,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34bbcb08ea23a1f687a0 HTTP/1.1" 200 None 2026-04-02 09:20:25,657 - lava_callback - INFO - Completed processing callback for node 69ce34bbcb08ea23a1f687a0 INFO: 172.21.0.1:43844 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:20:27,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:27,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:20:41,711 - lava_callback - INFO - Received callback for node 69ce34c9cb08ea23a1f687d5 INFO: 172.21.0.1:57036 - "POST /node/69ce34c9cb08ea23a1f687d5 HTTP/1.0" 202 Accepted 2026-04-02 09:20:41,718 - lava_callback - INFO - Starting async job submit for node 69ce34c9cb08ea23a1f687d5 2026-04-02 09:20:41,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:41,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c9cb08ea23a1f687d5 HTTP/1.1" 200 None 2026-04-02 09:20:41,778 - lava_callback - DEBUG - Processing node 69ce34c9cb08ea23a1f687d5: baseline-arm64 2026-04-02 09:20:41,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:42,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:42,123 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c9cb08ea23a1f687d5/log.txt.gz 2026-04-02 09:20:42,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:42,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:42,496 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c9cb08ea23a1f687d5/lava-logs.yaml 2026-04-02 09:20:42,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:42,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:42,649 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c9cb08ea23a1f687d5/lava_callback.json.gz 2026-04-02 09:20:42,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:42,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c9cb08ea23a1f687d5 HTTP/1.1" 200 None 2026-04-02 09:20:42,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:42,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:20:42,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:42,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c9cb08ea23a1f687d5 HTTP/1.1" 200 None 2026-04-02 09:20:42,743 - lava_callback - INFO - Completed processing callback for node 69ce34c9cb08ea23a1f687d5 2026-04-02 09:20:43,681 - lava_callback - INFO - Received callback for node 69ce34dacb08ea23a1f68802 INFO: 172.21.0.1:57048 - "POST /node/69ce34dacb08ea23a1f68802 HTTP/1.0" 202 Accepted 2026-04-02 09:20:43,687 - lava_callback - INFO - Starting async job submit for node 69ce34dacb08ea23a1f68802 2026-04-02 09:20:43,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:43,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dacb08ea23a1f68802 HTTP/1.1" 200 None 2026-04-02 09:20:43,728 - lava_callback - DEBUG - Processing node 69ce34dacb08ea23a1f68802: baseline-nfs-arm64 2026-04-02 09:20:43,730 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:20:43,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:43,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:43,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dacb08ea23a1f68802/lava-logs.yaml 2026-04-02 09:20:43,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:44,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:44,016 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dacb08ea23a1f68802/lava_callback.json.gz 2026-04-02 09:20:44,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:44,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dacb08ea23a1f68802 HTTP/1.1" 200 None 2026-04-02 09:20:44,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:44,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:20:44,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:44,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34dacb08ea23a1f68802 HTTP/1.1" 200 None 2026-04-02 09:20:44,080 - lava_callback - INFO - Completed processing callback for node 69ce34dacb08ea23a1f68802 INFO: 172.21.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:20:57,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:57,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:21:03,808 - lava_callback - INFO - Received callback for node 69ce34bdcb08ea23a1f687a6 INFO: 172.21.0.1:56792 - "POST /node/69ce34bdcb08ea23a1f687a6 HTTP/1.0" 202 Accepted 2026-04-02 09:21:03,824 - lava_callback - INFO - Starting async job submit for node 69ce34bdcb08ea23a1f687a6 2026-04-02 09:21:03,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:03,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bdcb08ea23a1f687a6 HTTP/1.1" 200 None 2026-04-02 09:21:03,916 - lava_callback - DEBUG - Processing node 69ce34bdcb08ea23a1f687a6: baseline-arm64 2026-04-02 09:21:04,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:04,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:04,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bdcb08ea23a1f687a6/log.txt.gz 2026-04-02 09:21:04,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:04,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:04,946 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bdcb08ea23a1f687a6/lava-logs.yaml 2026-04-02 09:21:04,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:05,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:05,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bdcb08ea23a1f687a6/lava_callback.json.gz 2026-04-02 09:21:05,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:05,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bdcb08ea23a1f687a6 HTTP/1.1" 200 None 2026-04-02 09:21:05,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:05,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:21:05,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:05,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34bdcb08ea23a1f687a6 HTTP/1.1" 200 None 2026-04-02 09:21:05,358 - lava_callback - INFO - Completed processing callback for node 69ce34bdcb08ea23a1f687a6 INFO: 172.21.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:21:27,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:27,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:21:39,188 - lava_callback - INFO - Received callback for node 69ce34bccb08ea23a1f687a3 INFO: 172.21.0.1:52682 - "POST /node/69ce34bccb08ea23a1f687a3 HTTP/1.0" 202 Accepted 2026-04-02 09:21:39,194 - lava_callback - INFO - Starting async job submit for node 69ce34bccb08ea23a1f687a3 2026-04-02 09:21:39,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:39,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bccb08ea23a1f687a3 HTTP/1.1" 200 None 2026-04-02 09:21:39,232 - lava_callback - DEBUG - Processing node 69ce34bccb08ea23a1f687a3: baseline-arm64 2026-04-02 09:21:39,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:39,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:39,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bccb08ea23a1f687a3/log.txt.gz 2026-04-02 09:21:39,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:40,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:40,086 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bccb08ea23a1f687a3/lava-logs.yaml 2026-04-02 09:21:40,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:40,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:40,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bccb08ea23a1f687a3/lava_callback.json.gz 2026-04-02 09:21:40,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:40,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bccb08ea23a1f687a3 HTTP/1.1" 200 None 2026-04-02 09:21:40,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:40,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:21:40,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:40,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34bccb08ea23a1f687a3 HTTP/1.1" 200 None 2026-04-02 09:21:40,372 - lava_callback - INFO - Completed processing callback for node 69ce34bccb08ea23a1f687a3 INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:21:57,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:57,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:22:06,079 - lava_callback - INFO - Received callback for node 69ce34eccb08ea23a1f6884f INFO: 172.21.0.1:60834 - "POST /node/69ce34eccb08ea23a1f6884f HTTP/1.0" 202 Accepted 2026-04-02 09:22:06,085 - lava_callback - INFO - Starting async job submit for node 69ce34eccb08ea23a1f6884f 2026-04-02 09:22:06,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:06,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34eccb08ea23a1f6884f HTTP/1.1" 200 None 2026-04-02 09:22:06,145 - lava_callback - DEBUG - Processing node 69ce34eccb08ea23a1f6884f: baseline-arm64-broonie 2026-04-02 09:22:06,417 - lava_callback - INFO - Received callback for node 69ce3505cb08ea23a1f688a3 INFO: 172.21.0.1:60844 - "POST /node/69ce3505cb08ea23a1f688a3 HTTP/1.0" 202 Accepted 2026-04-02 09:22:06,434 - lava_callback - INFO - Starting async job submit for node 69ce3505cb08ea23a1f688a3 2026-04-02 09:22:06,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:06,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:06,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3505cb08ea23a1f688a3 HTTP/1.1" 200 None 2026-04-02 09:22:06,517 - lava_callback - DEBUG - Processing node 69ce3505cb08ea23a1f688a3: baseline-arm64-foundriesio INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:06,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:06,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eccb08ea23a1f6884f/log.txt.gz 2026-04-02 09:22:06,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:07,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:07,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:07,234 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3505cb08ea23a1f688a3/log.txt.gz 2026-04-02 09:22:07,319 - lava_callback - INFO - Received callback for node 69ce3506cb08ea23a1f688a6 2026-04-02 09:22:07,333 - lava_callback - INFO - Starting async job submit for node 69ce3506cb08ea23a1f688a6 INFO: 172.21.0.1:60860 - "POST /node/69ce3506cb08ea23a1f688a6 HTTP/1.0" 202 Accepted 2026-04-02 09:22:07,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:07,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eccb08ea23a1f6884f/lava-logs.yaml 2026-04-02 09:22:07,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:07,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:07,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:07,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3506cb08ea23a1f688a6 HTTP/1.1" 200 None 2026-04-02 09:22:07,494 - lava_callback - DEBUG - Processing node 69ce3506cb08ea23a1f688a6: baseline-arm64-foundriesio 2026-04-02 09:22:07,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:07,809 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3505cb08ea23a1f688a3/lava-logs.yaml 2026-04-02 09:22:07,883 - lava_callback - INFO - Received callback for node 69ce34f4cb08ea23a1f6885e 2026-04-02 09:22:07,909 - lava_callback - INFO - Starting async job submit for node 69ce34f4cb08ea23a1f6885e 2026-04-02 09:22:07,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:60862 - "POST /node/69ce34f4cb08ea23a1f6885e HTTP/1.0" 202 Accepted 2026-04-02 09:22:07,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:07,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eccb08ea23a1f6884f/lava_callback.json.gz 2026-04-02 09:22:08,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:08,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f4cb08ea23a1f6885e HTTP/1.1" 200 None 2026-04-02 09:22:08,150 - lava_callback - DEBUG - Processing node 69ce34f4cb08ea23a1f6885e: baseline-arm64-broonie 2026-04-02 09:22:08,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34eccb08ea23a1f6884f HTTP/1.1" 200 None 2026-04-02 09:22:08,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:08,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:08,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3505cb08ea23a1f688a3/lava_callback.json.gz 2026-04-02 09:22:08,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34eccb08ea23a1f6884f HTTP/1.1" 200 None 2026-04-02 09:22:08,387 - lava_callback - INFO - Completed processing callback for node 69ce34eccb08ea23a1f6884f 2026-04-02 09:22:08,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:08,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3506cb08ea23a1f688a6/log.txt.gz 2026-04-02 09:22:08,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3505cb08ea23a1f688a3 HTTP/1.1" 200 None 2026-04-02 09:22:08,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:08,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:08,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:08,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3505cb08ea23a1f688a3 HTTP/1.1" 200 None 2026-04-02 09:22:08,954 - lava_callback - INFO - Completed processing callback for node 69ce3505cb08ea23a1f688a3 2026-04-02 09:22:09,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:09,085 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f4cb08ea23a1f6885e/log.txt.gz 2026-04-02 09:22:09,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:09,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3506cb08ea23a1f688a6/lava-logs.yaml 2026-04-02 09:22:09,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:09,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:09,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:09,462 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f4cb08ea23a1f6885e/lava-logs.yaml 2026-04-02 09:22:09,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:09,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:09,556 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3506cb08ea23a1f688a6/lava_callback.json.gz 2026-04-02 09:22:09,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3506cb08ea23a1f688a6 HTTP/1.1" 200 None 2026-04-02 09:22:09,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:09,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f4cb08ea23a1f6885e/lava_callback.json.gz 2026-04-02 09:22:09,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:09,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f4cb08ea23a1f6885e HTTP/1.1" 200 None 2026-04-02 09:22:09,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:09,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3506cb08ea23a1f688a6 HTTP/1.1" 200 None 2026-04-02 09:22:09,698 - lava_callback - INFO - Completed processing callback for node 69ce3506cb08ea23a1f688a6 2026-04-02 09:22:09,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f4cb08ea23a1f6885e HTTP/1.1" 200 None 2026-04-02 09:22:09,775 - lava_callback - INFO - Completed processing callback for node 69ce34f4cb08ea23a1f6885e 2026-04-02 09:22:13,560 - lava_callback - INFO - Received callback for node 69ce34c5cb08ea23a1f687b8 INFO: 172.21.0.1:60396 - "POST /node/69ce34c5cb08ea23a1f687b8 HTTP/1.0" 202 Accepted 2026-04-02 09:22:13,567 - lava_callback - INFO - Starting async job submit for node 69ce34c5cb08ea23a1f687b8 2026-04-02 09:22:13,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:13,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c5cb08ea23a1f687b8 HTTP/1.1" 200 None 2026-04-02 09:22:13,604 - lava_callback - DEBUG - Processing node 69ce34c5cb08ea23a1f687b8: baseline-arm64 2026-04-02 09:22:13,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:14,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:14,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c5cb08ea23a1f687b8/log.txt.gz 2026-04-02 09:22:14,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:14,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:14,519 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c5cb08ea23a1f687b8/lava-logs.yaml 2026-04-02 09:22:14,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:14,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:14,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c5cb08ea23a1f687b8/lava_callback.json.gz 2026-04-02 09:22:14,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:14,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c5cb08ea23a1f687b8 HTTP/1.1" 200 None 2026-04-02 09:22:14,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:14,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:14,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:14,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c5cb08ea23a1f687b8 HTTP/1.1" 200 None 2026-04-02 09:22:14,754 - lava_callback - INFO - Completed processing callback for node 69ce34c5cb08ea23a1f687b8 INFO: 172.21.0.1:60402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:23,901 - lava_callback - INFO - Received callback for node 69ce3503cb08ea23a1f68887 INFO: 172.21.0.1:40450 - "POST /node/69ce3503cb08ea23a1f68887 HTTP/1.0" 202 Accepted 2026-04-02 09:22:23,907 - lava_callback - INFO - Starting async job submit for node 69ce3503cb08ea23a1f68887 2026-04-02 09:22:23,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:23,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3503cb08ea23a1f68887 HTTP/1.1" 200 None 2026-04-02 09:22:23,949 - lava_callback - DEBUG - Processing node 69ce3503cb08ea23a1f68887: baseline-arm64-pengutronix 2026-04-02 09:22:24,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:24,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:24,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3503cb08ea23a1f68887/log.txt.gz 2026-04-02 09:22:24,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:24,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:24,540 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3503cb08ea23a1f68887/lava-logs.yaml 2026-04-02 09:22:24,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:24,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:24,693 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3503cb08ea23a1f68887/lava_callback.json.gz 2026-04-02 09:22:24,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:24,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3503cb08ea23a1f68887 HTTP/1.1" 200 None 2026-04-02 09:22:24,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:24,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:24,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:24,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3503cb08ea23a1f68887 HTTP/1.1" 200 None 2026-04-02 09:22:24,786 - lava_callback - INFO - Completed processing callback for node 69ce3503cb08ea23a1f68887 INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:27,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:27,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:31,486 - lava_callback - INFO - Received callback for node 69ce34c1cb08ea23a1f687af INFO: 172.21.0.1:52256 - "POST /node/69ce34c1cb08ea23a1f687af HTTP/1.0" 202 Accepted 2026-04-02 09:22:31,494 - lava_callback - INFO - Starting async job submit for node 69ce34c1cb08ea23a1f687af 2026-04-02 09:22:31,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:31,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c1cb08ea23a1f687af HTTP/1.1" 200 None 2026-04-02 09:22:31,564 - lava_callback - DEBUG - Processing node 69ce34c1cb08ea23a1f687af: baseline-arm64 2026-04-02 09:22:31,838 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:22:31,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:32,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:32,181 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c1cb08ea23a1f687af/lava-logs.yaml 2026-04-02 09:22:32,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:32,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:32,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c1cb08ea23a1f687af/lava_callback.json.gz 2026-04-02 09:22:32,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:32,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c1cb08ea23a1f687af HTTP/1.1" 200 None 2026-04-02 09:22:32,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:32,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:32,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:32,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c1cb08ea23a1f687af HTTP/1.1" 200 None 2026-04-02 09:22:32,469 - lava_callback - INFO - Completed processing callback for node 69ce34c1cb08ea23a1f687af 2026-04-02 09:22:32,763 - lava_callback - INFO - Received callback for node 69ce34c8cb08ea23a1f687be INFO: 172.21.0.1:52260 - "POST /node/69ce34c8cb08ea23a1f687be HTTP/1.0" 202 Accepted 2026-04-02 09:22:32,770 - lava_callback - INFO - Starting async job submit for node 69ce34c8cb08ea23a1f687be 2026-04-02 09:22:32,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:32,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c8cb08ea23a1f687be HTTP/1.1" 200 None 2026-04-02 09:22:32,808 - lava_callback - DEBUG - Processing node 69ce34c8cb08ea23a1f687be: baseline-arm64 2026-04-02 09:22:33,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:33,222 - lava_callback - INFO - Received callback for node 69ce34d7cb08ea23a1f687f8 INFO: 172.21.0.1:52272 - "POST /node/69ce34d7cb08ea23a1f687f8 HTTP/1.0" 202 Accepted 2026-04-02 09:22:33,229 - lava_callback - INFO - Starting async job submit for node 69ce34d7cb08ea23a1f687f8 2026-04-02 09:22:33,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:33,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d7cb08ea23a1f687f8 HTTP/1.1" 200 None 2026-04-02 09:22:33,284 - lava_callback - DEBUG - Processing node 69ce34d7cb08ea23a1f687f8: baseline-nfs-arm64 2026-04-02 09:22:33,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:33,477 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c8cb08ea23a1f687be/log.txt.gz 2026-04-02 09:22:33,706 - lava_callback - INFO - Received callback for node 69ce3504cb08ea23a1f6888a INFO: 172.21.0.1:52288 - "POST /node/69ce3504cb08ea23a1f6888a HTTP/1.0" 202 Accepted 2026-04-02 09:22:33,747 - lava_callback - INFO - Starting async job submit for node 69ce3504cb08ea23a1f6888a 2026-04-02 09:22:33,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:34,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3504cb08ea23a1f6888a HTTP/1.1" 200 None 2026-04-02 09:22:34,087 - lava_callback - DEBUG - Processing node 69ce3504cb08ea23a1f6888a: baseline-arm64-pengutronix 2026-04-02 09:22:34,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:34,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:34,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:34,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:34,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d7cb08ea23a1f687f8/log.txt.gz 2026-04-02 09:22:34,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:34,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:34,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c8cb08ea23a1f687be/lava-logs.yaml 2026-04-02 09:22:34,622 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3504cb08ea23a1f6888a/log.txt.gz 2026-04-02 09:22:34,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:34,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:34,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:35,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:35,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c8cb08ea23a1f687be/lava_callback.json.gz 2026-04-02 09:22:35,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c8cb08ea23a1f687be HTTP/1.1" 200 None 2026-04-02 09:22:35,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:35,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:35,148 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d7cb08ea23a1f687f8/lava-logs.yaml 2026-04-02 09:22:35,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:35,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c8cb08ea23a1f687be HTTP/1.1" 200 None 2026-04-02 09:22:35,175 - lava_callback - INFO - Completed processing callback for node 69ce34c8cb08ea23a1f687be 2026-04-02 09:22:35,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:35,194 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3504cb08ea23a1f6888a/lava-logs.yaml 2026-04-02 09:22:35,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:35,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:35,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3504cb08ea23a1f6888a/lava_callback.json.gz 2026-04-02 09:22:35,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:35,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,424 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d7cb08ea23a1f687f8/lava_callback.json.gz 2026-04-02 09:22:35,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3504cb08ea23a1f6888a HTTP/1.1" 200 None 2026-04-02 09:22:35,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d7cb08ea23a1f687f8 HTTP/1.1" 200 None 2026-04-02 09:22:35,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:35,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:35,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3504cb08ea23a1f6888a HTTP/1.1" 200 None 2026-04-02 09:22:35,518 - lava_callback - INFO - Completed processing callback for node 69ce3504cb08ea23a1f6888a 2026-04-02 09:22:35,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d7cb08ea23a1f687f8 HTTP/1.1" 200 None 2026-04-02 09:22:35,530 - lava_callback - INFO - Completed processing callback for node 69ce34d7cb08ea23a1f687f8 INFO: 172.21.0.1:52298 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:45,597 - lava_callback - INFO - Received callback for node 69ce34cdcb08ea23a1f687df INFO: 172.21.0.1:39398 - "POST /node/69ce34cdcb08ea23a1f687df HTTP/1.0" 202 Accepted 2026-04-02 09:22:45,603 - lava_callback - INFO - Starting async job submit for node 69ce34cdcb08ea23a1f687df 2026-04-02 09:22:45,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:45,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cdcb08ea23a1f687df HTTP/1.1" 200 None 2026-04-02 09:22:45,644 - lava_callback - DEBUG - Processing node 69ce34cdcb08ea23a1f687df: baseline-arm64 2026-04-02 09:22:45,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:46,037 - lava_callback - INFO - Received callback for node 69ce34f9cb08ea23a1f6886b INFO: 172.21.0.1:39408 - "POST /node/69ce34f9cb08ea23a1f6886b HTTP/1.0" 202 Accepted 2026-04-02 09:22:46,045 - lava_callback - INFO - Starting async job submit for node 69ce34f9cb08ea23a1f6886b 2026-04-02 09:22:46,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:46,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:46,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cdcb08ea23a1f687df/log.txt.gz 2026-04-02 09:22:46,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f9cb08ea23a1f6886b HTTP/1.1" 200 None 2026-04-02 09:22:46,149 - lava_callback - DEBUG - Processing node 69ce34f9cb08ea23a1f6886b: baseline-arm64-broonie 2026-04-02 09:22:46,361 - lava_callback - INFO - Received callback for node 69ce34c0cb08ea23a1f687ac INFO: 172.21.0.1:39420 - "POST /node/69ce34c0cb08ea23a1f687ac HTTP/1.0" 202 Accepted 2026-04-02 09:22:46,383 - lava_callback - INFO - Starting async job submit for node 69ce34c0cb08ea23a1f687ac 2026-04-02 09:22:46,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:46,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:46,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c0cb08ea23a1f687ac HTTP/1.1" 200 None 2026-04-02 09:22:46,557 - lava_callback - DEBUG - Processing node 69ce34c0cb08ea23a1f687ac: baseline-arm64 2026-04-02 09:22:46,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:46,775 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:22:46,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:46,838 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cdcb08ea23a1f687df/lava-logs.yaml 2026-04-02 09:22:46,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:46,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:46,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:46,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f9cb08ea23a1f6886b/log.txt.gz 2026-04-02 09:22:47,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:47,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:47,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cdcb08ea23a1f687df/lava_callback.json.gz 2026-04-02 09:22:47,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:47,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,165 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c0cb08ea23a1f687ac/lava-logs.yaml 2026-04-02 09:22:47,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:47,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cdcb08ea23a1f687df HTTP/1.1" 200 None 2026-04-02 09:22:47,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:47,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34cdcb08ea23a1f687df HTTP/1.1" 200 None 2026-04-02 09:22:47,267 - lava_callback - INFO - Completed processing callback for node 69ce34cdcb08ea23a1f687df 2026-04-02 09:22:47,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:47,350 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f9cb08ea23a1f6886b/lava-logs.yaml 2026-04-02 09:22:47,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:47,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:47,372 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c0cb08ea23a1f687ac/lava_callback.json.gz 2026-04-02 09:22:47,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,456 - lava_callback - INFO - Received callback for node 69ce34fecb08ea23a1f6887a INFO: 172.21.0.1:39430 - "POST /node/69ce34fecb08ea23a1f6887a HTTP/1.0" 202 Accepted 2026-04-02 09:22:47,466 - lava_callback - INFO - Starting async job submit for node 69ce34fecb08ea23a1f6887a 2026-04-02 09:22:47,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c0cb08ea23a1f687ac HTTP/1.1" 200 None 2026-04-02 09:22:47,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34fecb08ea23a1f6887a HTTP/1.1" 200 None 2026-04-02 09:22:47,530 - lava_callback - DEBUG - Processing node 69ce34fecb08ea23a1f6887a: baseline-arm64-clabbe 2026-04-02 09:22:47,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:47,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:47,649 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f9cb08ea23a1f6886b/lava_callback.json.gz 2026-04-02 09:22:47,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c0cb08ea23a1f687ac HTTP/1.1" 200 None 2026-04-02 09:22:47,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,836 - lava_callback - INFO - Completed processing callback for node 69ce34c0cb08ea23a1f687ac 2026-04-02 09:22:47,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f9cb08ea23a1f6886b HTTP/1.1" 200 None 2026-04-02 09:22:47,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:48,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:48,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:48,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f9cb08ea23a1f6886b HTTP/1.1" 200 None 2026-04-02 09:22:48,078 - lava_callback - INFO - Completed processing callback for node 69ce34f9cb08ea23a1f6886b 2026-04-02 09:22:48,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:48,245 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ce34fecb08ea23a1f6887a/log.txt.gz 2026-04-02 09:22:48,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:48,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:48,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ce34fecb08ea23a1f6887a/lava-logs.yaml 2026-04-02 09:22:48,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:49,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:49,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ce34fecb08ea23a1f6887a/lava_callback.json.gz 2026-04-02 09:22:49,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:49,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34fecb08ea23a1f6887a HTTP/1.1" 200 None 2026-04-02 09:22:49,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:49,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:49,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:49,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34fecb08ea23a1f6887a HTTP/1.1" 200 None 2026-04-02 09:22:49,106 - lava_callback - INFO - Completed processing callback for node 69ce34fecb08ea23a1f6887a 2026-04-02 09:22:49,481 - lava_callback - INFO - Received callback for node 69ce34f0cb08ea23a1f68855 INFO: 172.21.0.1:39444 - "POST /node/69ce34f0cb08ea23a1f68855 HTTP/1.0" 202 Accepted 2026-04-02 09:22:49,487 - lava_callback - INFO - Starting async job submit for node 69ce34f0cb08ea23a1f68855 2026-04-02 09:22:49,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:49,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f0cb08ea23a1f68855 HTTP/1.1" 200 None 2026-04-02 09:22:49,528 - lava_callback - DEBUG - Processing node 69ce34f0cb08ea23a1f68855: baseline-arm64-broonie 2026-04-02 09:22:49,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:49,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:49,913 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f0cb08ea23a1f68855/log.txt.gz 2026-04-02 09:22:50,061 - lava_callback - INFO - Received callback for node 69ce34becb08ea23a1f687a9 INFO: 172.21.0.1:57038 - "POST /node/69ce34becb08ea23a1f687a9 HTTP/1.0" 202 Accepted 2026-04-02 09:22:50,085 - lava_callback - INFO - Starting async job submit for node 69ce34becb08ea23a1f687a9 2026-04-02 09:22:50,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:50,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:50,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34becb08ea23a1f687a9 HTTP/1.1" 200 None 2026-04-02 09:22:50,194 - lava_callback - DEBUG - Processing node 69ce34becb08ea23a1f687a9: baseline-arm64 2026-04-02 09:22:50,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:50,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f0cb08ea23a1f68855/lava-logs.yaml 2026-04-02 09:22:50,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:50,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:50,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:50,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34becb08ea23a1f687a9/log.txt.gz 2026-04-02 09:22:50,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:50,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f0cb08ea23a1f68855/lava_callback.json.gz 2026-04-02 09:22:50,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:50,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:50,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f0cb08ea23a1f68855 HTTP/1.1" 200 None 2026-04-02 09:22:50,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:50,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:50,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:50,984 - lava_callback - INFO - Received callback for node 69ce34f1cb08ea23a1f68858 2026-04-02 09:22:50,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f0cb08ea23a1f68855 HTTP/1.1" 200 None INFO: 172.21.0.1:57052 - "POST /node/69ce34f1cb08ea23a1f68858 HTTP/1.0" 202 Accepted 2026-04-02 09:22:51,010 - lava_callback - INFO - Starting async job submit for node 69ce34f1cb08ea23a1f68858 2026-04-02 09:22:51,017 - lava_callback - INFO - Completed processing callback for node 69ce34f0cb08ea23a1f68855 2026-04-02 09:22:51,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:51,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f1cb08ea23a1f68858 HTTP/1.1" 200 None 2026-04-02 09:22:51,112 - lava_callback - DEBUG - Processing node 69ce34f1cb08ea23a1f68858: baseline-arm64-broonie 2026-04-02 09:22:51,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:51,283 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34becb08ea23a1f687a9/lava-logs.yaml 2026-04-02 09:22:51,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:51,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:51,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:51,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34becb08ea23a1f687a9/lava_callback.json.gz 2026-04-02 09:22:51,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:51,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:51,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f1cb08ea23a1f68858/log.txt.gz 2026-04-02 09:22:51,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34becb08ea23a1f687a9 HTTP/1.1" 200 None 2026-04-02 09:22:51,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:51,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:51,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:51,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:51,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34becb08ea23a1f687a9 HTTP/1.1" 200 None 2026-04-02 09:22:51,871 - lava_callback - INFO - Completed processing callback for node 69ce34becb08ea23a1f687a9 2026-04-02 09:22:52,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:52,076 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f1cb08ea23a1f68858/lava-logs.yaml 2026-04-02 09:22:52,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:52,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:52,222 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f1cb08ea23a1f68858/lava_callback.json.gz 2026-04-02 09:22:52,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:52,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f1cb08ea23a1f68858 HTTP/1.1" 200 None 2026-04-02 09:22:52,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:52,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:52,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:52,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f1cb08ea23a1f68858 HTTP/1.1" 200 None 2026-04-02 09:22:52,314 - lava_callback - INFO - Completed processing callback for node 69ce34f1cb08ea23a1f68858 2026-04-02 09:22:52,393 - lava_callback - INFO - Received callback for node 69ce34f5cb08ea23a1f68861 INFO: 172.21.0.1:57068 - "POST /node/69ce34f5cb08ea23a1f68861 HTTP/1.0" 202 Accepted 2026-04-02 09:22:52,399 - lava_callback - INFO - Starting async job submit for node 69ce34f5cb08ea23a1f68861 2026-04-02 09:22:52,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:52,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f5cb08ea23a1f68861 HTTP/1.1" 200 None 2026-04-02 09:22:52,440 - lava_callback - DEBUG - Processing node 69ce34f5cb08ea23a1f68861: baseline-arm64-broonie 2026-04-02 09:22:52,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:52,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:52,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f5cb08ea23a1f68861/log.txt.gz 2026-04-02 09:22:53,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:53,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:53,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f5cb08ea23a1f68861/lava-logs.yaml 2026-04-02 09:22:53,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:53,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:53,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f5cb08ea23a1f68861/lava_callback.json.gz 2026-04-02 09:22:53,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:53,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f5cb08ea23a1f68861 HTTP/1.1" 200 None 2026-04-02 09:22:53,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:53,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:53,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:53,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f5cb08ea23a1f68861 HTTP/1.1" 200 None 2026-04-02 09:22:53,451 - lava_callback - INFO - Completed processing callback for node 69ce34f5cb08ea23a1f68861 2026-04-02 09:22:53,833 - lava_callback - INFO - Received callback for node 69ce34f7cb08ea23a1f68864 INFO: 172.21.0.1:57076 - "POST /node/69ce34f7cb08ea23a1f68864 HTTP/1.0" 202 Accepted 2026-04-02 09:22:53,839 - lava_callback - INFO - Starting async job submit for node 69ce34f7cb08ea23a1f68864 2026-04-02 09:22:53,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:53,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f7cb08ea23a1f68864 HTTP/1.1" 200 None 2026-04-02 09:22:53,894 - lava_callback - DEBUG - Processing node 69ce34f7cb08ea23a1f68864: baseline-arm64-broonie 2026-04-02 09:22:54,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:54,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:54,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f7cb08ea23a1f68864/log.txt.gz 2026-04-02 09:22:54,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:54,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:54,675 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f7cb08ea23a1f68864/lava-logs.yaml 2026-04-02 09:22:54,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:54,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:54,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f7cb08ea23a1f68864/lava_callback.json.gz 2026-04-02 09:22:54,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:54,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f7cb08ea23a1f68864 HTTP/1.1" 200 None 2026-04-02 09:22:54,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:54,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:54,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:54,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f7cb08ea23a1f68864 HTTP/1.1" 200 None 2026-04-02 09:22:54,901 - lava_callback - INFO - Completed processing callback for node 69ce34f7cb08ea23a1f68864 2026-04-02 09:22:55,851 - lava_callback - INFO - Received callback for node 69ce3198cb08ea23a1f686ff INFO: 172.21.0.1:57090 - "POST /node/69ce3198cb08ea23a1f686ff HTTP/1.0" 202 Accepted 2026-04-02 09:22:55,858 - lava_callback - INFO - Starting async job submit for node 69ce3198cb08ea23a1f686ff 2026-04-02 09:22:55,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:55,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3198cb08ea23a1f686ff HTTP/1.1" 200 None 2026-04-02 09:22:55,951 - lava_callback - DEBUG - Processing node 69ce3198cb08ea23a1f686ff: baseline-arm INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:56,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:56,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:56,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3198cb08ea23a1f686ff/log.txt.gz 2026-04-02 09:22:57,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:57,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:57,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-02 09:22:57,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:57,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3198cb08ea23a1f686ff/lava-logs.yaml 2026-04-02 09:22:57,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:57,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:57,619 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3198cb08ea23a1f686ff/lava_callback.json.gz DEBUG: Setup failed for 69ce3198cb08ea23a1f686ff. Transitting job node result: incomplete -> fail 2026-04-02 09:22:57,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:57,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3198cb08ea23a1f686ff HTTP/1.1" 200 None 2026-04-02 09:22:57,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:57,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:22:57,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:57,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3198cb08ea23a1f686ff HTTP/1.1" 200 None 2026-04-02 09:22:57,897 - lava_callback - INFO - Completed processing callback for node 69ce3198cb08ea23a1f686ff 2026-04-02 09:23:03,878 - lava_callback - INFO - Received callback for node 69ce34e0cb08ea23a1f68815 INFO: 172.21.0.1:32768 - "POST /node/69ce34e0cb08ea23a1f68815 HTTP/1.0" 202 Accepted 2026-04-02 09:23:03,885 - lava_callback - INFO - Starting async job submit for node 69ce34e0cb08ea23a1f68815 2026-04-02 09:23:03,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:03,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e0cb08ea23a1f68815 HTTP/1.1" 200 None 2026-04-02 09:23:03,928 - lava_callback - DEBUG - Processing node 69ce34e0cb08ea23a1f68815: baseline-nfs-arm64 2026-04-02 09:23:04,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:04,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:04,563 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34e0cb08ea23a1f68815/log.txt.gz 2026-04-02 09:23:04,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:05,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:05,118 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34e0cb08ea23a1f68815/lava-logs.yaml 2026-04-02 09:23:05,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:05,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:05,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34e0cb08ea23a1f68815/lava_callback.json.gz 2026-04-02 09:23:05,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:05,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e0cb08ea23a1f68815 HTTP/1.1" 200 None 2026-04-02 09:23:05,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:05,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:05,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:05,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34e0cb08ea23a1f68815 HTTP/1.1" 200 None 2026-04-02 09:23:05,411 - lava_callback - INFO - Completed processing callback for node 69ce34e0cb08ea23a1f68815 2026-04-02 09:23:06,245 - lava_callback - INFO - Received callback for node 69ce3153cb08ea23a1f686df INFO: 172.21.0.1:32778 - "POST /node/69ce3153cb08ea23a1f686df HTTP/1.0" 202 Accepted 2026-04-02 09:23:06,251 - lava_callback - INFO - Starting async job submit for node 69ce3153cb08ea23a1f686df 2026-04-02 09:23:06,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:06,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3153cb08ea23a1f686df HTTP/1.1" 200 None 2026-04-02 09:23:06,329 - lava_callback - DEBUG - Processing node 69ce3153cb08ea23a1f686df: ltp-smoke INFO: 172.21.0.1:32784 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:23:06,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:06,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:06,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3153cb08ea23a1f686df/log.txt.gz 2026-04-02 09:23:07,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:07,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:07,525 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3153cb08ea23a1f686df/lava-logs.yaml 2026-04-02 09:23:07,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:07,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:07,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3153cb08ea23a1f686df/lava_callback.json.gz 2026-04-02 09:23:07,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:07,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3153cb08ea23a1f686df HTTP/1.1" 200 None 2026-04-02 09:23:07,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:07,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce266ecb08ea23a1f68074 HTTP/1.1" 200 None 2026-04-02 09:23:07,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:07,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3153cb08ea23a1f686df HTTP/1.1" 200 None 2026-04-02 09:23:08,012 - lava_callback - INFO - Received callback for node 69ce34d5cb08ea23a1f687f2 INFO: 172.21.0.1:32786 - "POST /node/69ce34d5cb08ea23a1f687f2 HTTP/1.0" 202 Accepted 2026-04-02 09:23:08,031 - lava_callback - INFO - Starting async job submit for node 69ce34d5cb08ea23a1f687f2 2026-04-02 09:23:08,063 - lava_callback - INFO - Completed processing callback for node 69ce3153cb08ea23a1f686df 2026-04-02 09:23:08,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:08,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d5cb08ea23a1f687f2 HTTP/1.1" 200 None 2026-04-02 09:23:08,111 - lava_callback - DEBUG - Processing node 69ce34d5cb08ea23a1f687f2: baseline-nfs-arm64 2026-04-02 09:23:08,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:08,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:08,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d5cb08ea23a1f687f2/log.txt.gz 2026-04-02 09:23:08,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:09,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:09,082 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d5cb08ea23a1f687f2/lava-logs.yaml 2026-04-02 09:23:09,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:09,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:09,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d5cb08ea23a1f687f2/lava_callback.json.gz 2026-04-02 09:23:09,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:09,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d5cb08ea23a1f687f2 HTTP/1.1" 200 None 2026-04-02 09:23:09,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:09,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:09,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:09,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d5cb08ea23a1f687f2 HTTP/1.1" 200 None 2026-04-02 09:23:09,312 - lava_callback - INFO - Completed processing callback for node 69ce34d5cb08ea23a1f687f2 INFO: 172.21.0.1:49392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:23:22,356 - lava_callback - INFO - Received callback for node 69ce34cbcb08ea23a1f687d8 INFO: 172.21.0.1:53498 - "POST /node/69ce34cbcb08ea23a1f687d8 HTTP/1.0" 202 Accepted 2026-04-02 09:23:22,365 - lava_callback - INFO - Starting async job submit for node 69ce34cbcb08ea23a1f687d8 2026-04-02 09:23:22,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:22,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cbcb08ea23a1f687d8 HTTP/1.1" 200 None 2026-04-02 09:23:22,402 - lava_callback - DEBUG - Processing node 69ce34cbcb08ea23a1f687d8: baseline-arm64 2026-04-02 09:23:22,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:22,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:22,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cbcb08ea23a1f687d8/log.txt.gz 2026-04-02 09:23:22,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:23,048 - lava_callback - INFO - Received callback for node 69ce34c4cb08ea23a1f687b5 INFO: 172.21.0.1:53506 - "POST /node/69ce34c4cb08ea23a1f687b5 HTTP/1.0" 202 Accepted 2026-04-02 09:23:23,056 - lava_callback - INFO - Starting async job submit for node 69ce34c4cb08ea23a1f687b5 2026-04-02 09:23:23,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:23,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c4cb08ea23a1f687b5 HTTP/1.1" 200 None 2026-04-02 09:23:23,105 - lava_callback - DEBUG - Processing node 69ce34c4cb08ea23a1f687b5: baseline-arm64 2026-04-02 09:23:23,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:23,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cbcb08ea23a1f687d8/lava-logs.yaml 2026-04-02 09:23:23,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:23,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:23,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:23,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cbcb08ea23a1f687d8/lava_callback.json.gz 2026-04-02 09:23:23,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:23,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cbcb08ea23a1f687d8 HTTP/1.1" 200 None 2026-04-02 09:23:23,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:23,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:23,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:23,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34cbcb08ea23a1f687d8 HTTP/1.1" 200 None 2026-04-02 09:23:23,715 - lava_callback - INFO - Completed processing callback for node 69ce34cbcb08ea23a1f687d8 2026-04-02 09:23:23,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:23,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c4cb08ea23a1f687b5/log.txt.gz 2026-04-02 09:23:23,989 - lava_callback - INFO - Received callback for node 69ce34c7cb08ea23a1f687bb INFO: 172.21.0.1:53510 - "POST /node/69ce34c7cb08ea23a1f687bb HTTP/1.0" 202 Accepted 2026-04-02 09:23:24,001 - lava_callback - INFO - Starting async job submit for node 69ce34c7cb08ea23a1f687bb 2026-04-02 09:23:24,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:24,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:24,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c7cb08ea23a1f687bb HTTP/1.1" 200 None 2026-04-02 09:23:24,064 - lava_callback - DEBUG - Processing node 69ce34c7cb08ea23a1f687bb: baseline-arm64 2026-04-02 09:23:24,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:24,295 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c4cb08ea23a1f687b5/lava-logs.yaml 2026-04-02 09:23:24,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:24,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:24,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:24,612 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c4cb08ea23a1f687b5/lava_callback.json.gz 2026-04-02 09:23:24,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:24,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:24,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c7cb08ea23a1f687bb/log.txt.gz 2026-04-02 09:23:24,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c4cb08ea23a1f687b5 HTTP/1.1" 200 None 2026-04-02 09:23:24,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:24,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:24,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:24,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:24,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c4cb08ea23a1f687b5 HTTP/1.1" 200 None 2026-04-02 09:23:24,891 - lava_callback - INFO - Completed processing callback for node 69ce34c4cb08ea23a1f687b5 2026-04-02 09:23:25,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:25,118 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c7cb08ea23a1f687bb/lava-logs.yaml 2026-04-02 09:23:25,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:25,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:25,268 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c7cb08ea23a1f687bb/lava_callback.json.gz 2026-04-02 09:23:25,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:25,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c7cb08ea23a1f687bb HTTP/1.1" 200 None 2026-04-02 09:23:25,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:25,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:25,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:25,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c7cb08ea23a1f687bb HTTP/1.1" 200 None 2026-04-02 09:23:25,428 - lava_callback - INFO - Completed processing callback for node 69ce34c7cb08ea23a1f687bb 2026-04-02 09:23:26,042 - lava_callback - INFO - Received callback for node 69ce34eecb08ea23a1f68852 INFO: 172.21.0.1:53516 - "POST /node/69ce34eecb08ea23a1f68852 HTTP/1.0" 202 Accepted 2026-04-02 09:23:26,048 - lava_callback - INFO - Starting async job submit for node 69ce34eecb08ea23a1f68852 2026-04-02 09:23:26,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:26,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34eecb08ea23a1f68852 HTTP/1.1" 200 None 2026-04-02 09:23:26,108 - lava_callback - DEBUG - Processing node 69ce34eecb08ea23a1f68852: baseline-arm64-broonie 2026-04-02 09:23:26,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:23:26,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:26,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eecb08ea23a1f68852/log.txt.gz 2026-04-02 09:23:26,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:27,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:27,153 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eecb08ea23a1f68852/lava-logs.yaml 2026-04-02 09:23:27,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:27,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:27,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eecb08ea23a1f68852/lava_callback.json.gz 2026-04-02 09:23:27,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:27,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:27,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34eecb08ea23a1f68852 HTTP/1.1" 200 None 2026-04-02 09:23:27,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:27,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-02 09:23:27,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:27,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:27,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34eecb08ea23a1f68852 HTTP/1.1" 200 None 2026-04-02 09:23:27,423 - lava_callback - INFO - Completed processing callback for node 69ce34eecb08ea23a1f68852 INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:23:39,301 - lava_callback - INFO - Received callback for node 69ce34cfcb08ea23a1f687e6 INFO: 172.21.0.1:54648 - "POST /node/69ce34cfcb08ea23a1f687e6 HTTP/1.0" 202 Accepted 2026-04-02 09:23:39,308 - lava_callback - INFO - Starting async job submit for node 69ce34cfcb08ea23a1f687e6 2026-04-02 09:23:39,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:39,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cfcb08ea23a1f687e6 HTTP/1.1" 200 None 2026-04-02 09:23:39,347 - lava_callback - DEBUG - Processing node 69ce34cfcb08ea23a1f687e6: baseline-arm64 2026-04-02 09:23:39,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:39,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:39,892 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cfcb08ea23a1f687e6/log.txt.gz 2026-04-02 09:23:40,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:40,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:40,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cfcb08ea23a1f687e6/lava-logs.yaml 2026-04-02 09:23:40,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:40,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:40,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cfcb08ea23a1f687e6/lava_callback.json.gz 2026-04-02 09:23:40,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:40,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cfcb08ea23a1f687e6 HTTP/1.1" 200 None 2026-04-02 09:23:40,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:40,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:40,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:40,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34cfcb08ea23a1f687e6 HTTP/1.1" 200 None 2026-04-02 09:23:40,608 - lava_callback - INFO - Completed processing callback for node 69ce34cfcb08ea23a1f687e6 INFO: 172.21.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:23:57,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:57,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58368 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:24:08,369 - lava_callback - INFO - Received callback for node 69ce34decb08ea23a1f6880e INFO: 172.21.0.1:58382 - "POST /node/69ce34decb08ea23a1f6880e HTTP/1.0" 202 Accepted 2026-04-02 09:24:08,376 - lava_callback - INFO - Starting async job submit for node 69ce34decb08ea23a1f6880e 2026-04-02 09:24:08,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:08,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34decb08ea23a1f6880e HTTP/1.1" 200 None 2026-04-02 09:24:08,413 - lava_callback - DEBUG - Processing node 69ce34decb08ea23a1f6880e: baseline-nfs-arm64 2026-04-02 09:24:08,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:08,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:08,910 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34decb08ea23a1f6880e/log.txt.gz 2026-04-02 09:24:09,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:09,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:09,358 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34decb08ea23a1f6880e/lava-logs.yaml 2026-04-02 09:24:09,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:09,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:09,563 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34decb08ea23a1f6880e/lava_callback.json.gz 2026-04-02 09:24:09,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:09,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34decb08ea23a1f6880e HTTP/1.1" 200 None 2026-04-02 09:24:09,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:09,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:24:09,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:09,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34decb08ea23a1f6880e HTTP/1.1" 200 None 2026-04-02 09:24:09,678 - lava_callback - INFO - Completed processing callback for node 69ce34decb08ea23a1f6880e INFO: 172.21.0.1:44660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:24:17,359 - lava_callback - INFO - Received callback for node 69ce34dbcb08ea23a1f68808 INFO: 172.21.0.1:44674 - "POST /node/69ce34dbcb08ea23a1f68808 HTTP/1.0" 202 Accepted 2026-04-02 09:24:17,366 - lava_callback - INFO - Starting async job submit for node 69ce34dbcb08ea23a1f68808 2026-04-02 09:24:17,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:17,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dbcb08ea23a1f68808 HTTP/1.1" 200 None 2026-04-02 09:24:17,423 - lava_callback - DEBUG - Processing node 69ce34dbcb08ea23a1f68808: baseline-nfs-arm64 2026-04-02 09:24:17,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:17,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:17,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dbcb08ea23a1f68808/log.txt.gz 2026-04-02 09:24:18,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:18,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:18,420 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dbcb08ea23a1f68808/lava-logs.yaml 2026-04-02 09:24:18,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:18,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:18,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dbcb08ea23a1f68808/lava_callback.json.gz 2026-04-02 09:24:18,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:18,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dbcb08ea23a1f68808 HTTP/1.1" 200 None 2026-04-02 09:24:18,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:18,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:24:18,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:18,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34dbcb08ea23a1f68808 HTTP/1.1" 200 None 2026-04-02 09:24:18,664 - lava_callback - INFO - Completed processing callback for node 69ce34dbcb08ea23a1f68808 2026-04-02 09:24:23,376 - lava_callback - INFO - Received callback for node 69ce34d2cb08ea23a1f687ec INFO: 172.21.0.1:42582 - "POST /node/69ce34d2cb08ea23a1f687ec HTTP/1.0" 202 Accepted 2026-04-02 09:24:23,383 - lava_callback - INFO - Starting async job submit for node 69ce34d2cb08ea23a1f687ec 2026-04-02 09:24:23,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:23,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d2cb08ea23a1f687ec HTTP/1.1" 200 None 2026-04-02 09:24:23,426 - lava_callback - DEBUG - Processing node 69ce34d2cb08ea23a1f687ec: baseline-nfs-arm64 2026-04-02 09:24:23,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:24,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:24,272 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d2cb08ea23a1f687ec/log.txt.gz 2026-04-02 09:24:24,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:24,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:24,674 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d2cb08ea23a1f687ec/lava-logs.yaml 2026-04-02 09:24:24,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:24,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:24,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d2cb08ea23a1f687ec/lava_callback.json.gz 2026-04-02 09:24:24,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:24,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d2cb08ea23a1f687ec HTTP/1.1" 200 None 2026-04-02 09:24:24,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:24,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:24:24,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:24,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d2cb08ea23a1f687ec HTTP/1.1" 200 None 2026-04-02 09:24:24,917 - lava_callback - INFO - Completed processing callback for node 69ce34d2cb08ea23a1f687ec 2026-04-02 09:24:26,225 - lava_callback - INFO - Received callback for node 69ce34f2cb08ea23a1f6885b INFO: 172.21.0.1:42588 - "POST /node/69ce34f2cb08ea23a1f6885b HTTP/1.0" 202 Accepted 2026-04-02 09:24:26,231 - lava_callback - INFO - Starting async job submit for node 69ce34f2cb08ea23a1f6885b 2026-04-02 09:24:26,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:26,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f2cb08ea23a1f6885b HTTP/1.1" 200 None 2026-04-02 09:24:26,272 - lava_callback - DEBUG - Processing node 69ce34f2cb08ea23a1f6885b: baseline-arm64-broonie 2026-04-02 09:24:26,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:24:26,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:26,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f2cb08ea23a1f6885b/log.txt.gz 2026-04-02 09:24:26,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:27,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:27,100 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f2cb08ea23a1f6885b/lava-logs.yaml 2026-04-02 09:24:27,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:27,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:27,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f2cb08ea23a1f6885b/lava_callback.json.gz 2026-04-02 09:24:27,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:27,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f2cb08ea23a1f6885b HTTP/1.1" 200 None 2026-04-02 09:24:27,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:27,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:27,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:24:27,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:24:27,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:27,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f2cb08ea23a1f6885b HTTP/1.1" 200 None 2026-04-02 09:24:27,485 - lava_callback - INFO - Completed processing callback for node 69ce34f2cb08ea23a1f6885b INFO: 172.21.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49638 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:24:46,643 - lava_callback - INFO - Received callback for node 69ce34c3cb08ea23a1f687b2 INFO: 172.21.0.1:49642 - "POST /node/69ce34c3cb08ea23a1f687b2 HTTP/1.0" 202 Accepted 2026-04-02 09:24:46,652 - lava_callback - INFO - Starting async job submit for node 69ce34c3cb08ea23a1f687b2 2026-04-02 09:24:46,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:46,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c3cb08ea23a1f687b2 HTTP/1.1" 200 None 2026-04-02 09:24:46,716 - lava_callback - DEBUG - Processing node 69ce34c3cb08ea23a1f687b2: baseline-arm64 2026-04-02 09:24:47,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:47,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:47,406 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c3cb08ea23a1f687b2/log.txt.gz 2026-04-02 09:24:47,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:47,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:47,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c3cb08ea23a1f687b2/lava-logs.yaml 2026-04-02 09:24:47,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:47,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:47,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c3cb08ea23a1f687b2/lava_callback.json.gz 2026-04-02 09:24:47,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:47,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c3cb08ea23a1f687b2 HTTP/1.1" 200 None 2026-04-02 09:24:47,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:48,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:24:48,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:48,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c3cb08ea23a1f687b2 HTTP/1.1" 200 None 2026-04-02 09:24:48,039 - lava_callback - INFO - Completed processing callback for node 69ce34c3cb08ea23a1f687b2 INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:24:57,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:57,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:25:02,046 - lava_callback - INFO - Received callback for node 69ce34d3cb08ea23a1f687ef INFO: 172.21.0.1:59614 - "POST /node/69ce34d3cb08ea23a1f687ef HTTP/1.0" 202 Accepted 2026-04-02 09:25:02,052 - lava_callback - INFO - Starting async job submit for node 69ce34d3cb08ea23a1f687ef 2026-04-02 09:25:02,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:02,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d3cb08ea23a1f687ef HTTP/1.1" 200 None 2026-04-02 09:25:02,098 - lava_callback - DEBUG - Processing node 69ce34d3cb08ea23a1f687ef: baseline-nfs-arm64 2026-04-02 09:25:02,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:25:02,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:25:02,737 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d3cb08ea23a1f687ef/log.txt.gz 2026-04-02 09:25:03,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:25:03,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:25:03,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d3cb08ea23a1f687ef/lava-logs.yaml 2026-04-02 09:25:03,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:25:03,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:25:03,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d3cb08ea23a1f687ef/lava_callback.json.gz 2026-04-02 09:25:03,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:03,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d3cb08ea23a1f687ef HTTP/1.1" 200 None 2026-04-02 09:25:03,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:03,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:25:03,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:03,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d3cb08ea23a1f687ef HTTP/1.1" 200 None 2026-04-02 09:25:03,642 - lava_callback - INFO - Completed processing callback for node 69ce34d3cb08ea23a1f687ef INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40420 - "GET /%26 HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:25:24,448 - lava_callback - INFO - Received callback for node 69cb92f12a64fa9aff937639 INFO: 172.21.0.1:54046 - "POST /node/69cb92f12a64fa9aff937639 HTTP/1.0" 202 Accepted 2026-04-02 09:25:24,453 - lava_callback - INFO - Starting async job submit for node 69cb92f12a64fa9aff937639 2026-04-02 09:25:24,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:24,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb92f12a64fa9aff937639 HTTP/1.1" 200 None 2026-04-02 09:25:24,470 - lava_callback - DEBUG - Processing node 69cb92f12a64fa9aff937639: baseline-arm-baylibre 2026-04-02 09:25:24,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb92f12a64fa9aff937639 2026-04-02 09:25:24,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:24,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb92f12a64fa9aff937639 HTTP/1.1" 200 None 2026-04-02 09:25:24,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:24,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:25:24,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:24,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb92f12a64fa9aff937639 HTTP/1.1" 200 None 2026-04-02 09:25:24,531 - lava_callback - ERROR - Error processing callback for node 69cb92f12a64fa9aff937639: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:25:27,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:27,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50986 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:26:30,083 - lava_callback - INFO - Received callback for node 69ce3633cb08ea23a1f689ef INFO: 172.21.0.1:55914 - "POST /node/69ce3633cb08ea23a1f689ef HTTP/1.0" 202 Accepted 2026-04-02 09:26:30,088 - lava_callback - INFO - Starting async job submit for node 69ce3633cb08ea23a1f689ef 2026-04-02 09:26:30,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:26:30,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3633cb08ea23a1f689ef HTTP/1.1" 200 None 2026-04-02 09:26:30,107 - lava_callback - DEBUG - Processing node 69ce3633cb08ea23a1f689ef: baseline-arm 2026-04-02 09:26:30,112 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:26:30,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:26:30,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:26:30,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3633cb08ea23a1f689ef/lava-logs.yaml 2026-04-02 09:26:30,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:26:30,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:26:30,367 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3633cb08ea23a1f689ef/lava_callback.json.gz 2026-04-02 09:26:30,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:26:30,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3633cb08ea23a1f689ef HTTP/1.1" 200 None 2026-04-02 09:26:30,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:26:30,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:26:30,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:26:30,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3633cb08ea23a1f689ef HTTP/1.1" 200 None 2026-04-02 09:26:30,463 - lava_callback - INFO - Completed processing callback for node 69ce3633cb08ea23a1f689ef INFO: 172.21.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:26:57,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:26:57,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:29:28,516 - lava_callback - INFO - Received callback for node 69ce34d9cb08ea23a1f687fb INFO: 172.21.0.1:58718 - "POST /node/69ce34d9cb08ea23a1f687fb HTTP/1.0" 202 Accepted 2026-04-02 09:29:28,524 - lava_callback - INFO - Starting async job submit for node 69ce34d9cb08ea23a1f687fb 2026-04-02 09:29:28,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:29:28,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d9cb08ea23a1f687fb HTTP/1.1" 200 None 2026-04-02 09:29:28,595 - lava_callback - DEBUG - Processing node 69ce34d9cb08ea23a1f687fb: baseline-nfs-arm64 2026-04-02 09:29:29,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:29:29,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:29:29,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d9cb08ea23a1f687fb/log.txt.gz 2026-04-02 09:29:30,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:29:30,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:29:30,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d9cb08ea23a1f687fb/lava-logs.yaml 2026-04-02 09:29:30,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:29:30,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:29:30,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d9cb08ea23a1f687fb/lava_callback.json.gz 2026-04-02 09:29:30,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:29:30,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d9cb08ea23a1f687fb HTTP/1.1" 200 None 2026-04-02 09:29:30,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:29:30,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:29:30,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:29:30,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d9cb08ea23a1f687fb HTTP/1.1" 200 None 2026-04-02 09:29:30,747 - lava_callback - INFO - Completed processing callback for node 69ce34d9cb08ea23a1f687fb INFO: 172.21.0.1:36172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:29:57,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:29:57,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:30:24,461 - lava_callback - INFO - Received callback for node 69cb94232a64fa9aff93767a INFO: 172.21.0.1:60118 - "POST /node/69cb94232a64fa9aff93767a HTTP/1.0" 202 Accepted 2026-04-02 09:30:24,466 - lava_callback - INFO - Starting async job submit for node 69cb94232a64fa9aff93767a 2026-04-02 09:30:24,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:30:24,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94232a64fa9aff93767a HTTP/1.1" 200 None 2026-04-02 09:30:24,482 - lava_callback - DEBUG - Processing node 69cb94232a64fa9aff93767a: baseline-arm-baylibre 2026-04-02 09:30:24,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb94232a64fa9aff93767a 2026-04-02 09:30:24,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:30:24,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94232a64fa9aff93767a HTTP/1.1" 200 None 2026-04-02 09:30:24,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:30:24,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:30:24,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:30:24,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb94232a64fa9aff93767a HTTP/1.1" 200 None 2026-04-02 09:30:24,537 - lava_callback - ERROR - Error processing callback for node 69cb94232a64fa9aff93767a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:32:24,683 - lava_callback - INFO - Received callback for node 69cb94932a64fa9aff937694 INFO: 172.21.0.1:50286 - "POST /node/69cb94932a64fa9aff937694 HTTP/1.0" 202 Accepted 2026-04-02 09:32:24,690 - lava_callback - INFO - Starting async job submit for node 69cb94932a64fa9aff937694 2026-04-02 09:32:24,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:24,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94932a64fa9aff937694 HTTP/1.1" 200 None 2026-04-02 09:32:24,717 - lava_callback - DEBUG - Processing node 69cb94932a64fa9aff937694: baseline-arm-baylibre 2026-04-02 09:32:24,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb94932a64fa9aff937694 2026-04-02 09:32:24,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:24,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94932a64fa9aff937694 HTTP/1.1" 200 None 2026-04-02 09:32:24,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:24,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:32:24,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:24,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb94932a64fa9aff937694 HTTP/1.1" 200 None 2026-04-02 09:32:24,770 - lava_callback - ERROR - Error processing callback for node 69cb94932a64fa9aff937694: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:32:52,788 - lava_callback - INFO - Received callback for node 69cb94bc2a64fa9aff9376a6 INFO: 172.21.0.1:34620 - "POST /node/69cb94bc2a64fa9aff9376a6 HTTP/1.0" 202 Accepted 2026-04-02 09:32:52,793 - lava_callback - INFO - Starting async job submit for node 69cb94bc2a64fa9aff9376a6 2026-04-02 09:32:52,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:52,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94bc2a64fa9aff9376a6 HTTP/1.1" 200 None 2026-04-02 09:32:52,810 - lava_callback - DEBUG - Processing node 69cb94bc2a64fa9aff9376a6: baseline-arm-clabbe 2026-04-02 09:32:52,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb94bc2a64fa9aff9376a6 2026-04-02 09:32:52,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:52,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94bc2a64fa9aff9376a6 HTTP/1.1" 200 None 2026-04-02 09:32:52,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:52,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:32:52,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:52,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb94bc2a64fa9aff9376a6 HTTP/1.1" 200 None 2026-04-02 09:32:52,878 - lava_callback - ERROR - Error processing callback for node 69cb94bc2a64fa9aff9376a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:33:32,774 - lava_callback - INFO - Received callback for node 69cb94e12a64fa9aff9376b4 INFO: 172.21.0.1:40860 - "POST /node/69cb94e12a64fa9aff9376b4 HTTP/1.0" 202 Accepted 2026-04-02 09:33:32,781 - lava_callback - INFO - Starting async job submit for node 69cb94e12a64fa9aff9376b4 2026-04-02 09:33:32,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:33:32,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94e12a64fa9aff9376b4 HTTP/1.1" 200 None 2026-04-02 09:33:32,802 - lava_callback - DEBUG - Processing node 69cb94e12a64fa9aff9376b4: baseline-arm-clabbe 2026-04-02 09:33:32,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb94e12a64fa9aff9376b4 2026-04-02 09:33:32,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:33:32,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94e12a64fa9aff9376b4 HTTP/1.1" 200 None 2026-04-02 09:33:32,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:33:32,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:33:32,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:33:32,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb94e12a64fa9aff9376b4 HTTP/1.1" 200 None 2026-04-02 09:33:32,877 - lava_callback - ERROR - Error processing callback for node 69cb94e12a64fa9aff9376b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:34:12,856 - lava_callback - INFO - Received callback for node 69cb95062a64fa9aff9376bb INFO: 172.21.0.1:55546 - "POST /node/69cb95062a64fa9aff9376bb HTTP/1.0" 202 Accepted 2026-04-02 09:34:12,862 - lava_callback - INFO - Starting async job submit for node 69cb95062a64fa9aff9376bb 2026-04-02 09:34:12,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:12,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb95062a64fa9aff9376bb HTTP/1.1" 200 None 2026-04-02 09:34:12,886 - lava_callback - DEBUG - Processing node 69cb95062a64fa9aff9376bb: baseline-arm-clabbe 2026-04-02 09:34:12,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb95062a64fa9aff9376bb 2026-04-02 09:34:12,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:12,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb95062a64fa9aff9376bb HTTP/1.1" 200 None 2026-04-02 09:34:12,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:12,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:34:12,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:12,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb95062a64fa9aff9376bb HTTP/1.1" 200 None 2026-04-02 09:34:12,944 - lava_callback - ERROR - Error processing callback for node 69cb95062a64fa9aff9376bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:34:52,876 - lava_callback - INFO - Received callback for node 69cb952a2a64fa9aff9376c6 INFO: 172.21.0.1:60512 - "POST /node/69cb952a2a64fa9aff9376c6 HTTP/1.0" 202 Accepted 2026-04-02 09:34:52,882 - lava_callback - INFO - Starting async job submit for node 69cb952a2a64fa9aff9376c6 2026-04-02 09:34:52,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:52,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb952a2a64fa9aff9376c6 HTTP/1.1" 200 None 2026-04-02 09:34:52,912 - lava_callback - DEBUG - Processing node 69cb952a2a64fa9aff9376c6: baseline-arm-clabbe 2026-04-02 09:34:52,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb952a2a64fa9aff9376c6 2026-04-02 09:34:52,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:52,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb952a2a64fa9aff9376c6 HTTP/1.1" 200 None 2026-04-02 09:34:52,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:52,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:34:52,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:52,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb952a2a64fa9aff9376c6 HTTP/1.1" 200 None 2026-04-02 09:34:52,981 - lava_callback - ERROR - Error processing callback for node 69cb952a2a64fa9aff9376c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60518 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:34:59,684 - lava_callback - INFO - Received callback for node 69ce34d1cb08ea23a1f687e9 INFO: 172.21.0.1:60532 - "POST /node/69ce34d1cb08ea23a1f687e9 HTTP/1.0" 202 Accepted 2026-04-02 09:34:59,691 - lava_callback - INFO - Starting async job submit for node 69ce34d1cb08ea23a1f687e9 2026-04-02 09:34:59,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:59,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d1cb08ea23a1f687e9 HTTP/1.1" 200 None 2026-04-02 09:34:59,741 - lava_callback - DEBUG - Processing node 69ce34d1cb08ea23a1f687e9: baseline-arm64 2026-04-02 09:35:00,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:00,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:00,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34d1cb08ea23a1f687e9/log.txt.gz 2026-04-02 09:35:00,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:00,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:00,785 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34d1cb08ea23a1f687e9/lava-logs.yaml 2026-04-02 09:35:00,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:00,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:00,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34d1cb08ea23a1f687e9/lava_callback.json.gz DEBUG: Setup failed for 69ce34d1cb08ea23a1f687e9. Transitting job node result: incomplete -> fail 2026-04-02 09:35:01,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:01,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d1cb08ea23a1f687e9 HTTP/1.1" 200 None 2026-04-02 09:35:01,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:01,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:35:01,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:01,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d1cb08ea23a1f687e9 HTTP/1.1" 200 None 2026-04-02 09:35:01,208 - lava_callback - INFO - Completed processing callback for node 69ce34d1cb08ea23a1f687e9 INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52828 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:35:27,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:27,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:35:56,903 - lava_callback - INFO - Received callback for node 69ce34cccb08ea23a1f687dc INFO: 172.21.0.1:44480 - "POST /node/69ce34cccb08ea23a1f687dc HTTP/1.0" 202 Accepted 2026-04-02 09:35:56,914 - lava_callback - INFO - Starting async job submit for node 69ce34cccb08ea23a1f687dc 2026-04-02 09:35:56,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:56,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cccb08ea23a1f687dc HTTP/1.1" 200 None 2026-04-02 09:35:56,957 - lava_callback - DEBUG - Processing node 69ce34cccb08ea23a1f687dc: baseline-arm64 2026-04-02 09:35:57,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:57,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:57,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cccb08ea23a1f687dc/log.txt.gz 2026-04-02 09:35:57,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:58,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:58,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cccb08ea23a1f687dc/lava-logs.yaml 2026-04-02 09:35:58,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:58,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:58,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cccb08ea23a1f687dc/lava_callback.json.gz 2026-04-02 09:35:58,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:58,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cccb08ea23a1f687dc HTTP/1.1" 200 None 2026-04-02 09:35:58,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:58,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:35:58,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:58,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34cccb08ea23a1f687dc HTTP/1.1" 200 None 2026-04-02 09:35:58,449 - lava_callback - INFO - Completed processing callback for node 69ce34cccb08ea23a1f687dc INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:36:27,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:27,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52412 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:36:32,982 - lava_callback - INFO - Received callback for node 69cb959d2a64fa9aff9376e1 INFO: 172.21.0.1:52418 - "POST /node/69cb959d2a64fa9aff9376e1 HTTP/1.0" 202 Accepted 2026-04-02 09:36:32,989 - lava_callback - INFO - Starting async job submit for node 69cb959d2a64fa9aff9376e1 2026-04-02 09:36:32,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:33,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb959d2a64fa9aff9376e1 HTTP/1.1" 200 None 2026-04-02 09:36:33,010 - lava_callback - DEBUG - Processing node 69cb959d2a64fa9aff9376e1: baseline-arm-clabbe 2026-04-02 09:36:33,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb959d2a64fa9aff9376e1 2026-04-02 09:36:33,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:33,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb959d2a64fa9aff9376e1 HTTP/1.1" 200 None 2026-04-02 09:36:33,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:33,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:36:33,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:33,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb959d2a64fa9aff9376e1 HTTP/1.1" 200 None 2026-04-02 09:36:33,067 - lava_callback - ERROR - Error processing callback for node 69cb959d2a64fa9aff9376e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:36:47,337 - lava_callback - INFO - Received callback for node 69ce34dccb08ea23a1f6880b INFO: 172.21.0.1:57956 - "POST /node/69ce34dccb08ea23a1f6880b HTTP/1.0" 202 Accepted 2026-04-02 09:36:47,344 - lava_callback - INFO - Starting async job submit for node 69ce34dccb08ea23a1f6880b 2026-04-02 09:36:47,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:47,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dccb08ea23a1f6880b HTTP/1.1" 200 None 2026-04-02 09:36:47,388 - lava_callback - DEBUG - Processing node 69ce34dccb08ea23a1f6880b: baseline-nfs-arm64 2026-04-02 09:36:47,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:36:48,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:36:48,094 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dccb08ea23a1f6880b/log.txt.gz 2026-04-02 09:36:48,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:36:48,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:36:48,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dccb08ea23a1f6880b/lava-logs.yaml 2026-04-02 09:36:48,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:36:48,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:36:48,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dccb08ea23a1f6880b/lava_callback.json.gz 2026-04-02 09:36:49,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:49,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dccb08ea23a1f6880b HTTP/1.1" 200 None 2026-04-02 09:36:49,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:49,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:36:49,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:49,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34dccb08ea23a1f6880b HTTP/1.1" 200 None 2026-04-02 09:36:49,151 - lava_callback - INFO - Completed processing callback for node 69ce34dccb08ea23a1f6880b INFO: 172.21.0.1:36874 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:36:57,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:57,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:41:27,644 - lava_callback - INFO - Received callback for node 69ce34d6cb08ea23a1f687f5 INFO: 172.21.0.1:49148 - "POST /node/69ce34d6cb08ea23a1f687f5 HTTP/1.0" 202 Accepted 2026-04-02 09:41:27,652 - lava_callback - INFO - Starting async job submit for node 69ce34d6cb08ea23a1f687f5 2026-04-02 09:41:27,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:41:27,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d6cb08ea23a1f687f5 HTTP/1.1" 200 None 2026-04-02 09:41:27,710 - lava_callback - DEBUG - Processing node 69ce34d6cb08ea23a1f687f5: baseline-nfs-arm64 2026-04-02 09:41:28,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:41:28,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:41:28,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d6cb08ea23a1f687f5/log.txt.gz 2026-04-02 09:41:29,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:41:30,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:41:30,009 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d6cb08ea23a1f687f5/lava-logs.yaml 2026-04-02 09:41:30,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:41:30,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:41:30,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d6cb08ea23a1f687f5/lava_callback.json.gz DEBUG: Setup failed for 69ce34d6cb08ea23a1f687f5. Transitting job node result: incomplete -> fail 2026-04-02 09:41:30,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:41:30,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d6cb08ea23a1f687f5 HTTP/1.1" 200 None 2026-04-02 09:41:30,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:41:30,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:41:30,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:41:30,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d6cb08ea23a1f687f5 HTTP/1.1" 200 None 2026-04-02 09:41:30,458 - lava_callback - INFO - Completed processing callback for node 69ce34d6cb08ea23a1f687f5 INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:41:57,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:41:57,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43862 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:45:05,270 - lava_callback - INFO - Received callback for node 69cb978f2a64fa9aff937731 INFO: 172.21.0.1:36586 - "POST /node/69cb978f2a64fa9aff937731 HTTP/1.0" 202 Accepted 2026-04-02 09:45:05,275 - lava_callback - INFO - Starting async job submit for node 69cb978f2a64fa9aff937731 2026-04-02 09:45:05,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:45:05,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb978f2a64fa9aff937731 HTTP/1.1" 200 None 2026-04-02 09:45:05,293 - lava_callback - DEBUG - Processing node 69cb978f2a64fa9aff937731: baseline-arm64-baylibre 2026-04-02 09:45:05,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb978f2a64fa9aff937731 2026-04-02 09:45:05,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:45:05,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb978f2a64fa9aff937731 HTTP/1.1" 200 None 2026-04-02 09:45:05,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:45:05,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 09:45:05,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:45:05,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb978f2a64fa9aff937731 HTTP/1.1" 200 None 2026-04-02 09:45:05,383 - lava_callback - ERROR - Error processing callback for node 69cb978f2a64fa9aff937731: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:47:25,355 - lava_callback - INFO - Received callback for node 69cb98262a64fa9aff937747 INFO: 172.21.0.1:40148 - "POST /node/69cb98262a64fa9aff937747 HTTP/1.0" 202 Accepted 2026-04-02 09:47:25,361 - lava_callback - INFO - Starting async job submit for node 69cb98262a64fa9aff937747 2026-04-02 09:47:25,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:47:25,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb98262a64fa9aff937747 HTTP/1.1" 200 None 2026-04-02 09:47:25,386 - lava_callback - DEBUG - Processing node 69cb98262a64fa9aff937747: baseline-arm64-baylibre 2026-04-02 09:47:25,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb98262a64fa9aff937747 2026-04-02 09:47:25,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:47:25,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb98262a64fa9aff937747 HTTP/1.1" 200 None 2026-04-02 09:47:25,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:47:25,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 09:47:25,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:47:25,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb98262a64fa9aff937747 HTTP/1.1" 200 None 2026-04-02 09:47:25,459 - lava_callback - ERROR - Error processing callback for node 69cb98262a64fa9aff937747: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:51:25,561 - lava_callback - INFO - Received callback for node 69cb990a2a64fa9aff93776f INFO: 172.21.0.1:42412 - "POST /node/69cb990a2a64fa9aff93776f HTTP/1.0" 202 Accepted 2026-04-02 09:51:25,567 - lava_callback - INFO - Starting async job submit for node 69cb990a2a64fa9aff93776f 2026-04-02 09:51:25,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:51:25,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb990a2a64fa9aff93776f HTTP/1.1" 200 None 2026-04-02 09:51:25,583 - lava_callback - DEBUG - Processing node 69cb990a2a64fa9aff93776f: baseline-arm64-baylibre 2026-04-02 09:51:25,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb990a2a64fa9aff93776f 2026-04-02 09:51:25,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:51:25,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb990a2a64fa9aff93776f HTTP/1.1" 200 None 2026-04-02 09:51:25,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:51:25,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 09:51:25,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:51:25,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb990a2a64fa9aff93776f HTTP/1.1" 200 None 2026-04-02 09:51:25,640 - lava_callback - ERROR - Error processing callback for node 69cb990a2a64fa9aff93776f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:52:24,277 - lava_callback - INFO - Received callback for node 69ce3c45cb08ea23a1f68b28 INFO: 172.21.0.1:60360 - "POST /node/69ce3c45cb08ea23a1f68b28 HTTP/1.0" 202 Accepted 2026-04-02 09:52:24,284 - lava_callback - INFO - Starting async job submit for node 69ce3c45cb08ea23a1f68b28 2026-04-02 09:52:24,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:24,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3c45cb08ea23a1f68b28 HTTP/1.1" 200 None 2026-04-02 09:52:24,304 - lava_callback - DEBUG - Processing node 69ce3c45cb08ea23a1f68b28: baseline-nfs-arm64 2026-04-02 09:52:24,306 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:52:24,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:52:24,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:52:24,525 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3c45cb08ea23a1f68b28/lava-logs.yaml 2026-04-02 09:52:24,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:52:24,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:52:24,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3c45cb08ea23a1f68b28/lava_callback.json.gz 2026-04-02 09:52:24,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:24,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3c45cb08ea23a1f68b28 HTTP/1.1" 200 None 2026-04-02 09:52:24,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:24,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:52:24,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:24,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3c45cb08ea23a1f68b28 HTTP/1.1" 200 None 2026-04-02 09:52:24,755 - lava_callback - INFO - Completed processing callback for node 69ce3c45cb08ea23a1f68b28 2026-04-02 09:52:25,574 - lava_callback - INFO - Received callback for node 69cb99562a64fa9aff937781 INFO: 172.21.0.1:60368 - "POST /node/69cb99562a64fa9aff937781 HTTP/1.0" 202 Accepted 2026-04-02 09:52:25,580 - lava_callback - INFO - Starting async job submit for node 69cb99562a64fa9aff937781 2026-04-02 09:52:25,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:25,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99562a64fa9aff937781 HTTP/1.1" 200 None 2026-04-02 09:52:25,597 - lava_callback - DEBUG - Processing node 69cb99562a64fa9aff937781: baseline-arm64-baylibre 2026-04-02 09:52:25,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb99562a64fa9aff937781 2026-04-02 09:52:25,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:25,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99562a64fa9aff937781 HTTP/1.1" 200 None 2026-04-02 09:52:25,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:25,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:52:25,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:25,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb99562a64fa9aff937781 HTTP/1.1" 200 None 2026-04-02 09:52:25,665 - lava_callback - ERROR - Error processing callback for node 69cb99562a64fa9aff937781: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:52:27,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:27,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43094 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:53:45,655 - lava_callback - INFO - Received callback for node 69cb99a32a64fa9aff937789 INFO: 172.21.0.1:46460 - "POST /node/69cb99a32a64fa9aff937789 HTTP/1.0" 202 Accepted 2026-04-02 09:53:45,661 - lava_callback - INFO - Starting async job submit for node 69cb99a32a64fa9aff937789 2026-04-02 09:53:45,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:53:45,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99a32a64fa9aff937789 HTTP/1.1" 200 None 2026-04-02 09:53:45,689 - lava_callback - DEBUG - Processing node 69cb99a32a64fa9aff937789: baseline-arm64-baylibre 2026-04-02 09:53:45,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb99a32a64fa9aff937789 2026-04-02 09:53:45,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:53:45,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99a32a64fa9aff937789 HTTP/1.1" 200 None 2026-04-02 09:53:45,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:53:45,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:53:45,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:53:45,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb99a32a64fa9aff937789 HTTP/1.1" 200 None 2026-04-02 09:53:45,740 - lava_callback - ERROR - Error processing callback for node 69cb99a32a64fa9aff937789: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:54:02,065 - lava_callback - INFO - Received callback for node 69ce3c8acb08ea23a1f68b38 INFO: 172.21.0.1:40716 - "POST /node/69ce3c8acb08ea23a1f68b38 HTTP/1.0" 202 Accepted 2026-04-02 09:54:02,072 - lava_callback - INFO - Starting async job submit for node 69ce3c8acb08ea23a1f68b38 2026-04-02 09:54:02,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:54:02,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3c8acb08ea23a1f68b38 HTTP/1.1" 200 None 2026-04-02 09:54:02,125 - lava_callback - DEBUG - Processing node 69ce3c8acb08ea23a1f68b38: baseline-arm64 2026-04-02 09:54:02,267 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:54:02,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:54:02,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:54:02,641 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3c8acb08ea23a1f68b38/lava-logs.yaml 2026-04-02 09:54:02,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:54:03,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:54:03,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3c8acb08ea23a1f68b38/lava_callback.json.gz 2026-04-02 09:54:03,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:54:03,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3c8acb08ea23a1f68b38 HTTP/1.1" 200 None 2026-04-02 09:54:03,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:54:03,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:54:03,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:54:03,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3c8acb08ea23a1f68b38 HTTP/1.1" 200 None 2026-04-02 09:54:03,272 - lava_callback - INFO - Completed processing callback for node 69ce3c8acb08ea23a1f68b38 INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:54:27,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:54:27,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:55:05,738 - lava_callback - INFO - Received callback for node 69cb99ee2a64fa9aff937795 INFO: 172.21.0.1:60586 - "POST /node/69cb99ee2a64fa9aff937795 HTTP/1.0" 202 Accepted 2026-04-02 09:55:05,743 - lava_callback - INFO - Starting async job submit for node 69cb99ee2a64fa9aff937795 2026-04-02 09:55:05,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:05,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99ee2a64fa9aff937795 HTTP/1.1" 200 None 2026-04-02 09:55:05,759 - lava_callback - DEBUG - Processing node 69cb99ee2a64fa9aff937795: baseline-arm64-baylibre 2026-04-02 09:55:05,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb99ee2a64fa9aff937795 2026-04-02 09:55:05,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:05,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99ee2a64fa9aff937795 HTTP/1.1" 200 None 2026-04-02 09:55:05,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:05,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:55:05,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:05,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb99ee2a64fa9aff937795 HTTP/1.1" 200 None 2026-04-02 09:55:05,812 - lava_callback - ERROR - Error processing callback for node 69cb99ee2a64fa9aff937795: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:55:54,932 - lava_callback - INFO - Received callback for node 69ce3cd7cb08ea23a1f68b45 INFO: 172.21.0.1:52226 - "POST /node/69ce3cd7cb08ea23a1f68b45 HTTP/1.0" 202 Accepted 2026-04-02 09:55:54,938 - lava_callback - INFO - Starting async job submit for node 69ce3cd7cb08ea23a1f68b45 2026-04-02 09:55:54,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:54,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3cd7cb08ea23a1f68b45 HTTP/1.1" 200 None 2026-04-02 09:55:54,984 - lava_callback - DEBUG - Processing node 69ce3cd7cb08ea23a1f68b45: baseline-arm64 2026-04-02 09:55:55,118 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:55:55,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:55:55,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:55:55,390 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3cd7cb08ea23a1f68b45/lava-logs.yaml 2026-04-02 09:55:55,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:55:55,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:55:55,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3cd7cb08ea23a1f68b45/lava_callback.json.gz 2026-04-02 09:55:55,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:55,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3cd7cb08ea23a1f68b45 HTTP/1.1" 200 None 2026-04-02 09:55:55,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:55,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:55:55,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:55,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3cd7cb08ea23a1f68b45 HTTP/1.1" 200 None 2026-04-02 09:55:55,920 - lava_callback - INFO - Completed processing callback for node 69ce3cd7cb08ea23a1f68b45 INFO: 172.21.0.1:52228 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:55:57,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:57,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39278 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:56:25,802 - lava_callback - INFO - Received callback for node 69cb9a3e2a64fa9aff93779d INFO: 172.21.0.1:45068 - "POST /node/69cb9a3e2a64fa9aff93779d HTTP/1.0" 202 Accepted 2026-04-02 09:56:25,808 - lava_callback - INFO - Starting async job submit for node 69cb9a3e2a64fa9aff93779d 2026-04-02 09:56:25,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:56:25,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9a3e2a64fa9aff93779d HTTP/1.1" 200 None 2026-04-02 09:56:25,827 - lava_callback - DEBUG - Processing node 69cb9a3e2a64fa9aff93779d: baseline-arm64-baylibre 2026-04-02 09:56:25,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9a3e2a64fa9aff93779d 2026-04-02 09:56:25,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:56:25,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9a3e2a64fa9aff93779d HTTP/1.1" 200 None 2026-04-02 09:56:25,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:56:25,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:56:25,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:56:25,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9a3e2a64fa9aff93779d HTTP/1.1" 200 None 2026-04-02 09:56:25,890 - lava_callback - ERROR - Error processing callback for node 69cb9a3e2a64fa9aff93779d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:57:42,609 - lava_callback - INFO - Received callback for node 69ce3d4bcb08ea23a1f68b64 INFO: 172.21.0.1:38158 - "POST /node/69ce3d4bcb08ea23a1f68b64 HTTP/1.0" 202 Accepted 2026-04-02 09:57:42,615 - lava_callback - INFO - Starting async job submit for node 69ce3d4bcb08ea23a1f68b64 2026-04-02 09:57:42,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:42,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d4bcb08ea23a1f68b64 HTTP/1.1" 200 None 2026-04-02 09:57:42,660 - lava_callback - DEBUG - Processing node 69ce3d4bcb08ea23a1f68b64: baseline-arm64 2026-04-02 09:57:43,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:57:43,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:57:43,299 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d4bcb08ea23a1f68b64/log.txt.gz 2026-04-02 09:57:43,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:57:43,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:57:43,811 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d4bcb08ea23a1f68b64/lava-logs.yaml 2026-04-02 09:57:43,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:57:43,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:57:43,983 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d4bcb08ea23a1f68b64/lava_callback.json.gz 2026-04-02 09:57:44,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:44,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d4bcb08ea23a1f68b64 HTTP/1.1" 200 None 2026-04-02 09:57:44,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:44,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:57:44,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:44,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3d4bcb08ea23a1f68b64 HTTP/1.1" 200 None 2026-04-02 09:57:44,130 - lava_callback - INFO - Completed processing callback for node 69ce3d4bcb08ea23a1f68b64 2026-04-02 09:57:45,936 - lava_callback - INFO - Received callback for node 69cb9a8a2a64fa9aff9377ad INFO: 172.21.0.1:38170 - "POST /node/69cb9a8a2a64fa9aff9377ad HTTP/1.0" 202 Accepted 2026-04-02 09:57:45,941 - lava_callback - INFO - Starting async job submit for node 69cb9a8a2a64fa9aff9377ad 2026-04-02 09:57:45,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:45,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9a8a2a64fa9aff9377ad HTTP/1.1" 200 None 2026-04-02 09:57:45,958 - lava_callback - DEBUG - Processing node 69cb9a8a2a64fa9aff9377ad: baseline-arm64-baylibre 2026-04-02 09:57:45,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9a8a2a64fa9aff9377ad 2026-04-02 09:57:45,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:45,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9a8a2a64fa9aff9377ad HTTP/1.1" 200 None 2026-04-02 09:57:45,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:45,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:57:45,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:46,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9a8a2a64fa9aff9377ad HTTP/1.1" 200 None 2026-04-02 09:57:46,018 - lava_callback - ERROR - Error processing callback for node 69cb9a8a2a64fa9aff9377ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:57:57,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:57,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:59:25,977 - lava_callback - INFO - Received callback for node 69cb9afa2a64fa9aff9377c5 INFO: 172.21.0.1:36510 - "POST /node/69cb9afa2a64fa9aff9377c5 HTTP/1.0" 202 Accepted 2026-04-02 09:59:25,983 - lava_callback - INFO - Starting async job submit for node 69cb9afa2a64fa9aff9377c5 2026-04-02 09:59:25,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:59:26,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9afa2a64fa9aff9377c5 HTTP/1.1" 200 None 2026-04-02 09:59:26,001 - lava_callback - DEBUG - Processing node 69cb9afa2a64fa9aff9377c5: baseline-arm64-baylibre 2026-04-02 09:59:26,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9afa2a64fa9aff9377c5 2026-04-02 09:59:26,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:59:26,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9afa2a64fa9aff9377c5 HTTP/1.1" 200 None 2026-04-02 09:59:26,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:59:26,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:59:26,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:59:26,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9afa2a64fa9aff9377c5 HTTP/1.1" 200 None 2026-04-02 09:59:26,060 - lava_callback - ERROR - Error processing callback for node 69cb9afa2a64fa9aff9377c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:00:46,034 - lava_callback - INFO - Received callback for node 69cb9b472a64fa9aff9377ce INFO: 172.21.0.1:55534 - "POST /node/69cb9b472a64fa9aff9377ce HTTP/1.0" 202 Accepted 2026-04-02 10:00:46,040 - lava_callback - INFO - Starting async job submit for node 69cb9b472a64fa9aff9377ce 2026-04-02 10:00:46,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:00:46,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9b472a64fa9aff9377ce HTTP/1.1" 200 None 2026-04-02 10:00:46,060 - lava_callback - DEBUG - Processing node 69cb9b472a64fa9aff9377ce: baseline-arm64-baylibre 2026-04-02 10:00:46,060 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9b472a64fa9aff9377ce 2026-04-02 10:00:46,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:00:46,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9b472a64fa9aff9377ce HTTP/1.1" 200 None 2026-04-02 10:00:46,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:00:46,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:00:46,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:00:46,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9b472a64fa9aff9377ce HTTP/1.1" 200 None 2026-04-02 10:00:46,145 - lava_callback - ERROR - Error processing callback for node 69cb9b472a64fa9aff9377ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:03:34,123 - lava_callback - INFO - Received callback for node 69cb9be92a64fa9aff9377e6 INFO: 172.21.0.1:48144 - "POST /node/69cb9be92a64fa9aff9377e6 HTTP/1.0" 202 Accepted 2026-04-02 10:03:34,130 - lava_callback - INFO - Starting async job submit for node 69cb9be92a64fa9aff9377e6 2026-04-02 10:03:34,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:03:34,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9be92a64fa9aff9377e6 HTTP/1.1" 200 None 2026-04-02 10:03:34,150 - lava_callback - DEBUG - Processing node 69cb9be92a64fa9aff9377e6: baseline-arm64-clabbe 2026-04-02 10:03:34,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9be92a64fa9aff9377e6 2026-04-02 10:03:34,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:03:34,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9be92a64fa9aff9377e6 HTTP/1.1" 200 None 2026-04-02 10:03:34,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:03:34,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:03:34,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:03:34,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9be92a64fa9aff9377e6 HTTP/1.1" 200 None 2026-04-02 10:03:34,215 - lava_callback - ERROR - Error processing callback for node 69cb9be92a64fa9aff9377e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:04:54,232 - lava_callback - INFO - Received callback for node 69cb9c372a64fa9aff9377ec INFO: 172.21.0.1:54476 - "POST /node/69cb9c372a64fa9aff9377ec HTTP/1.0" 202 Accepted 2026-04-02 10:04:54,238 - lava_callback - INFO - Starting async job submit for node 69cb9c372a64fa9aff9377ec 2026-04-02 10:04:54,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:04:54,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9c372a64fa9aff9377ec HTTP/1.1" 200 None 2026-04-02 10:04:54,276 - lava_callback - DEBUG - Processing node 69cb9c372a64fa9aff9377ec: baseline-arm64-clabbe 2026-04-02 10:04:54,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9c372a64fa9aff9377ec 2026-04-02 10:04:54,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:04:54,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9c372a64fa9aff9377ec HTTP/1.1" 200 None 2026-04-02 10:04:54,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:04:54,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:04:54,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:04:54,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9c372a64fa9aff9377ec HTTP/1.1" 200 None 2026-04-02 10:04:54,346 - lava_callback - ERROR - Error processing callback for node 69cb9c372a64fa9aff9377ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:05:57,695 - lava_callback - INFO - Received callback for node 69ce3d9bcb08ea23a1f68b75 INFO: 172.21.0.1:45608 - "POST /node/69ce3d9bcb08ea23a1f68b75 HTTP/1.0" 202 Accepted 2026-04-02 10:05:57,703 - lava_callback - INFO - Starting async job submit for node 69ce3d9bcb08ea23a1f68b75 2026-04-02 10:05:57,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:05:57,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d9bcb08ea23a1f68b75 HTTP/1.1" 200 None 2026-04-02 10:05:57,768 - lava_callback - DEBUG - Processing node 69ce3d9bcb08ea23a1f68b75: baseline-arm64 2026-04-02 10:05:58,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:05:58,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:05:58,365 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d9bcb08ea23a1f68b75/log.txt.gz 2026-04-02 10:05:58,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:05:58,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:05:58,812 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d9bcb08ea23a1f68b75/lava-logs.yaml 2026-04-02 10:05:58,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:05:59,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:05:59,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d9bcb08ea23a1f68b75/lava_callback.json.gz DEBUG: Setup failed for 69ce3d9bcb08ea23a1f68b75. Transitting job node result: incomplete -> fail 2026-04-02 10:05:59,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:05:59,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d9bcb08ea23a1f68b75 HTTP/1.1" 200 None 2026-04-02 10:05:59,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:05:59,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:05:59,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:05:59,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3d9bcb08ea23a1f68b75 HTTP/1.1" 200 None 2026-04-02 10:05:59,275 - lava_callback - INFO - Completed processing callback for node 69ce3d9bcb08ea23a1f68b75 INFO: 172.21.0.1:44798 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:06:14,245 - lava_callback - INFO - Received callback for node 69cb9c852a64fa9aff9377f8 INFO: 172.21.0.1:45332 - "POST /node/69cb9c852a64fa9aff9377f8 HTTP/1.0" 202 Accepted 2026-04-02 10:06:14,250 - lava_callback - INFO - Starting async job submit for node 69cb9c852a64fa9aff9377f8 2026-04-02 10:06:14,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:14,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9c852a64fa9aff9377f8 HTTP/1.1" 200 None 2026-04-02 10:06:14,269 - lava_callback - DEBUG - Processing node 69cb9c852a64fa9aff9377f8: baseline-arm64-clabbe 2026-04-02 10:06:14,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9c852a64fa9aff9377f8 2026-04-02 10:06:14,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:14,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9c852a64fa9aff9377f8 HTTP/1.1" 200 None 2026-04-02 10:06:14,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:14,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:06:14,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:14,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9c852a64fa9aff9377f8 HTTP/1.1" 200 None 2026-04-02 10:06:14,320 - lava_callback - ERROR - Error processing callback for node 69cb9c852a64fa9aff9377f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50730 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:06:27,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:27,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:06:47,045 - lava_callback - INFO - Received callback for node 69ce3fa3cb08ea23a1f68bc6 INFO: 172.21.0.1:37402 - "POST /node/69ce3fa3cb08ea23a1f68bc6 HTTP/1.0" 202 Accepted 2026-04-02 10:06:47,051 - lava_callback - INFO - Starting async job submit for node 69ce3fa3cb08ea23a1f68bc6 2026-04-02 10:06:47,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:47,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3fa3cb08ea23a1f68bc6 HTTP/1.1" 200 None 2026-04-02 10:06:47,067 - lava_callback - DEBUG - Processing node 69ce3fa3cb08ea23a1f68bc6: baseline-nfs-arm64 2026-04-02 10:06:47,069 - lava_callback - WARNING - Failed to upload log 2026-04-02 10:06:47,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:06:47,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:06:47,223 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3fa3cb08ea23a1f68bc6/lava-logs.yaml 2026-04-02 10:06:47,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:06:47,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:06:47,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3fa3cb08ea23a1f68bc6/lava_callback.json.gz 2026-04-02 10:06:47,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:47,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3fa3cb08ea23a1f68bc6 HTTP/1.1" 200 None 2026-04-02 10:06:47,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:47,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:06:47,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:47,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3fa3cb08ea23a1f68bc6 HTTP/1.1" 200 None 2026-04-02 10:06:47,422 - lava_callback - INFO - Completed processing callback for node 69ce3fa3cb08ea23a1f68bc6 INFO: 172.21.0.1:59936 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:06:57,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:57,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 10:07:06,100 - lava_callback - INFO - Received callback for node 69ce3b41cb08ea23a1f68b00 INFO: 172.21.0.1:35530 - "POST /node/69ce3b41cb08ea23a1f68b00 HTTP/1.0" 202 Accepted 2026-04-02 10:07:06,157 - lava_callback - INFO - Starting async job submit for node 69ce3b41cb08ea23a1f68b00 2026-04-02 10:07:06,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:07:06,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3b41cb08ea23a1f68b00 HTTP/1.1" 200 None 2026-04-02 10:07:06,219 - lava_callback - DEBUG - Processing node 69ce3b41cb08ea23a1f68b00: baseline-arm-pengutronix 2026-04-02 10:07:06,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:07:06,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:07:06,496 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce3b41cb08ea23a1f68b00/log.txt.gz INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:07:06,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:07:06,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:07:06,723 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce3b41cb08ea23a1f68b00/lava-logs.yaml 2026-04-02 10:07:06,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:07:06,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:07:06,847 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce3b41cb08ea23a1f68b00/lava_callback.json.gz DEBUG: Setup failed for 69ce3b41cb08ea23a1f68b00. Transitting job node result: incomplete -> fail 2026-04-02 10:07:06,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:07:06,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3b41cb08ea23a1f68b00 HTTP/1.1" 200 None 2026-04-02 10:07:06,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:07:06,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 10:07:06,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:07:06,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3b41cb08ea23a1f68b00 HTTP/1.1" 200 None 2026-04-02 10:07:07,003 - lava_callback - INFO - Completed processing callback for node 69ce3b41cb08ea23a1f68b00 INFO: 172.21.0.1:47488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45034 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:07:27,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:07:27,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:08:54,338 - lava_callback - INFO - Received callback for node 69cb9d202a64fa9aff93780c INFO: 172.21.0.1:45900 - "POST /node/69cb9d202a64fa9aff93780c HTTP/1.0" 202 Accepted 2026-04-02 10:08:54,344 - lava_callback - INFO - Starting async job submit for node 69cb9d202a64fa9aff93780c 2026-04-02 10:08:54,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:08:54,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9d202a64fa9aff93780c HTTP/1.1" 200 None 2026-04-02 10:08:54,382 - lava_callback - DEBUG - Processing node 69cb9d202a64fa9aff93780c: baseline-arm64-clabbe 2026-04-02 10:08:54,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9d202a64fa9aff93780c 2026-04-02 10:08:54,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:08:54,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9d202a64fa9aff93780c HTTP/1.1" 200 None 2026-04-02 10:08:54,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:08:54,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:08:54,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:08:54,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9d202a64fa9aff93780c HTTP/1.1" 200 None 2026-04-02 10:08:54,448 - lava_callback - ERROR - Error processing callback for node 69cb9d202a64fa9aff93780c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45280 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:09:30,870 - lava_callback - INFO - Received callback for node 69ce3de4cb08ea23a1f68b80 INFO: 172.21.0.1:40050 - "POST /node/69ce3de4cb08ea23a1f68b80 HTTP/1.0" 202 Accepted 2026-04-02 10:09:30,877 - lava_callback - INFO - Starting async job submit for node 69ce3de4cb08ea23a1f68b80 2026-04-02 10:09:30,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:09:30,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3de4cb08ea23a1f68b80 HTTP/1.1" 200 None 2026-04-02 10:09:30,917 - lava_callback - DEBUG - Processing node 69ce3de4cb08ea23a1f68b80: baseline-arm64 2026-04-02 10:09:31,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:09:31,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:09:31,564 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3de4cb08ea23a1f68b80/log.txt.gz 2026-04-02 10:09:31,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:09:32,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:09:32,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3de4cb08ea23a1f68b80/lava-logs.yaml 2026-04-02 10:09:32,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:09:32,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:09:32,231 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3de4cb08ea23a1f68b80/lava_callback.json.gz 2026-04-02 10:09:32,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:09:32,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3de4cb08ea23a1f68b80 HTTP/1.1" 200 None 2026-04-02 10:09:32,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:09:32,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:09:32,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:09:32,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3de4cb08ea23a1f68b80 HTTP/1.1" 200 None 2026-04-02 10:09:32,395 - lava_callback - INFO - Completed processing callback for node 69ce3de4cb08ea23a1f68b80 INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:09:57,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:09:57,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:10:52,842 - lava_callback - INFO - Received callback for node 69ce3e36cb08ea23a1f68b8c INFO: 172.21.0.1:47012 - "POST /node/69ce3e36cb08ea23a1f68b8c HTTP/1.0" 202 Accepted 2026-04-02 10:10:52,849 - lava_callback - INFO - Starting async job submit for node 69ce3e36cb08ea23a1f68b8c 2026-04-02 10:10:52,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:10:52,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3e36cb08ea23a1f68b8c HTTP/1.1" 200 None 2026-04-02 10:10:52,890 - lava_callback - DEBUG - Processing node 69ce3e36cb08ea23a1f68b8c: baseline-nfs-arm64 2026-04-02 10:10:53,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:10:53,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:10:53,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e36cb08ea23a1f68b8c/log.txt.gz 2026-04-02 10:10:53,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:10:54,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:10:54,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e36cb08ea23a1f68b8c/lava-logs.yaml 2026-04-02 10:10:54,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:10:54,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:10:54,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e36cb08ea23a1f68b8c/lava_callback.json.gz 2026-04-02 10:10:54,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:10:54,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3e36cb08ea23a1f68b8c HTTP/1.1" 200 None 2026-04-02 10:10:54,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:10:54,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:10:54,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:10:54,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3e36cb08ea23a1f68b8c HTTP/1.1" 200 None 2026-04-02 10:10:54,546 - lava_callback - INFO - Completed processing callback for node 69ce3e36cb08ea23a1f68b8c INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:10:57,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:10:57,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:11:08,537 - lava_callback - INFO - Received callback for node 69ce4076cb08ea23a1f68beb INFO: 172.21.0.1:35788 - "POST /node/69ce4076cb08ea23a1f68beb HTTP/1.0" 202 Accepted 2026-04-02 10:11:08,544 - lava_callback - INFO - Starting async job submit for node 69ce4076cb08ea23a1f68beb 2026-04-02 10:11:08,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:11:08,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4076cb08ea23a1f68beb HTTP/1.1" 200 None 2026-04-02 10:11:08,590 - lava_callback - DEBUG - Processing node 69ce4076cb08ea23a1f68beb: baseline-arm64 2026-04-02 10:11:08,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:11:08,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:11:08,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4076cb08ea23a1f68beb/log.txt.gz 2026-04-02 10:11:09,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:11:09,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:11:09,250 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4076cb08ea23a1f68beb/lava-logs.yaml 2026-04-02 10:11:09,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:11:09,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:11:09,388 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4076cb08ea23a1f68beb/lava_callback.json.gz 2026-04-02 10:11:09,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:11:09,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4076cb08ea23a1f68beb HTTP/1.1" 200 None 2026-04-02 10:11:09,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:11:09,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:11:09,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:11:09,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4076cb08ea23a1f68beb HTTP/1.1" 200 None 2026-04-02 10:11:09,549 - lava_callback - INFO - Completed processing callback for node 69ce4076cb08ea23a1f68beb INFO: 172.21.0.1:41328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:11:27,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:11:27,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:12:34,460 - lava_callback - INFO - Received callback for node 69cb9e0e2a64fa9aff93782c INFO: 172.21.0.1:48968 - "POST /node/69cb9e0e2a64fa9aff93782c HTTP/1.0" 202 Accepted 2026-04-02 10:12:34,465 - lava_callback - INFO - Starting async job submit for node 69cb9e0e2a64fa9aff93782c 2026-04-02 10:12:34,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:12:34,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9e0e2a64fa9aff93782c HTTP/1.1" 200 None 2026-04-02 10:12:34,481 - lava_callback - DEBUG - Processing node 69cb9e0e2a64fa9aff93782c: baseline-arm64-clabbe 2026-04-02 10:12:34,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9e0e2a64fa9aff93782c 2026-04-02 10:12:34,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:12:34,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9e0e2a64fa9aff93782c HTTP/1.1" 200 None 2026-04-02 10:12:34,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:12:34,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:12:34,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:12:34,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9e0e2a64fa9aff93782c HTTP/1.1" 200 None 2026-04-02 10:12:34,539 - lava_callback - ERROR - Error processing callback for node 69cb9e0e2a64fa9aff93782c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET /node/698c536a755d7811a414168d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:13:22,285 - lava_callback - INFO - Received callback for node 69ce410acb08ea23a1f68c01 INFO: 172.21.0.1:46624 - "POST /node/69ce410acb08ea23a1f68c01 HTTP/1.0" 202 Accepted 2026-04-02 10:13:22,292 - lava_callback - INFO - Starting async job submit for node 69ce410acb08ea23a1f68c01 2026-04-02 10:13:22,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:13:22,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce410acb08ea23a1f68c01 HTTP/1.1" 200 None 2026-04-02 10:13:22,338 - lava_callback - DEBUG - Processing node 69ce410acb08ea23a1f68c01: baseline-arm64 2026-04-02 10:13:22,472 - lava_callback - WARNING - Failed to upload log 2026-04-02 10:13:22,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:13:22,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:13:22,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce410acb08ea23a1f68c01/lava-logs.yaml 2026-04-02 10:13:22,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:13:22,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:13:22,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce410acb08ea23a1f68c01/lava_callback.json.gz 2026-04-02 10:13:23,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:13:23,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce410acb08ea23a1f68c01 HTTP/1.1" 200 None 2026-04-02 10:13:23,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:13:23,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:13:23,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:13:23,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce410acb08ea23a1f68c01 HTTP/1.1" 200 None 2026-04-02 10:13:23,129 - lava_callback - INFO - Completed processing callback for node 69ce410acb08ea23a1f68c01 INFO: 172.21.0.1:46640 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:13:27,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:13:27,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:14:01,474 - lava_callback - INFO - Received callback for node 69ce3d21cb08ea23a1f68b51 INFO: 172.21.0.1:44712 - "POST /node/69ce3d21cb08ea23a1f68b51 HTTP/1.0" 202 Accepted 2026-04-02 10:14:01,486 - lava_callback - INFO - Starting async job submit for node 69ce3d21cb08ea23a1f68b51 2026-04-02 10:14:01,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:01,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d21cb08ea23a1f68b51 HTTP/1.1" 200 None 2026-04-02 10:14:01,577 - lava_callback - DEBUG - Processing node 69ce3d21cb08ea23a1f68b51: baseline-arm 2026-04-02 10:14:02,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:03,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:03,355 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3d21cb08ea23a1f68b51/log.txt.gz 2026-04-02 10:14:03,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:04,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:04,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3d21cb08ea23a1f68b51/lava-logs.yaml 2026-04-02 10:14:04,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:04,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:04,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3d21cb08ea23a1f68b51/lava_callback.json.gz DEBUG: Setup failed for 69ce3d21cb08ea23a1f68b51. Transitting job node result: incomplete -> fail 2026-04-02 10:14:04,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:04,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d21cb08ea23a1f68b51 HTTP/1.1" 200 None 2026-04-02 10:14:04,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:04,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 10:14:04,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:04,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3d21cb08ea23a1f68b51 HTTP/1.1" 200 None 2026-04-02 10:14:04,603 - lava_callback - INFO - Completed processing callback for node 69ce3d21cb08ea23a1f68b51 INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:14:08,504 - lava_callback - INFO - Received callback for node 69ce3d44cb08ea23a1f68b5f INFO: 172.21.0.1:44732 - "POST /node/69ce3d44cb08ea23a1f68b5f HTTP/1.0" 202 Accepted 2026-04-02 10:14:08,511 - lava_callback - INFO - Starting async job submit for node 69ce3d44cb08ea23a1f68b5f 2026-04-02 10:14:08,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:08,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d44cb08ea23a1f68b5f HTTP/1.1" 200 None 2026-04-02 10:14:08,623 - lava_callback - DEBUG - Processing node 69ce3d44cb08ea23a1f68b5f: ltp-smoke 2026-04-02 10:14:09,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:09,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:09,324 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3d44cb08ea23a1f68b5f/log.txt.gz 2026-04-02 10:14:09,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:09,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:09,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3d44cb08ea23a1f68b5f/lava-logs.yaml 2026-04-02 10:14:09,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:10,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:10,093 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3d44cb08ea23a1f68b5f/lava_callback.json.gz 2026-04-02 10:14:10,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:10,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d44cb08ea23a1f68b5f HTTP/1.1" 200 None 2026-04-02 10:14:10,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:10,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce266ecb08ea23a1f68074 HTTP/1.1" 200 None 2026-04-02 10:14:10,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:10,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3d44cb08ea23a1f68b5f HTTP/1.1" 200 None 2026-04-02 10:14:10,401 - lava_callback - INFO - Completed processing callback for node 69ce3d44cb08ea23a1f68b5f INFO: 172.21.0.1:33400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:14:27,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:27,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:15:14,535 - lava_callback - INFO - Received callback for node 69cb9ea72a64fa9aff937840 INFO: 172.21.0.1:41860 - "POST /node/69cb9ea72a64fa9aff937840 HTTP/1.0" 202 Accepted 2026-04-02 10:15:14,541 - lava_callback - INFO - Starting async job submit for node 69cb9ea72a64fa9aff937840 2026-04-02 10:15:14,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:15:14,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9ea72a64fa9aff937840 HTTP/1.1" 200 None 2026-04-02 10:15:14,557 - lava_callback - DEBUG - Processing node 69cb9ea72a64fa9aff937840: baseline-arm64-clabbe 2026-04-02 10:15:14,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9ea72a64fa9aff937840 2026-04-02 10:15:14,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:15:14,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9ea72a64fa9aff937840 HTTP/1.1" 200 None 2026-04-02 10:15:14,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:15:14,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:15:14,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:15:14,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9ea72a64fa9aff937840 HTTP/1.1" 200 None 2026-04-02 10:15:14,612 - lava_callback - ERROR - Error processing callback for node 69cb9ea72a64fa9aff937840: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:15:56,430 - lava_callback - INFO - Received callback for node 69ce41a7cb08ea23a1f68c27 INFO: 172.21.0.1:58456 - "POST /node/69ce41a7cb08ea23a1f68c27 HTTP/1.0" 202 Accepted 2026-04-02 10:15:56,440 - lava_callback - INFO - Starting async job submit for node 69ce41a7cb08ea23a1f68c27 2026-04-02 10:15:56,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:15:56,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce41a7cb08ea23a1f68c27 HTTP/1.1" 200 None 2026-04-02 10:15:56,475 - lava_callback - DEBUG - Processing node 69ce41a7cb08ea23a1f68c27: baseline-arm64 INFO: 172.21.0.1:58460 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:15:58,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:15:58,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:15:58,887 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce41a7cb08ea23a1f68c27/log.txt.gz 2026-04-02 10:16:00,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:16:00,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:16:00,445 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce41a7cb08ea23a1f68c27/lava-logs.yaml 2026-04-02 10:16:00,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:16:00,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:16:00,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce41a7cb08ea23a1f68c27/lava_callback.json.gz 2026-04-02 10:16:00,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:00,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce41a7cb08ea23a1f68c27 HTTP/1.1" 200 None 2026-04-02 10:16:00,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:00,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:16:00,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:00,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce41a7cb08ea23a1f68c27 HTTP/1.1" 200 None 2026-04-02 10:16:00,728 - lava_callback - INFO - Completed processing callback for node 69ce41a7cb08ea23a1f68c27 INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:16:27,010 - lava_callback - INFO - Received callback for node 69cb9ef82a64fa9aff937858 INFO: 172.21.0.1:38772 - "POST /node/69cb9ef82a64fa9aff937858 HTTP/1.0" 202 Accepted 2026-04-02 10:16:27,016 - lava_callback - INFO - Starting async job submit for node 69cb9ef82a64fa9aff937858 2026-04-02 10:16:27,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:27,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9ef82a64fa9aff937858 HTTP/1.1" 200 None 2026-04-02 10:16:27,031 - lava_callback - DEBUG - Processing node 69cb9ef82a64fa9aff937858: baseline-arm64-baylibre 2026-04-02 10:16:27,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9ef82a64fa9aff937858 2026-04-02 10:16:27,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:27,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9ef82a64fa9aff937858 HTTP/1.1" 200 None 2026-04-02 10:16:27,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:27,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:16:27,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:27,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9ef82a64fa9aff937858 HTTP/1.1" 200 None 2026-04-02 10:16:27,104 - lava_callback - ERROR - Error processing callback for node 69cb9ef82a64fa9aff937858: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 10:16:27,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:27,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59596 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:19:47,157 - lava_callback - INFO - Received callback for node 69cb9fba2a64fa9aff937875 INFO: 172.21.0.1:59598 - "POST /node/69cb9fba2a64fa9aff937875 HTTP/1.0" 202 Accepted 2026-04-02 10:19:47,162 - lava_callback - INFO - Starting async job submit for node 69cb9fba2a64fa9aff937875 2026-04-02 10:19:47,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:19:47,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9fba2a64fa9aff937875 HTTP/1.1" 200 None 2026-04-02 10:19:47,188 - lava_callback - DEBUG - Processing node 69cb9fba2a64fa9aff937875: baseline-arm64-baylibre 2026-04-02 10:19:47,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9fba2a64fa9aff937875 2026-04-02 10:19:47,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:19:47,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9fba2a64fa9aff937875 HTTP/1.1" 200 None 2026-04-02 10:19:47,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:19:47,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:19:47,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:19:47,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9fba2a64fa9aff937875 HTTP/1.1" 200 None 2026-04-02 10:19:47,239 - lava_callback - ERROR - Error processing callback for node 69cb9fba2a64fa9aff937875: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:21:23,304 - lava_callback - INFO - Received callback for node 69ce3e7fcb08ea23a1f68b96 INFO: 172.21.0.1:34892 - "POST /node/69ce3e7fcb08ea23a1f68b96 HTTP/1.0" 202 Accepted 2026-04-02 10:21:23,312 - lava_callback - INFO - Starting async job submit for node 69ce3e7fcb08ea23a1f68b96 2026-04-02 10:21:23,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:21:23,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3e7fcb08ea23a1f68b96 HTTP/1.1" 200 None 2026-04-02 10:21:23,371 - lava_callback - DEBUG - Processing node 69ce3e7fcb08ea23a1f68b96: baseline-nfs-arm64 2026-04-02 10:21:24,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:21:24,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:21:24,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e7fcb08ea23a1f68b96/log.txt.gz 2026-04-02 10:21:25,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:21:25,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:21:25,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e7fcb08ea23a1f68b96/lava-logs.yaml 2026-04-02 10:21:25,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:21:26,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:21:26,120 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e7fcb08ea23a1f68b96/lava_callback.json.gz DEBUG: Setup failed for 69ce3e7fcb08ea23a1f68b96. Transitting job node result: incomplete -> fail 2026-04-02 10:21:26,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:21:26,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3e7fcb08ea23a1f68b96 HTTP/1.1" 200 None 2026-04-02 10:21:26,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:21:26,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:21:26,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:21:26,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3e7fcb08ea23a1f68b96 HTTP/1.1" 200 None 2026-04-02 10:21:26,382 - lava_callback - INFO - Completed processing callback for node 69ce3e7fcb08ea23a1f68b96 INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:21:27,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:21:27,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:23:54,950 - lava_callback - INFO - Received callback for node 69cba0b02a64fa9aff937895 INFO: 172.21.0.1:53038 - "POST /node/69cba0b02a64fa9aff937895 HTTP/1.0" 202 Accepted 2026-04-02 10:23:54,956 - lava_callback - INFO - Starting async job submit for node 69cba0b02a64fa9aff937895 2026-04-02 10:23:54,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:23:54,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba0b02a64fa9aff937895 HTTP/1.1" 200 None 2026-04-02 10:23:54,977 - lava_callback - DEBUG - Processing node 69cba0b02a64fa9aff937895: baseline-arm64-clabbe 2026-04-02 10:23:54,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba0b02a64fa9aff937895 2026-04-02 10:23:54,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:23:54,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba0b02a64fa9aff937895 HTTP/1.1" 200 None 2026-04-02 10:23:54,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:23:55,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:23:55,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:23:55,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba0b02a64fa9aff937895 HTTP/1.1" 200 None 2026-04-02 10:23:55,028 - lava_callback - ERROR - Error processing callback for node 69cba0b02a64fa9aff937895: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:25:14,985 - lava_callback - INFO - Received callback for node 69cba0fe2a64fa9aff9378a1 INFO: 172.21.0.1:42822 - "POST /node/69cba0fe2a64fa9aff9378a1 HTTP/1.0" 202 Accepted 2026-04-02 10:25:14,990 - lava_callback - INFO - Starting async job submit for node 69cba0fe2a64fa9aff9378a1 2026-04-02 10:25:14,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:25:15,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba0fe2a64fa9aff9378a1 HTTP/1.1" 200 None 2026-04-02 10:25:15,008 - lava_callback - DEBUG - Processing node 69cba0fe2a64fa9aff9378a1: baseline-arm64-clabbe 2026-04-02 10:25:15,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba0fe2a64fa9aff9378a1 2026-04-02 10:25:15,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:25:15,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba0fe2a64fa9aff9378a1 HTTP/1.1" 200 None 2026-04-02 10:25:15,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:25:15,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:25:15,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:25:15,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba0fe2a64fa9aff9378a1 HTTP/1.1" 200 None 2026-04-02 10:25:15,062 - lava_callback - ERROR - Error processing callback for node 69cba0fe2a64fa9aff9378a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:26:35,091 - lava_callback - INFO - Received callback for node 69cba14b2a64fa9aff9378aa INFO: 172.21.0.1:53338 - "POST /node/69cba14b2a64fa9aff9378aa HTTP/1.0" 202 Accepted 2026-04-02 10:26:35,097 - lava_callback - INFO - Starting async job submit for node 69cba14b2a64fa9aff9378aa 2026-04-02 10:26:35,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:26:35,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba14b2a64fa9aff9378aa HTTP/1.1" 200 None 2026-04-02 10:26:35,116 - lava_callback - DEBUG - Processing node 69cba14b2a64fa9aff9378aa: baseline-arm64-clabbe 2026-04-02 10:26:35,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba14b2a64fa9aff9378aa 2026-04-02 10:26:35,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:26:35,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba14b2a64fa9aff9378aa HTTP/1.1" 200 None 2026-04-02 10:26:35,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:26:35,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:26:35,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:26:35,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba14b2a64fa9aff9378aa HTTP/1.1" 200 None 2026-04-02 10:26:35,175 - lava_callback - ERROR - Error processing callback for node 69cba14b2a64fa9aff9378aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:27:45,894 - lava_callback - INFO - Received callback for node 69ce448ecb08ea23a1f68c87 INFO: 172.21.0.1:59912 - "POST /node/69ce448ecb08ea23a1f68c87 HTTP/1.0" 202 Accepted 2026-04-02 10:27:45,902 - lava_callback - INFO - Starting async job submit for node 69ce448ecb08ea23a1f68c87 2026-04-02 10:27:45,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:45,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce448ecb08ea23a1f68c87 HTTP/1.1" 200 None 2026-04-02 10:27:45,922 - lava_callback - DEBUG - Processing node 69ce448ecb08ea23a1f68c87: baseline-nfs-arm64 2026-04-02 10:27:45,923 - lava_callback - WARNING - Failed to upload log 2026-04-02 10:27:45,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:27:46,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:27:46,088 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce448ecb08ea23a1f68c87/lava-logs.yaml 2026-04-02 10:27:46,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:27:46,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:27:46,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce448ecb08ea23a1f68c87/lava_callback.json.gz 2026-04-02 10:27:46,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:46,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce448ecb08ea23a1f68c87 HTTP/1.1" 200 None 2026-04-02 10:27:46,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:46,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:27:46,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:46,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce448ecb08ea23a1f68c87 HTTP/1.1" 200 None 2026-04-02 10:27:46,313 - lava_callback - INFO - Completed processing callback for node 69ce448ecb08ea23a1f68c87 INFO: 172.21.0.1:59916 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:27:55,261 - lava_callback - INFO - Received callback for node 69cba19b2a64fa9aff9378b2 INFO: 172.21.0.1:35240 - "POST /node/69cba19b2a64fa9aff9378b2 HTTP/1.0" 202 Accepted 2026-04-02 10:27:55,266 - lava_callback - INFO - Starting async job submit for node 69cba19b2a64fa9aff9378b2 2026-04-02 10:27:55,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:55,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba19b2a64fa9aff9378b2 HTTP/1.1" 200 None 2026-04-02 10:27:55,283 - lava_callback - DEBUG - Processing node 69cba19b2a64fa9aff9378b2: baseline-arm64-clabbe 2026-04-02 10:27:55,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba19b2a64fa9aff9378b2 2026-04-02 10:27:55,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:55,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba19b2a64fa9aff9378b2 HTTP/1.1" 200 None 2026-04-02 10:27:55,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:55,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:27:55,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:55,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba19b2a64fa9aff9378b2 HTTP/1.1" 200 None 2026-04-02 10:27:55,354 - lava_callback - ERROR - Error processing callback for node 69cba19b2a64fa9aff9378b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35254 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:27:57,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:57,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34146 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:30:20,403 - lava_callback - INFO - Received callback for node 69ce43f6cb08ea23a1f68c75 INFO: 172.21.0.1:48298 - "POST /node/69ce43f6cb08ea23a1f68c75 HTTP/1.0" 202 Accepted 2026-04-02 10:30:20,411 - lava_callback - INFO - Starting async job submit for node 69ce43f6cb08ea23a1f68c75 2026-04-02 10:30:20,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:20,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce43f6cb08ea23a1f68c75 HTTP/1.1" 200 None 2026-04-02 10:30:20,462 - lava_callback - DEBUG - Processing node 69ce43f6cb08ea23a1f68c75: baseline-arm64 2026-04-02 10:30:20,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:30:20,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:30:20,998 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce43f6cb08ea23a1f68c75/log.txt.gz 2026-04-02 10:30:21,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:30:21,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:30:21,430 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce43f6cb08ea23a1f68c75/lava-logs.yaml 2026-04-02 10:30:21,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:30:21,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:30:21,643 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce43f6cb08ea23a1f68c75/lava_callback.json.gz DEBUG: Setup failed for 69ce43f6cb08ea23a1f68c75. Transitting job node result: incomplete -> fail 2026-04-02 10:30:21,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:21,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce43f6cb08ea23a1f68c75 HTTP/1.1" 200 None 2026-04-02 10:30:21,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:21,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:30:21,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:21,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce43f6cb08ea23a1f68c75 HTTP/1.1" 200 None 2026-04-02 10:30:21,888 - lava_callback - INFO - Completed processing callback for node 69ce43f6cb08ea23a1f68c75 INFO: 172.21.0.1:48308 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:30:27,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:27,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:30:35,209 - lava_callback - INFO - Received callback for node 69cba2352a64fa9aff9378c2 INFO: 172.21.0.1:42700 - "POST /node/69cba2352a64fa9aff9378c2 HTTP/1.0" 202 Accepted 2026-04-02 10:30:35,218 - lava_callback - INFO - Starting async job submit for node 69cba2352a64fa9aff9378c2 2026-04-02 10:30:35,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:35,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba2352a64fa9aff9378c2 HTTP/1.1" 200 None 2026-04-02 10:30:35,242 - lava_callback - DEBUG - Processing node 69cba2352a64fa9aff9378c2: baseline-arm64-clabbe 2026-04-02 10:30:35,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba2352a64fa9aff9378c2 2026-04-02 10:30:35,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:35,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba2352a64fa9aff9378c2 HTTP/1.1" 200 None 2026-04-02 10:30:35,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:35,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:30:35,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:35,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba2352a64fa9aff9378c2 HTTP/1.1" 200 None 2026-04-02 10:30:35,327 - lava_callback - ERROR - Error processing callback for node 69cba2352a64fa9aff9378c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44936 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:32:55,606 - lava_callback - INFO - Received callback for node 69cba2d32a64fa9aff9378d7 INFO: 172.21.0.1:53268 - "POST /node/69cba2d32a64fa9aff9378d7 HTTP/1.0" 202 Accepted 2026-04-02 10:32:55,612 - lava_callback - INFO - Starting async job submit for node 69cba2d32a64fa9aff9378d7 2026-04-02 10:32:55,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:32:55,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba2d32a64fa9aff9378d7 HTTP/1.1" 200 None 2026-04-02 10:32:55,628 - lava_callback - DEBUG - Processing node 69cba2d32a64fa9aff9378d7: baseline-arm64-clabbe 2026-04-02 10:32:55,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba2d32a64fa9aff9378d7 2026-04-02 10:32:55,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:32:55,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba2d32a64fa9aff9378d7 HTTP/1.1" 200 None 2026-04-02 10:32:55,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:32:55,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:32:55,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:32:55,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba2d32a64fa9aff9378d7 HTTP/1.1" 200 None 2026-04-02 10:32:55,688 - lava_callback - ERROR - Error processing callback for node 69cba2d32a64fa9aff9378d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:33:43,105 - lava_callback - INFO - Received callback for node 69ce45d3cb08ea23a1f68cbc INFO: 172.21.0.1:41638 - "POST /node/69ce45d3cb08ea23a1f68cbc HTTP/1.0" 202 Accepted 2026-04-02 10:33:43,117 - lava_callback - INFO - Starting async job submit for node 69ce45d3cb08ea23a1f68cbc 2026-04-02 10:33:43,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:33:43,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce45d3cb08ea23a1f68cbc HTTP/1.1" 200 None 2026-04-02 10:33:43,178 - lava_callback - DEBUG - Processing node 69ce45d3cb08ea23a1f68cbc: baseline-arm64 2026-04-02 10:33:43,373 - lava_callback - WARNING - Failed to upload log 2026-04-02 10:33:43,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:33:43,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:33:43,627 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce45d3cb08ea23a1f68cbc/lava-logs.yaml 2026-04-02 10:33:43,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:33:43,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:33:43,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce45d3cb08ea23a1f68cbc/lava_callback.json.gz 2026-04-02 10:33:43,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:33:43,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce45d3cb08ea23a1f68cbc HTTP/1.1" 200 None 2026-04-02 10:33:43,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:33:43,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:33:43,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:33:43,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce45d3cb08ea23a1f68cbc HTTP/1.1" 200 None 2026-04-02 10:33:43,903 - lava_callback - INFO - Completed processing callback for node 69ce45d3cb08ea23a1f68cbc INFO: 172.21.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:33:57,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:33:57,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55692 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:36:12,857 - lava_callback - INFO - Received callback for node 69ce4669cb08ea23a1f68ccf INFO: 172.21.0.1:33822 - "POST /node/69ce4669cb08ea23a1f68ccf HTTP/1.0" 202 Accepted 2026-04-02 10:36:12,863 - lava_callback - INFO - Starting async job submit for node 69ce4669cb08ea23a1f68ccf 2026-04-02 10:36:12,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:36:12,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4669cb08ea23a1f68ccf HTTP/1.1" 200 None 2026-04-02 10:36:12,908 - lava_callback - DEBUG - Processing node 69ce4669cb08ea23a1f68ccf: baseline-arm64 2026-04-02 10:36:13,044 - lava_callback - WARNING - Failed to upload log 2026-04-02 10:36:13,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:36:13,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:36:13,323 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4669cb08ea23a1f68ccf/lava-logs.yaml 2026-04-02 10:36:13,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:36:13,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:36:13,635 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4669cb08ea23a1f68ccf/lava_callback.json.gz 2026-04-02 10:36:13,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:36:13,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4669cb08ea23a1f68ccf HTTP/1.1" 200 None 2026-04-02 10:36:13,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:36:13,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:36:13,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:36:13,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4669cb08ea23a1f68ccf HTTP/1.1" 200 None 2026-04-02 10:36:13,782 - lava_callback - INFO - Completed processing callback for node 69ce4669cb08ea23a1f68ccf INFO: 172.21.0.1:33836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:36:27,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:36:27,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47548 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:41:12,224 - lava_callback - INFO - Received callback for node 69ce4544cb08ea23a1f68caa INFO: 172.21.0.1:38292 - "POST /node/69ce4544cb08ea23a1f68caa HTTP/1.0" 202 Accepted 2026-04-02 10:41:12,230 - lava_callback - INFO - Starting async job submit for node 69ce4544cb08ea23a1f68caa 2026-04-02 10:41:12,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:41:12,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4544cb08ea23a1f68caa HTTP/1.1" 200 None 2026-04-02 10:41:12,291 - lava_callback - DEBUG - Processing node 69ce4544cb08ea23a1f68caa: baseline-arm64 2026-04-02 10:41:12,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:41:12,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:41:12,964 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4544cb08ea23a1f68caa/log.txt.gz 2026-04-02 10:41:13,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:41:13,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:41:13,594 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4544cb08ea23a1f68caa/lava-logs.yaml 2026-04-02 10:41:13,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:41:14,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:41:14,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4544cb08ea23a1f68caa/lava_callback.json.gz 2026-04-02 10:41:14,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:41:14,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4544cb08ea23a1f68caa HTTP/1.1" 200 None 2026-04-02 10:41:14,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:41:14,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:41:14,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:41:14,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4544cb08ea23a1f68caa HTTP/1.1" 200 None 2026-04-02 10:41:14,171 - lava_callback - INFO - Completed processing callback for node 69ce4544cb08ea23a1f68caa INFO: 172.21.0.1:38296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:41:27,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:41:27,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:42:32,928 - lava_callback - INFO - Received callback for node 69ce4592cb08ea23a1f68cb6 INFO: 172.21.0.1:56822 - "POST /node/69ce4592cb08ea23a1f68cb6 HTTP/1.0" 202 Accepted 2026-04-02 10:42:32,936 - lava_callback - INFO - Starting async job submit for node 69ce4592cb08ea23a1f68cb6 2026-04-02 10:42:32,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:42:32,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4592cb08ea23a1f68cb6 HTTP/1.1" 200 None 2026-04-02 10:42:32,998 - lava_callback - DEBUG - Processing node 69ce4592cb08ea23a1f68cb6: baseline-nfs-arm64 2026-04-02 10:42:33,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:42:33,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:42:33,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4592cb08ea23a1f68cb6/log.txt.gz 2026-04-02 10:42:34,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:42:34,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:42:34,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4592cb08ea23a1f68cb6/lava-logs.yaml 2026-04-02 10:42:34,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:42:34,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:42:34,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4592cb08ea23a1f68cb6/lava_callback.json.gz 2026-04-02 10:42:34,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:42:34,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4592cb08ea23a1f68cb6 HTTP/1.1" 200 None 2026-04-02 10:42:34,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:42:34,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:42:34,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:42:34,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4592cb08ea23a1f68cb6 HTTP/1.1" 200 None 2026-04-02 10:42:34,710 - lava_callback - INFO - Completed processing callback for node 69ce4592cb08ea23a1f68cb6 INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:42:57,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:42:58,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:47:34,768 - lava_callback - INFO - Received callback for node 69ce4773cb08ea23a1f68cfa INFO: 172.21.0.1:34682 - "POST /node/69ce4773cb08ea23a1f68cfa HTTP/1.0" 202 Accepted 2026-04-02 10:47:34,780 - lava_callback - INFO - Starting async job submit for node 69ce4773cb08ea23a1f68cfa 2026-04-02 10:47:34,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:47:34,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4773cb08ea23a1f68cfa HTTP/1.1" 200 None 2026-04-02 10:47:34,842 - lava_callback - DEBUG - Processing node 69ce4773cb08ea23a1f68cfa: baseline-arm64 2026-04-02 10:47:35,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:47:35,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:47:35,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4773cb08ea23a1f68cfa/log.txt.gz 2026-04-02 10:47:35,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:47:35,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:47:35,901 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4773cb08ea23a1f68cfa/lava-logs.yaml 2026-04-02 10:47:35,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:47:36,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:47:36,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4773cb08ea23a1f68cfa/lava_callback.json.gz DEBUG: Setup failed for 69ce4773cb08ea23a1f68cfa. Transitting job node result: incomplete -> fail 2026-04-02 10:47:36,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:47:36,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4773cb08ea23a1f68cfa HTTP/1.1" 200 None 2026-04-02 10:47:36,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:47:36,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:47:36,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:47:36,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4773cb08ea23a1f68cfa HTTP/1.1" 200 None 2026-04-02 10:47:36,300 - lava_callback - INFO - Completed processing callback for node 69ce4773cb08ea23a1f68cfa INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:47:58,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:47:58,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:48:08,599 - lava_callback - INFO - Received callback for node 69ce44dacb08ea23a1f68c98 INFO: 172.21.0.1:55760 - "POST /node/69ce44dacb08ea23a1f68c98 HTTP/1.0" 202 Accepted 2026-04-02 10:48:08,645 - lava_callback - INFO - Starting async job submit for node 69ce44dacb08ea23a1f68c98 2026-04-02 10:48:08,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:48:08,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce44dacb08ea23a1f68c98 HTTP/1.1" 200 None 2026-04-02 10:48:08,685 - lava_callback - DEBUG - Processing node 69ce44dacb08ea23a1f68c98: baseline-arm-pengutronix 2026-04-02 10:48:08,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:48:08,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:48:08,919 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce44dacb08ea23a1f68c98/log.txt.gz 2026-04-02 10:48:08,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:48:09,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:48:09,139 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce44dacb08ea23a1f68c98/lava-logs.yaml 2026-04-02 10:48:09,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:48:09,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:48:09,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce44dacb08ea23a1f68c98/lava_callback.json.gz DEBUG: Setup failed for 69ce44dacb08ea23a1f68c98. Transitting job node result: incomplete -> fail 2026-04-02 10:48:09,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:48:09,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce44dacb08ea23a1f68c98 HTTP/1.1" 200 None 2026-04-02 10:48:09,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:48:09,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 10:48:09,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:48:09,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce44dacb08ea23a1f68c98 HTTP/1.1" 200 None 2026-04-02 10:48:09,439 - lava_callback - INFO - Completed processing callback for node 69ce44dacb08ea23a1f68c98 INFO: 172.21.0.1:59840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52764 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:48:28,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:48:28,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43848 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:51:25,229 - lava_callback - INFO - Received callback for node 69ce47cfcb08ea23a1f68d04 INFO: 172.21.0.1:45108 - "POST /node/69ce47cfcb08ea23a1f68d04 HTTP/1.0" 202 Accepted 2026-04-02 10:51:25,235 - lava_callback - INFO - Starting async job submit for node 69ce47cfcb08ea23a1f68d04 2026-04-02 10:51:25,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:51:25,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce47cfcb08ea23a1f68d04 HTTP/1.1" 200 None 2026-04-02 10:51:25,312 - lava_callback - DEBUG - Processing node 69ce47cfcb08ea23a1f68d04: baseline-arm64 2026-04-02 10:51:25,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:51:26,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:51:26,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce47cfcb08ea23a1f68d04/log.txt.gz 2026-04-02 10:51:26,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:51:26,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:51:26,770 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce47cfcb08ea23a1f68d04/lava-logs.yaml 2026-04-02 10:51:26,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:51:26,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:51:26,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce47cfcb08ea23a1f68d04/lava_callback.json.gz 2026-04-02 10:51:26,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:51:27,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce47cfcb08ea23a1f68d04 HTTP/1.1" 200 None 2026-04-02 10:51:27,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:51:27,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:51:27,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:51:27,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce47cfcb08ea23a1f68d04 HTTP/1.1" 200 None 2026-04-02 10:51:27,089 - lava_callback - INFO - Completed processing callback for node 69ce47cfcb08ea23a1f68d04 2026-04-02 10:51:28,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:51:28,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:53:09,512 - lava_callback - INFO - Received callback for node 69ce46b4cb08ea23a1f68cd8 INFO: 172.21.0.1:51640 - "POST /node/69ce46b4cb08ea23a1f68cd8 HTTP/1.0" 202 Accepted 2026-04-02 10:53:09,518 - lava_callback - INFO - Starting async job submit for node 69ce46b4cb08ea23a1f68cd8 2026-04-02 10:53:09,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:53:09,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce46b4cb08ea23a1f68cd8 HTTP/1.1" 200 None 2026-04-02 10:53:09,596 - lava_callback - DEBUG - Processing node 69ce46b4cb08ea23a1f68cd8: baseline-arm 2026-04-02 10:53:10,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:53:10,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:53:10,517 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce46b4cb08ea23a1f68cd8/log.txt.gz 2026-04-02 10:53:10,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:53:11,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:53:11,158 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce46b4cb08ea23a1f68cd8/lava-logs.yaml 2026-04-02 10:53:11,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:53:11,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:53:11,327 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce46b4cb08ea23a1f68cd8/lava_callback.json.gz DEBUG: Setup failed for 69ce46b4cb08ea23a1f68cd8. Transitting job node result: incomplete -> fail 2026-04-02 10:53:11,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:53:11,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce46b4cb08ea23a1f68cd8 HTTP/1.1" 200 None 2026-04-02 10:53:11,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:53:11,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 10:53:11,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:53:11,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce46b4cb08ea23a1f68cd8 HTTP/1.1" 200 None 2026-04-02 10:53:11,636 - lava_callback - INFO - Completed processing callback for node 69ce46b4cb08ea23a1f68cd8 INFO: 172.21.0.1:42252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60434 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:53:28,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:53:28,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:54:01,392 - lava_callback - INFO - Received callback for node 69ce4824cb08ea23a1f68d11 INFO: 172.21.0.1:55258 - "POST /node/69ce4824cb08ea23a1f68d11 HTTP/1.0" 202 Accepted 2026-04-02 10:54:01,399 - lava_callback - INFO - Starting async job submit for node 69ce4824cb08ea23a1f68d11 2026-04-02 10:54:01,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:01,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4824cb08ea23a1f68d11 HTTP/1.1" 200 None 2026-04-02 10:54:01,443 - lava_callback - DEBUG - Processing node 69ce4824cb08ea23a1f68d11: baseline-nfs-arm64 2026-04-02 10:54:02,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:02,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:02,470 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4824cb08ea23a1f68d11/log.txt.gz 2026-04-02 10:54:02,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:02,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:02,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4824cb08ea23a1f68d11/lava-logs.yaml 2026-04-02 10:54:02,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:03,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:03,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4824cb08ea23a1f68d11/lava_callback.json.gz 2026-04-02 10:54:03,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:03,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4824cb08ea23a1f68d11 HTTP/1.1" 200 None 2026-04-02 10:54:03,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:03,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:54:03,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:03,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4824cb08ea23a1f68d11 HTTP/1.1" 200 None 2026-04-02 10:54:03,270 - lava_callback - INFO - Completed processing callback for node 69ce4824cb08ea23a1f68d11 INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:54:28,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:28,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:54:49,566 - lava_callback - INFO - Received callback for node 69ce46d7cb08ea23a1f68ce5 INFO: 172.21.0.1:54984 - "POST /node/69ce46d7cb08ea23a1f68ce5 HTTP/1.0" 202 Accepted 2026-04-02 10:54:49,572 - lava_callback - INFO - Starting async job submit for node 69ce46d7cb08ea23a1f68ce5 2026-04-02 10:54:49,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:49,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce46d7cb08ea23a1f68ce5 HTTP/1.1" 200 None 2026-04-02 10:54:49,652 - lava_callback - DEBUG - Processing node 69ce46d7cb08ea23a1f68ce5: ltp-smoke 2026-04-02 10:54:50,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:50,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:50,443 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce46d7cb08ea23a1f68ce5/log.txt.gz 2026-04-02 10:54:50,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:51,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:51,010 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce46d7cb08ea23a1f68ce5/lava-logs.yaml 2026-04-02 10:54:51,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:51,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:51,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce46d7cb08ea23a1f68ce5/lava_callback.json.gz 2026-04-02 10:54:51,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:51,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce46d7cb08ea23a1f68ce5 HTTP/1.1" 200 None 2026-04-02 10:54:51,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:51,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce266ecb08ea23a1f68074 HTTP/1.1" 200 None 2026-04-02 10:54:51,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:51,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce46d7cb08ea23a1f68ce5 HTTP/1.1" 200 None 2026-04-02 10:54:51,506 - lava_callback - INFO - Completed processing callback for node 69ce46d7cb08ea23a1f68ce5 INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:54:58,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:58,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39330 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:58:25,341 - lava_callback - INFO - Received callback for node 69ce472bcb08ea23a1f68cf0 INFO: 172.21.0.1:42314 - "POST /node/69ce472bcb08ea23a1f68cf0 HTTP/1.0" 202 Accepted 2026-04-02 10:58:25,349 - lava_callback - INFO - Starting async job submit for node 69ce472bcb08ea23a1f68cf0 2026-04-02 10:58:25,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:58:25,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce472bcb08ea23a1f68cf0 HTTP/1.1" 200 None 2026-04-02 10:58:25,408 - lava_callback - DEBUG - Processing node 69ce472bcb08ea23a1f68cf0: baseline-nfs-arm64 2026-04-02 10:58:26,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:58:26,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:58:26,646 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce472bcb08ea23a1f68cf0/log.txt.gz 2026-04-02 10:58:27,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:58:27,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:58:27,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce472bcb08ea23a1f68cf0/lava-logs.yaml 2026-04-02 10:58:27,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:58:27,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:58:27,842 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce472bcb08ea23a1f68cf0/lava_callback.json.gz DEBUG: Setup failed for 69ce472bcb08ea23a1f68cf0. Transitting job node result: incomplete -> fail 2026-04-02 10:58:27,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:58:27,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce472bcb08ea23a1f68cf0 HTTP/1.1" 200 None 2026-04-02 10:58:27,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:58:27,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:58:27,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:58:28,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce472bcb08ea23a1f68cf0 HTTP/1.1" 200 None 2026-04-02 10:58:28,108 - lava_callback - INFO - Completed processing callback for node 69ce472bcb08ea23a1f68cf0 2026-04-02 10:58:28,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:58:28,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:04:50,139 - lava_callback - INFO - Received callback for node 69cbaa3f2a64fa9aff937994 INFO: 172.21.0.1:47136 - "POST /node/69cbaa3f2a64fa9aff937994 HTTP/1.0" 202 Accepted 2026-04-02 11:04:50,145 - lava_callback - INFO - Starting async job submit for node 69cbaa3f2a64fa9aff937994 2026-04-02 11:04:50,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:04:50,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaa3f2a64fa9aff937994 HTTP/1.1" 200 None 2026-04-02 11:04:50,161 - lava_callback - DEBUG - Processing node 69cbaa3f2a64fa9aff937994: baseline-arm-baylibre 2026-04-02 11:04:50,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbaa3f2a64fa9aff937994 2026-04-02 11:04:50,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:04:50,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaa3f2a64fa9aff937994 HTTP/1.1" 200 None 2026-04-02 11:04:50,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:04:50,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:04:50,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:04:50,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbaa3f2a64fa9aff937994 HTTP/1.1" 200 None 2026-04-02 11:04:50,217 - lava_callback - ERROR - Error processing callback for node 69cbaa3f2a64fa9aff937994: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:06:49,660 - lava_callback - INFO - Received callback for node 69cbaab72a64fa9aff9379a4 INFO: 172.21.0.1:33318 - "POST /node/69cbaab72a64fa9aff9379a4 HTTP/1.0" 202 Accepted 2026-04-02 11:06:49,665 - lava_callback - INFO - Starting async job submit for node 69cbaab72a64fa9aff9379a4 2026-04-02 11:06:49,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:06:49,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaab72a64fa9aff9379a4 HTTP/1.1" 200 None 2026-04-02 11:06:49,692 - lava_callback - DEBUG - Processing node 69cbaab72a64fa9aff9379a4: baseline-arm-baylibre 2026-04-02 11:06:49,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbaab72a64fa9aff9379a4 2026-04-02 11:06:49,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:06:49,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaab72a64fa9aff9379a4 HTTP/1.1" 200 None 2026-04-02 11:06:49,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:06:49,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:06:49,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:06:49,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbaab72a64fa9aff9379a4 HTTP/1.1" 200 None 2026-04-02 11:06:49,755 - lava_callback - ERROR - Error processing callback for node 69cbaab72a64fa9aff9379a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42908 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:07:29,617 - lava_callback - INFO - Received callback for node 69cbaade2a64fa9aff9379af INFO: 172.21.0.1:42924 - "POST /node/69cbaade2a64fa9aff9379af HTTP/1.0" 202 Accepted 2026-04-02 11:07:29,622 - lava_callback - INFO - Starting async job submit for node 69cbaade2a64fa9aff9379af 2026-04-02 11:07:29,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:29,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaade2a64fa9aff9379af HTTP/1.1" 200 None 2026-04-02 11:07:29,656 - lava_callback - DEBUG - Processing node 69cbaade2a64fa9aff9379af: baseline-arm-baylibre 2026-04-02 11:07:29,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbaade2a64fa9aff9379af 2026-04-02 11:07:29,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:29,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaade2a64fa9aff9379af HTTP/1.1" 200 None 2026-04-02 11:07:29,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:29,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:07:29,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:29,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbaade2a64fa9aff9379af HTTP/1.1" 200 None 2026-04-02 11:07:29,722 - lava_callback - ERROR - Error processing callback for node 69cbaade2a64fa9aff9379af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:07:49,645 - lava_callback - INFO - Received callback for node 69ce4976cb08ea23a1f68d23 2026-04-02 11:07:49,648 - lava_callback - INFO - Received callback for node 69cbab022a64fa9aff9379be INFO: 172.21.0.1:47792 - "POST /node/69cbab022a64fa9aff9379be HTTP/1.0" 202 Accepted 2026-04-02 11:07:49,653 - lava_callback - INFO - Starting async job submit for node 69cbab022a64fa9aff9379be 2026-04-02 11:07:49,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:49,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab022a64fa9aff9379be HTTP/1.1" 200 None 2026-04-02 11:07:49,670 - lava_callback - DEBUG - Processing node 69cbab022a64fa9aff9379be: baseline-arm-baylibre 2026-04-02 11:07:49,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbab022a64fa9aff9379be 2026-04-02 11:07:49,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:49,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab022a64fa9aff9379be HTTP/1.1" 200 None 2026-04-02 11:07:49,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:49,697 - lava_callback - INFO - Starting async job submit for node 69ce4976cb08ea23a1f68d23 INFO: 172.21.0.1:47790 - "POST /node/69ce4976cb08ea23a1f68d23 HTTP/1.0" 202 Accepted 2026-04-02 11:07:49,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:49,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:07:49,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:49,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4976cb08ea23a1f68d23 HTTP/1.1" 200 None 2026-04-02 11:07:49,740 - lava_callback - DEBUG - Processing node 69ce4976cb08ea23a1f68d23: baseline-arm-pengutronix 2026-04-02 11:07:49,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbab022a64fa9aff9379be HTTP/1.1" 200 None 2026-04-02 11:07:49,829 - lava_callback - ERROR - Error processing callback for node 69cbab022a64fa9aff9379be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 11:07:49,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:07:50,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:07:50,086 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce4976cb08ea23a1f68d23/log.txt.gz 2026-04-02 11:07:50,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:07:50,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:07:50,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce4976cb08ea23a1f68d23/lava-logs.yaml 2026-04-02 11:07:50,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:07:50,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:07:50,635 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce4976cb08ea23a1f68d23/lava_callback.json.gz DEBUG: Setup failed for 69ce4976cb08ea23a1f68d23. Transitting job node result: incomplete -> fail 2026-04-02 11:07:50,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:50,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4976cb08ea23a1f68d23 HTTP/1.1" 200 None 2026-04-02 11:07:50,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:50,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 11:07:50,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:50,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4976cb08ea23a1f68d23 HTTP/1.1" 200 None 2026-04-02 11:07:50,786 - lava_callback - INFO - Completed processing callback for node 69ce4976cb08ea23a1f68d23 INFO: 172.21.0.1:48692 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:07:58,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:58,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:08:29,754 - lava_callback - INFO - Received callback for node 69cbab272a64fa9aff9379c9 INFO: 172.21.0.1:35818 - "POST /node/69cbab272a64fa9aff9379c9 HTTP/1.0" 202 Accepted 2026-04-02 11:08:29,760 - lava_callback - INFO - Starting async job submit for node 69cbab272a64fa9aff9379c9 2026-04-02 11:08:29,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:08:29,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab272a64fa9aff9379c9 HTTP/1.1" 200 None 2026-04-02 11:08:29,776 - lava_callback - DEBUG - Processing node 69cbab272a64fa9aff9379c9: baseline-arm-baylibre 2026-04-02 11:08:29,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbab272a64fa9aff9379c9 2026-04-02 11:08:29,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:08:29,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab272a64fa9aff9379c9 HTTP/1.1" 200 None 2026-04-02 11:08:29,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:08:29,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:08:29,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:08:29,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbab272a64fa9aff9379c9 HTTP/1.1" 200 None 2026-04-02 11:08:29,840 - lava_callback - ERROR - Error processing callback for node 69cbab272a64fa9aff9379c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:09:49,898 - lava_callback - INFO - Received callback for node 69cbab6e2a64fa9aff9379da INFO: 172.21.0.1:36196 - "POST /node/69cbab6e2a64fa9aff9379da HTTP/1.0" 202 Accepted 2026-04-02 11:09:49,906 - lava_callback - INFO - Starting async job submit for node 69cbab6e2a64fa9aff9379da 2026-04-02 11:09:49,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:09:49,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab6e2a64fa9aff9379da HTTP/1.1" 200 None 2026-04-02 11:09:49,923 - lava_callback - DEBUG - Processing node 69cbab6e2a64fa9aff9379da: baseline-arm-baylibre 2026-04-02 11:09:49,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbab6e2a64fa9aff9379da 2026-04-02 11:09:49,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:09:49,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab6e2a64fa9aff9379da HTTP/1.1" 200 None 2026-04-02 11:09:49,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:09:49,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:09:49,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:09:49,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbab6e2a64fa9aff9379da HTTP/1.1" 200 None 2026-04-02 11:09:49,980 - lava_callback - ERROR - Error processing callback for node 69cbab6e2a64fa9aff9379da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:14:57,206 - lava_callback - INFO - Received callback for node 69cbacaa2a64fa9aff937a08 INFO: 172.21.0.1:40564 - "POST /node/69cbacaa2a64fa9aff937a08 HTTP/1.0" 202 Accepted 2026-04-02 11:14:57,215 - lava_callback - INFO - Starting async job submit for node 69cbacaa2a64fa9aff937a08 2026-04-02 11:14:57,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:14:57,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbacaa2a64fa9aff937a08 HTTP/1.1" 200 None 2026-04-02 11:14:57,232 - lava_callback - DEBUG - Processing node 69cbacaa2a64fa9aff937a08: baseline-arm-clabbe 2026-04-02 11:14:57,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbacaa2a64fa9aff937a08 2026-04-02 11:14:57,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:14:57,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbacaa2a64fa9aff937a08 HTTP/1.1" 200 None 2026-04-02 11:14:57,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:14:57,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:14:57,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:14:57,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbacaa2a64fa9aff937a08 HTTP/1.1" 200 None 2026-04-02 11:14:57,286 - lava_callback - ERROR - Error processing callback for node 69cbacaa2a64fa9aff937a08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:16:57,283 - lava_callback - INFO - Received callback for node 69cbad162a64fa9aff937a17 INFO: 172.21.0.1:59918 - "POST /node/69cbad162a64fa9aff937a17 HTTP/1.0" 202 Accepted 2026-04-02 11:16:57,289 - lava_callback - INFO - Starting async job submit for node 69cbad162a64fa9aff937a17 2026-04-02 11:16:57,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:16:57,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad162a64fa9aff937a17 HTTP/1.1" 200 None 2026-04-02 11:16:57,306 - lava_callback - DEBUG - Processing node 69cbad162a64fa9aff937a17: baseline-arm-clabbe 2026-04-02 11:16:57,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbad162a64fa9aff937a17 2026-04-02 11:16:57,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:16:57,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad162a64fa9aff937a17 HTTP/1.1" 200 None 2026-04-02 11:16:57,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:16:57,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:16:57,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:16:57,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbad162a64fa9aff937a17 HTTP/1.1" 200 None 2026-04-02 11:16:57,368 - lava_callback - ERROR - Error processing callback for node 69cbad162a64fa9aff937a17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46740 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:17:37,261 - lava_callback - INFO - Received callback for node 69cbad3c2a64fa9aff937a22 INFO: 172.21.0.1:46744 - "POST /node/69cbad3c2a64fa9aff937a22 HTTP/1.0" 202 Accepted 2026-04-02 11:17:37,266 - lava_callback - INFO - Starting async job submit for node 69cbad3c2a64fa9aff937a22 2026-04-02 11:17:37,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:17:37,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad3c2a64fa9aff937a22 HTTP/1.1" 200 None 2026-04-02 11:17:37,282 - lava_callback - DEBUG - Processing node 69cbad3c2a64fa9aff937a22: baseline-arm-clabbe 2026-04-02 11:17:37,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbad3c2a64fa9aff937a22 2026-04-02 11:17:37,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:17:37,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad3c2a64fa9aff937a22 HTTP/1.1" 200 None 2026-04-02 11:17:37,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:17:37,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:17:37,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:17:37,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbad3c2a64fa9aff937a22 HTTP/1.1" 200 None 2026-04-02 11:17:37,346 - lava_callback - ERROR - Error processing callback for node 69cbad3c2a64fa9aff937a22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:18:31,474 - lava_callback - INFO - Received callback for node 69ce4bdccb08ea23a1f68d46 INFO: 172.21.0.1:42886 - "POST /node/69ce4bdccb08ea23a1f68d46 HTTP/1.0" 202 Accepted 2026-04-02 11:18:31,484 - lava_callback - INFO - Starting async job submit for node 69ce4bdccb08ea23a1f68d46 2026-04-02 11:18:31,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:31,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4bdccb08ea23a1f68d46 HTTP/1.1" 200 None 2026-04-02 11:18:31,569 - lava_callback - DEBUG - Processing node 69ce4bdccb08ea23a1f68d46: baseline-nfs-arm64 INFO: 172.21.0.1:42898 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:18:32,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:18:32,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:18:32,962 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4bdccb08ea23a1f68d46/log.txt.gz 2026-04-02 11:18:33,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:18:33,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:18:33,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4bdccb08ea23a1f68d46/lava-logs.yaml 2026-04-02 11:18:33,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:18:34,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:18:34,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4bdccb08ea23a1f68d46/lava_callback.json.gz DEBUG: Setup failed for 69ce4bdccb08ea23a1f68d46. Transitting job node result: incomplete -> fail 2026-04-02 11:18:34,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:34,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4bdccb08ea23a1f68d46 HTTP/1.1" 200 None 2026-04-02 11:18:34,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:34,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 11:18:34,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:34,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4bdccb08ea23a1f68d46 HTTP/1.1" 200 None 2026-04-02 11:18:34,388 - lava_callback - INFO - Completed processing callback for node 69ce4bdccb08ea23a1f68d46 INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:18:57,362 - lava_callback - INFO - Received callback for node 69cbad8d2a64fa9aff937a31 INFO: 172.21.0.1:33404 - "POST /node/69cbad8d2a64fa9aff937a31 HTTP/1.0" 202 Accepted 2026-04-02 11:18:57,371 - lava_callback - INFO - Starting async job submit for node 69cbad8d2a64fa9aff937a31 2026-04-02 11:18:57,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:57,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad8d2a64fa9aff937a31 HTTP/1.1" 200 None 2026-04-02 11:18:57,389 - lava_callback - DEBUG - Processing node 69cbad8d2a64fa9aff937a31: baseline-arm-clabbe 2026-04-02 11:18:57,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbad8d2a64fa9aff937a31 2026-04-02 11:18:57,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:57,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad8d2a64fa9aff937a31 HTTP/1.1" 200 None 2026-04-02 11:18:57,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:57,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:18:57,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:57,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbad8d2a64fa9aff937a31 HTTP/1.1" 200 None 2026-04-02 11:18:57,453 - lava_callback - ERROR - Error processing callback for node 69cbad8d2a64fa9aff937a31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 11:18:58,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:58,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:20:57,452 - lava_callback - INFO - Received callback for node 69cbae062a64fa9aff937a41 INFO: 172.21.0.1:36366 - "POST /node/69cbae062a64fa9aff937a41 HTTP/1.0" 202 Accepted 2026-04-02 11:20:57,458 - lava_callback - INFO - Starting async job submit for node 69cbae062a64fa9aff937a41 2026-04-02 11:20:57,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:20:57,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbae062a64fa9aff937a41 HTTP/1.1" 200 None 2026-04-02 11:20:57,475 - lava_callback - DEBUG - Processing node 69cbae062a64fa9aff937a41: baseline-arm-clabbe 2026-04-02 11:20:57,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbae062a64fa9aff937a41 2026-04-02 11:20:57,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:20:57,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbae062a64fa9aff937a41 HTTP/1.1" 200 None 2026-04-02 11:20:57,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:20:57,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:20:57,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:20:57,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbae062a64fa9aff937a41 HTTP/1.1" 200 None 2026-04-02 11:20:57,540 - lava_callback - ERROR - Error processing callback for node 69cbae062a64fa9aff937a41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:41606 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:41618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET /login HTTP/1.0" 404 Not Found INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32904 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:54:52,318 - lava_callback - INFO - Received callback for node 69cbb6062a64fa9aff937ab7 INFO: 172.21.0.1:38326 - "POST /node/69cbb6062a64fa9aff937ab7 HTTP/1.0" 202 Accepted 2026-04-02 11:54:52,324 - lava_callback - INFO - Starting async job submit for node 69cbb6062a64fa9aff937ab7 2026-04-02 11:54:52,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:54:52,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb6062a64fa9aff937ab7 HTTP/1.1" 200 None 2026-04-02 11:54:52,341 - lava_callback - DEBUG - Processing node 69cbb6062a64fa9aff937ab7: baseline-arm64-baylibre 2026-04-02 11:54:52,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb6062a64fa9aff937ab7 2026-04-02 11:54:52,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:54:52,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb6062a64fa9aff937ab7 HTTP/1.1" 200 None 2026-04-02 11:54:52,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:54:52,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 11:54:52,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:54:52,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb6062a64fa9aff937ab7 HTTP/1.1" 200 None 2026-04-02 11:54:52,398 - lava_callback - ERROR - Error processing callback for node 69cbb6062a64fa9aff937ab7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:56:52,439 - lava_callback - INFO - Received callback for node 69cbb6812a64fa9aff937ac4 INFO: 172.21.0.1:59218 - "POST /node/69cbb6812a64fa9aff937ac4 HTTP/1.0" 202 Accepted 2026-04-02 11:56:52,445 - lava_callback - INFO - Starting async job submit for node 69cbb6812a64fa9aff937ac4 2026-04-02 11:56:52,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:56:52,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb6812a64fa9aff937ac4 HTTP/1.1" 200 None 2026-04-02 11:56:52,461 - lava_callback - DEBUG - Processing node 69cbb6812a64fa9aff937ac4: baseline-arm64-baylibre 2026-04-02 11:56:52,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb6812a64fa9aff937ac4 2026-04-02 11:56:52,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:56:52,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb6812a64fa9aff937ac4 HTTP/1.1" 200 None 2026-04-02 11:56:52,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:56:52,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 11:56:52,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:56:52,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb6812a64fa9aff937ac4 HTTP/1.1" 200 None 2026-04-02 11:56:52,512 - lava_callback - ERROR - Error processing callback for node 69cbb6812a64fa9aff937ac4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:59:52,545 - lava_callback - INFO - Received callback for node 69cbb7352a64fa9aff937ad1 INFO: 172.21.0.1:56232 - "POST /node/69cbb7352a64fa9aff937ad1 HTTP/1.0" 202 Accepted 2026-04-02 11:59:52,551 - lava_callback - INFO - Starting async job submit for node 69cbb7352a64fa9aff937ad1 2026-04-02 11:59:52,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:59:52,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb7352a64fa9aff937ad1 HTTP/1.1" 200 None 2026-04-02 11:59:52,571 - lava_callback - DEBUG - Processing node 69cbb7352a64fa9aff937ad1: baseline-arm64-baylibre 2026-04-02 11:59:52,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb7352a64fa9aff937ad1 2026-04-02 11:59:52,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:59:52,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb7352a64fa9aff937ad1 HTTP/1.1" 200 None 2026-04-02 11:59:52,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:59:52,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 11:59:52,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:59:52,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb7352a64fa9aff937ad1 HTTP/1.1" 200 None 2026-04-02 11:59:52,630 - lava_callback - ERROR - Error processing callback for node 69cbb7352a64fa9aff937ad1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:02:59,262 - lava_callback - INFO - Received callback for node 69cbb7ef2a64fa9aff937ae8 INFO: 172.21.0.1:41156 - "POST /node/69cbb7ef2a64fa9aff937ae8 HTTP/1.0" 202 Accepted 2026-04-02 12:02:59,267 - lava_callback - INFO - Starting async job submit for node 69cbb7ef2a64fa9aff937ae8 2026-04-02 12:02:59,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:02:59,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb7ef2a64fa9aff937ae8 HTTP/1.1" 200 None 2026-04-02 12:02:59,289 - lava_callback - DEBUG - Processing node 69cbb7ef2a64fa9aff937ae8: baseline-arm64-clabbe 2026-04-02 12:02:59,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb7ef2a64fa9aff937ae8 2026-04-02 12:02:59,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:02:59,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb7ef2a64fa9aff937ae8 HTTP/1.1" 200 None 2026-04-02 12:02:59,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:02:59,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:02:59,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:02:59,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb7ef2a64fa9aff937ae8 HTTP/1.1" 200 None 2026-04-02 12:02:59,346 - lava_callback - ERROR - Error processing callback for node 69cbb7ef2a64fa9aff937ae8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:04:19,305 - lava_callback - INFO - Received callback for node 69cbb83d2a64fa9aff937af0 INFO: 172.21.0.1:55494 - "POST /node/69cbb83d2a64fa9aff937af0 HTTP/1.0" 202 Accepted 2026-04-02 12:04:19,311 - lava_callback - INFO - Starting async job submit for node 69cbb83d2a64fa9aff937af0 2026-04-02 12:04:19,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:04:19,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb83d2a64fa9aff937af0 HTTP/1.1" 200 None 2026-04-02 12:04:19,347 - lava_callback - DEBUG - Processing node 69cbb83d2a64fa9aff937af0: baseline-arm64-clabbe 2026-04-02 12:04:19,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb83d2a64fa9aff937af0 2026-04-02 12:04:19,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:04:19,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb83d2a64fa9aff937af0 HTTP/1.1" 200 None 2026-04-02 12:04:19,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:04:19,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:04:19,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:04:19,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb83d2a64fa9aff937af0 HTTP/1.1" 200 None 2026-04-02 12:04:19,416 - lava_callback - ERROR - Error processing callback for node 69cbb83d2a64fa9aff937af0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:07:59,425 - lava_callback - INFO - Received callback for node 69cbb91c2a64fa9aff937b02 INFO: 172.21.0.1:42792 - "POST /node/69cbb91c2a64fa9aff937b02 HTTP/1.0" 202 Accepted 2026-04-02 12:07:59,431 - lava_callback - INFO - Starting async job submit for node 69cbb91c2a64fa9aff937b02 2026-04-02 12:07:59,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:07:59,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb91c2a64fa9aff937b02 HTTP/1.1" 200 None 2026-04-02 12:07:59,451 - lava_callback - DEBUG - Processing node 69cbb91c2a64fa9aff937b02: baseline-arm64-clabbe 2026-04-02 12:07:59,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb91c2a64fa9aff937b02 2026-04-02 12:07:59,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:07:59,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb91c2a64fa9aff937b02 HTTP/1.1" 200 None 2026-04-02 12:07:59,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:07:59,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:07:59,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:07:59,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb91c2a64fa9aff937b02 HTTP/1.1" 200 None 2026-04-02 12:07:59,508 - lava_callback - ERROR - Error processing callback for node 69cbb91c2a64fa9aff937b02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51700 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:09:19,489 - lava_callback - INFO - Received callback for node 69cbb96b2a64fa9aff937b0a INFO: 172.21.0.1:51702 - "POST /node/69cbb96b2a64fa9aff937b0a HTTP/1.0" 202 Accepted 2026-04-02 12:09:19,494 - lava_callback - INFO - Starting async job submit for node 69cbb96b2a64fa9aff937b0a 2026-04-02 12:09:19,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:09:19,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb96b2a64fa9aff937b0a HTTP/1.1" 200 None 2026-04-02 12:09:19,512 - lava_callback - DEBUG - Processing node 69cbb96b2a64fa9aff937b0a: baseline-arm64-clabbe 2026-04-02 12:09:19,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb96b2a64fa9aff937b0a 2026-04-02 12:09:19,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:09:19,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb96b2a64fa9aff937b0a HTTP/1.1" 200 None 2026-04-02 12:09:19,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:09:19,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:09:19,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:09:19,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb96b2a64fa9aff937b0a HTTP/1.1" 200 None 2026-04-02 12:09:19,572 - lava_callback - ERROR - Error processing callback for node 69cbb96b2a64fa9aff937b0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:10:59,536 - lava_callback - INFO - Received callback for node 69cbb9d12a64fa9aff937b18 INFO: 172.21.0.1:50198 - "POST /node/69cbb9d12a64fa9aff937b18 HTTP/1.0" 202 Accepted 2026-04-02 12:10:59,541 - lava_callback - INFO - Starting async job submit for node 69cbb9d12a64fa9aff937b18 2026-04-02 12:10:59,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:10:59,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb9d12a64fa9aff937b18 HTTP/1.1" 200 None 2026-04-02 12:10:59,558 - lava_callback - DEBUG - Processing node 69cbb9d12a64fa9aff937b18: baseline-arm64-clabbe 2026-04-02 12:10:59,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb9d12a64fa9aff937b18 2026-04-02 12:10:59,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:10:59,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb9d12a64fa9aff937b18 HTTP/1.1" 200 None 2026-04-02 12:10:59,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:10:59,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:10:59,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:10:59,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb9d12a64fa9aff937b18 HTTP/1.1" 200 None 2026-04-02 12:10:59,618 - lava_callback - ERROR - Error processing callback for node 69cbb9d12a64fa9aff937b18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46380 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:12:19,606 - lava_callback - INFO - Received callback for node 69cbba1d2a64fa9aff937b20 INFO: 172.21.0.1:46392 - "POST /node/69cbba1d2a64fa9aff937b20 HTTP/1.0" 202 Accepted 2026-04-02 12:12:19,612 - lava_callback - INFO - Starting async job submit for node 69cbba1d2a64fa9aff937b20 2026-04-02 12:12:19,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:12:19,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbba1d2a64fa9aff937b20 HTTP/1.1" 200 None 2026-04-02 12:12:19,628 - lava_callback - DEBUG - Processing node 69cbba1d2a64fa9aff937b20: baseline-arm64-clabbe 2026-04-02 12:12:19,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbba1d2a64fa9aff937b20 2026-04-02 12:12:19,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:12:19,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbba1d2a64fa9aff937b20 HTTP/1.1" 200 None 2026-04-02 12:12:19,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:12:19,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:12:19,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:12:19,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbba1d2a64fa9aff937b20 HTTP/1.1" 200 None 2026-04-02 12:12:19,688 - lava_callback - ERROR - Error processing callback for node 69cbba1d2a64fa9aff937b20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:23:19,649 - lava_callback - INFO - Received callback for node 69ce2be3cb08ea23a1f68449 INFO: 172.21.0.1:36026 - "POST /node/69ce2be3cb08ea23a1f68449 HTTP/1.0" 202 Accepted 2026-04-02 12:23:19,655 - lava_callback - INFO - Starting async job submit for node 69ce2be3cb08ea23a1f68449 2026-04-02 12:23:19,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:23:19,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be3cb08ea23a1f68449 HTTP/1.1" 200 None 2026-04-02 12:23:19,688 - lava_callback - DEBUG - Processing node 69ce2be3cb08ea23a1f68449: baseline-x86 2026-04-02 12:23:19,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 12:23:20,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 12:23:20,146 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be3cb08ea23a1f68449/log.txt.gz 2026-04-02 12:23:20,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 12:23:20,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 12:23:20,561 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be3cb08ea23a1f68449/lava-logs.yaml 2026-04-02 12:23:20,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 12:23:20,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 12:23:20,727 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be3cb08ea23a1f68449/lava_callback.json.gz 2026-04-02 12:23:20,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:23:20,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be3cb08ea23a1f68449 HTTP/1.1" 200 None 2026-04-02 12:23:20,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:23:20,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce268acb08ea23a1f68099 HTTP/1.1" 200 None 2026-04-02 12:23:20,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:23:20,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2be3cb08ea23a1f68449 HTTP/1.1" 200 None 2026-04-02 12:23:20,838 - lava_callback - INFO - Completed processing callback for node 69ce2be3cb08ea23a1f68449 INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:23:28,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:23:28,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59974 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:47:55,417 - lava_callback - INFO - Received callback for node 69cbc2712a64fa9aff937b88 INFO: 172.21.0.1:48574 - "POST /node/69cbc2712a64fa9aff937b88 HTTP/1.0" 202 Accepted 2026-04-02 12:47:55,423 - lava_callback - INFO - Starting async job submit for node 69cbc2712a64fa9aff937b88 2026-04-02 12:47:55,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:47:55,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2712a64fa9aff937b88 HTTP/1.1" 200 None 2026-04-02 12:47:55,439 - lava_callback - DEBUG - Processing node 69cbc2712a64fa9aff937b88: baseline-arm-baylibre 2026-04-02 12:47:55,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc2712a64fa9aff937b88 2026-04-02 12:47:55,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:47:55,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2712a64fa9aff937b88 HTTP/1.1" 200 None 2026-04-02 12:47:55,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:47:55,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:47:55,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:47:55,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc2712a64fa9aff937b88 HTTP/1.1" 200 None 2026-04-02 12:47:55,495 - lava_callback - ERROR - Error processing callback for node 69cbc2712a64fa9aff937b88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43868 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:48:55,230 - lava_callback - INFO - Received callback for node 69cbc2aa2a64fa9aff937b97 INFO: 172.21.0.1:34836 - "POST /node/69cbc2aa2a64fa9aff937b97 HTTP/1.0" 202 Accepted 2026-04-02 12:48:55,236 - lava_callback - INFO - Starting async job submit for node 69cbc2aa2a64fa9aff937b97 2026-04-02 12:48:55,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:48:55,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2aa2a64fa9aff937b97 HTTP/1.1" 200 None 2026-04-02 12:48:55,253 - lava_callback - DEBUG - Processing node 69cbc2aa2a64fa9aff937b97: baseline-arm-baylibre 2026-04-02 12:48:55,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc2aa2a64fa9aff937b97 2026-04-02 12:48:55,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:48:55,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2aa2a64fa9aff937b97 HTTP/1.1" 200 None 2026-04-02 12:48:55,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:48:55,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:48:55,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:48:55,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc2aa2a64fa9aff937b97 HTTP/1.1" 200 None 2026-04-02 12:48:55,345 - lava_callback - ERROR - Error processing callback for node 69cbc2aa2a64fa9aff937b97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:49:35,292 - lava_callback - INFO - Received callback for node 69cbc2d02a64fa9aff937ba3 INFO: 172.21.0.1:45672 - "POST /node/69cbc2d02a64fa9aff937ba3 HTTP/1.0" 202 Accepted 2026-04-02 12:49:35,297 - lava_callback - INFO - Starting async job submit for node 69cbc2d02a64fa9aff937ba3 2026-04-02 12:49:35,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:49:35,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2d02a64fa9aff937ba3 HTTP/1.1" 200 None 2026-04-02 12:49:35,324 - lava_callback - DEBUG - Processing node 69cbc2d02a64fa9aff937ba3: baseline-arm-baylibre 2026-04-02 12:49:35,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc2d02a64fa9aff937ba3 2026-04-02 12:49:35,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:49:35,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2d02a64fa9aff937ba3 HTTP/1.1" 200 None 2026-04-02 12:49:35,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:49:35,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:49:35,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:49:35,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc2d02a64fa9aff937ba3 HTTP/1.1" 200 None 2026-04-02 12:49:35,382 - lava_callback - ERROR - Error processing callback for node 69cbc2d02a64fa9aff937ba3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 12:50:15,318 - lava_callback - INFO - Received callback for node 69cbc3032a64fa9aff937bb1 INFO: 172.21.0.1:43922 - "POST /node/69cbc3032a64fa9aff937bb1 HTTP/1.0" 202 Accepted 2026-04-02 12:50:15,324 - lava_callback - INFO - Starting async job submit for node 69cbc3032a64fa9aff937bb1 2026-04-02 12:50:15,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:15,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3032a64fa9aff937bb1 HTTP/1.1" 200 None 2026-04-02 12:50:15,342 - lava_callback - DEBUG - Processing node 69cbc3032a64fa9aff937bb1: baseline-arm-baylibre 2026-04-02 12:50:15,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3032a64fa9aff937bb1 2026-04-02 12:50:15,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:15,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3032a64fa9aff937bb1 HTTP/1.1" 200 None 2026-04-02 12:50:15,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:15,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:50:15,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:15,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3032a64fa9aff937bb1 HTTP/1.1" 200 None 2026-04-02 12:50:15,403 - lava_callback - ERROR - Error processing callback for node 69cbc3032a64fa9aff937bb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:50:55,541 - lava_callback - INFO - Received callback for node 69cbc3262a64fa9aff937bc1 INFO: 172.21.0.1:34986 - "POST /node/69cbc3262a64fa9aff937bc1 HTTP/1.0" 202 Accepted 2026-04-02 12:50:55,547 - lava_callback - INFO - Starting async job submit for node 69cbc3262a64fa9aff937bc1 2026-04-02 12:50:55,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:55,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3262a64fa9aff937bc1 HTTP/1.1" 200 None 2026-04-02 12:50:55,563 - lava_callback - DEBUG - Processing node 69cbc3262a64fa9aff937bc1: baseline-arm-baylibre 2026-04-02 12:50:55,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3262a64fa9aff937bc1 2026-04-02 12:50:55,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:55,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3262a64fa9aff937bc1 HTTP/1.1" 200 None 2026-04-02 12:50:55,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:55,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:50:55,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:55,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3262a64fa9aff937bc1 HTTP/1.1" 200 None 2026-04-02 12:50:55,626 - lava_callback - ERROR - Error processing callback for node 69cbc3262a64fa9aff937bc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:51:35,363 - lava_callback - INFO - Received callback for node 69cbc34d2a64fa9aff937bcb INFO: 172.21.0.1:60612 - "POST /node/69cbc34d2a64fa9aff937bcb HTTP/1.0" 202 Accepted 2026-04-02 12:51:35,369 - lava_callback - INFO - Starting async job submit for node 69cbc34d2a64fa9aff937bcb 2026-04-02 12:51:35,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:51:35,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc34d2a64fa9aff937bcb HTTP/1.1" 200 None 2026-04-02 12:51:35,386 - lava_callback - DEBUG - Processing node 69cbc34d2a64fa9aff937bcb: baseline-arm-baylibre 2026-04-02 12:51:35,386 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc34d2a64fa9aff937bcb 2026-04-02 12:51:35,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:51:35,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc34d2a64fa9aff937bcb HTTP/1.1" 200 None 2026-04-02 12:51:35,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:51:35,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:51:35,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:51:35,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc34d2a64fa9aff937bcb HTTP/1.1" 200 None 2026-04-02 12:51:35,444 - lava_callback - ERROR - Error processing callback for node 69cbc34d2a64fa9aff937bcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58452 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 12:52:15,441 - lava_callback - INFO - Received callback for node 69cbc3732a64fa9aff937bdb INFO: 172.21.0.1:58466 - "POST /node/69cbc3732a64fa9aff937bdb HTTP/1.0" 202 Accepted 2026-04-02 12:52:15,446 - lava_callback - INFO - Starting async job submit for node 69cbc3732a64fa9aff937bdb 2026-04-02 12:52:15,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:15,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3732a64fa9aff937bdb HTTP/1.1" 200 None 2026-04-02 12:52:15,464 - lava_callback - DEBUG - Processing node 69cbc3732a64fa9aff937bdb: baseline-arm-baylibre 2026-04-02 12:52:15,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3732a64fa9aff937bdb 2026-04-02 12:52:15,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:15,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3732a64fa9aff937bdb HTTP/1.1" 200 None 2026-04-02 12:52:15,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:15,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:52:15,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:15,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3732a64fa9aff937bdb HTTP/1.1" 200 None 2026-04-02 12:52:15,524 - lava_callback - ERROR - Error processing callback for node 69cbc3732a64fa9aff937bdb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:52:55,418 - lava_callback - INFO - Received callback for node 69cbc3972a64fa9aff937be8 INFO: 172.21.0.1:40276 - "POST /node/69cbc3972a64fa9aff937be8 HTTP/1.0" 202 Accepted 2026-04-02 12:52:55,423 - lava_callback - INFO - Starting async job submit for node 69cbc3972a64fa9aff937be8 2026-04-02 12:52:55,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:55,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3972a64fa9aff937be8 HTTP/1.1" 200 None 2026-04-02 12:52:55,467 - lava_callback - DEBUG - Processing node 69cbc3972a64fa9aff937be8: baseline-arm-baylibre 2026-04-02 12:52:55,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3972a64fa9aff937be8 2026-04-02 12:52:55,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:55,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3972a64fa9aff937be8 HTTP/1.1" 200 None 2026-04-02 12:52:55,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:55,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:52:55,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:55,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3972a64fa9aff937be8 HTTP/1.1" 200 None 2026-04-02 12:52:55,522 - lava_callback - ERROR - Error processing callback for node 69cbc3972a64fa9aff937be8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:53:21,709 - lava_callback - INFO - Received callback for node 69cbc3bd2a64fa9aff937bf5 INFO: 172.21.0.1:55762 - "POST /node/69cbc3bd2a64fa9aff937bf5 HTTP/1.0" 202 Accepted 2026-04-02 12:53:21,714 - lava_callback - INFO - Starting async job submit for node 69cbc3bd2a64fa9aff937bf5 2026-04-02 12:53:21,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:53:21,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3bd2a64fa9aff937bf5 HTTP/1.1" 200 None 2026-04-02 12:53:21,731 - lava_callback - DEBUG - Processing node 69cbc3bd2a64fa9aff937bf5: baseline-arm-clabbe 2026-04-02 12:53:21,731 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3bd2a64fa9aff937bf5 2026-04-02 12:53:21,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:53:21,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3bd2a64fa9aff937bf5 HTTP/1.1" 200 None 2026-04-02 12:53:21,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:53:21,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:53:21,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:53:21,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3bd2a64fa9aff937bf5 HTTP/1.1" 200 None 2026-04-02 12:53:21,796 - lava_callback - ERROR - Error processing callback for node 69cbc3bd2a64fa9aff937bf5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:54:01,144 - lava_callback - INFO - Received callback for node 69cbc3e32a64fa9aff937c06 INFO: 172.21.0.1:38464 - "POST /node/69cbc3e32a64fa9aff937c06 HTTP/1.0" 202 Accepted 2026-04-02 12:54:01,151 - lava_callback - INFO - Starting async job submit for node 69cbc3e32a64fa9aff937c06 2026-04-02 12:54:01,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:01,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3e32a64fa9aff937c06 HTTP/1.1" 200 None 2026-04-02 12:54:01,168 - lava_callback - DEBUG - Processing node 69cbc3e32a64fa9aff937c06: baseline-arm-clabbe 2026-04-02 12:54:01,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3e32a64fa9aff937c06 2026-04-02 12:54:01,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:01,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3e32a64fa9aff937c06 HTTP/1.1" 200 None 2026-04-02 12:54:01,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:01,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:54:01,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:01,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3e32a64fa9aff937c06 HTTP/1.1" 200 None 2026-04-02 12:54:01,231 - lava_callback - ERROR - Error processing callback for node 69cbc3e32a64fa9aff937c06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34208 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:54:41,231 - lava_callback - INFO - Received callback for node 69cbc4082a64fa9aff937c11 INFO: 172.21.0.1:54558 - "POST /node/69cbc4082a64fa9aff937c11 HTTP/1.0" 202 Accepted 2026-04-02 12:54:41,236 - lava_callback - INFO - Starting async job submit for node 69cbc4082a64fa9aff937c11 2026-04-02 12:54:41,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:41,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4082a64fa9aff937c11 HTTP/1.1" 200 None 2026-04-02 12:54:41,253 - lava_callback - DEBUG - Processing node 69cbc4082a64fa9aff937c11: baseline-arm-clabbe 2026-04-02 12:54:41,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc4082a64fa9aff937c11 2026-04-02 12:54:41,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:41,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4082a64fa9aff937c11 HTTP/1.1" 200 None 2026-04-02 12:54:41,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:41,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:54:41,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:41,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc4082a64fa9aff937c11 HTTP/1.1" 200 None 2026-04-02 12:54:41,316 - lava_callback - ERROR - Error processing callback for node 69cbc4082a64fa9aff937c11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:55:21,187 - lava_callback - INFO - Received callback for node 69cbc42e2a64fa9aff937c20 INFO: 172.21.0.1:57104 - "POST /node/69cbc42e2a64fa9aff937c20 HTTP/1.0" 202 Accepted 2026-04-02 12:55:21,192 - lava_callback - INFO - Starting async job submit for node 69cbc42e2a64fa9aff937c20 2026-04-02 12:55:21,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:55:21,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc42e2a64fa9aff937c20 HTTP/1.1" 200 None 2026-04-02 12:55:21,213 - lava_callback - DEBUG - Processing node 69cbc42e2a64fa9aff937c20: baseline-arm-clabbe 2026-04-02 12:55:21,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc42e2a64fa9aff937c20 2026-04-02 12:55:21,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:55:21,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc42e2a64fa9aff937c20 HTTP/1.1" 200 None 2026-04-02 12:55:21,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:55:21,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:55:21,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:55:21,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc42e2a64fa9aff937c20 HTTP/1.1" 200 None 2026-04-02 12:55:21,269 - lava_callback - ERROR - Error processing callback for node 69cbc42e2a64fa9aff937c20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:56:01,274 - lava_callback - INFO - Received callback for node 69cbc4542a64fa9aff937c32 INFO: 172.21.0.1:47204 - "POST /node/69cbc4542a64fa9aff937c32 HTTP/1.0" 202 Accepted 2026-04-02 12:56:01,279 - lava_callback - INFO - Starting async job submit for node 69cbc4542a64fa9aff937c32 2026-04-02 12:56:01,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:01,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4542a64fa9aff937c32 HTTP/1.1" 200 None 2026-04-02 12:56:01,295 - lava_callback - DEBUG - Processing node 69cbc4542a64fa9aff937c32: baseline-arm-clabbe 2026-04-02 12:56:01,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc4542a64fa9aff937c32 2026-04-02 12:56:01,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:01,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4542a64fa9aff937c32 HTTP/1.1" 200 None 2026-04-02 12:56:01,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:01,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:56:01,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:01,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc4542a64fa9aff937c32 HTTP/1.1" 200 None 2026-04-02 12:56:01,351 - lava_callback - ERROR - Error processing callback for node 69cbc4542a64fa9aff937c32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56208 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:56:41,281 - lava_callback - INFO - Received callback for node 69cbc4792a64fa9aff937c3f INFO: 172.21.0.1:49396 - "POST /node/69cbc4792a64fa9aff937c3f HTTP/1.0" 202 Accepted 2026-04-02 12:56:41,287 - lava_callback - INFO - Starting async job submit for node 69cbc4792a64fa9aff937c3f 2026-04-02 12:56:41,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:41,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4792a64fa9aff937c3f HTTP/1.1" 200 None 2026-04-02 12:56:41,313 - lava_callback - DEBUG - Processing node 69cbc4792a64fa9aff937c3f: baseline-arm-clabbe 2026-04-02 12:56:41,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc4792a64fa9aff937c3f 2026-04-02 12:56:41,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:41,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4792a64fa9aff937c3f HTTP/1.1" 200 None 2026-04-02 12:56:41,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:41,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:56:41,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:41,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc4792a64fa9aff937c3f HTTP/1.1" 200 None 2026-04-02 12:56:41,379 - lava_callback - ERROR - Error processing callback for node 69cbc4792a64fa9aff937c3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:57:21,365 - lava_callback - INFO - Received callback for node 69cbc49e2a64fa9aff937c4e INFO: 172.21.0.1:39234 - "POST /node/69cbc49e2a64fa9aff937c4e HTTP/1.0" 202 Accepted 2026-04-02 12:57:21,370 - lava_callback - INFO - Starting async job submit for node 69cbc49e2a64fa9aff937c4e 2026-04-02 12:57:21,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:57:21,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc49e2a64fa9aff937c4e HTTP/1.1" 200 None 2026-04-02 12:57:21,405 - lava_callback - DEBUG - Processing node 69cbc49e2a64fa9aff937c4e: baseline-arm-clabbe 2026-04-02 12:57:21,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc49e2a64fa9aff937c4e 2026-04-02 12:57:21,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:57:21,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc49e2a64fa9aff937c4e HTTP/1.1" 200 None 2026-04-02 12:57:21,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:57:21,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:57:21,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:57:21,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc49e2a64fa9aff937c4e HTTP/1.1" 200 None 2026-04-02 12:57:21,495 - lava_callback - ERROR - Error processing callback for node 69cbc49e2a64fa9aff937c4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33652 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:58:01,366 - lava_callback - INFO - Received callback for node 69cbc4c42a64fa9aff937c5b INFO: 172.21.0.1:35868 - "POST /node/69cbc4c42a64fa9aff937c5b HTTP/1.0" 202 Accepted 2026-04-02 12:58:01,372 - lava_callback - INFO - Starting async job submit for node 69cbc4c42a64fa9aff937c5b 2026-04-02 12:58:01,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:01,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4c42a64fa9aff937c5b HTTP/1.1" 200 None 2026-04-02 12:58:01,396 - lava_callback - DEBUG - Processing node 69cbc4c42a64fa9aff937c5b: baseline-arm-clabbe 2026-04-02 12:58:01,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc4c42a64fa9aff937c5b 2026-04-02 12:58:01,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:01,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4c42a64fa9aff937c5b HTTP/1.1" 200 None 2026-04-02 12:58:01,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:01,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:58:01,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:01,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc4c42a64fa9aff937c5b HTTP/1.1" 200 None 2026-04-02 12:58:01,447 - lava_callback - ERROR - Error processing callback for node 69cbc4c42a64fa9aff937c5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43636 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:58:21,422 - lava_callback - INFO - Received callback for node 69cbc4ea2a64fa9aff937c67 INFO: 172.21.0.1:45038 - "POST /node/69cbc4ea2a64fa9aff937c67 HTTP/1.0" 202 Accepted 2026-04-02 12:58:21,428 - lava_callback - INFO - Starting async job submit for node 69cbc4ea2a64fa9aff937c67 2026-04-02 12:58:21,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:21,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4ea2a64fa9aff937c67 HTTP/1.1" 200 None 2026-04-02 12:58:21,444 - lava_callback - DEBUG - Processing node 69cbc4ea2a64fa9aff937c67: baseline-arm-clabbe 2026-04-02 12:58:21,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc4ea2a64fa9aff937c67 2026-04-02 12:58:21,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:21,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4ea2a64fa9aff937c67 HTTP/1.1" 200 None 2026-04-02 12:58:21,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:21,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:58:21,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:21,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc4ea2a64fa9aff937c67 HTTP/1.1" 200 None 2026-04-02 12:58:21,508 - lava_callback - ERROR - Error processing callback for node 69cbc4ea2a64fa9aff937c67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51232 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:59:01,440 - lava_callback - INFO - Received callback for node 69cbc5102a64fa9aff937c79 INFO: 172.21.0.1:48916 - "POST /node/69cbc5102a64fa9aff937c79 HTTP/1.0" 202 Accepted 2026-04-02 12:59:01,446 - lava_callback - INFO - Starting async job submit for node 69cbc5102a64fa9aff937c79 2026-04-02 12:59:01,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:01,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5102a64fa9aff937c79 HTTP/1.1" 200 None 2026-04-02 12:59:01,462 - lava_callback - DEBUG - Processing node 69cbc5102a64fa9aff937c79: baseline-arm-clabbe 2026-04-02 12:59:01,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5102a64fa9aff937c79 2026-04-02 12:59:01,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:01,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5102a64fa9aff937c79 HTTP/1.1" 200 None 2026-04-02 12:59:01,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:01,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:59:01,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:01,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5102a64fa9aff937c79 HTTP/1.1" 200 None 2026-04-02 12:59:01,539 - lava_callback - ERROR - Error processing callback for node 69cbc5102a64fa9aff937c79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:59:41,456 - lava_callback - INFO - Received callback for node 69cbc5392a64fa9aff937c82 INFO: 172.21.0.1:48906 - "POST /node/69cbc5392a64fa9aff937c82 HTTP/1.0" 202 Accepted 2026-04-02 12:59:41,462 - lava_callback - INFO - Starting async job submit for node 69cbc5392a64fa9aff937c82 2026-04-02 12:59:41,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:41,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5392a64fa9aff937c82 HTTP/1.1" 200 None 2026-04-02 12:59:41,477 - lava_callback - DEBUG - Processing node 69cbc5392a64fa9aff937c82: baseline-arm-clabbe 2026-04-02 12:59:41,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5392a64fa9aff937c82 2026-04-02 12:59:41,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:41,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5392a64fa9aff937c82 HTTP/1.1" 200 None 2026-04-02 12:59:41,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:41,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:59:41,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:41,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5392a64fa9aff937c82 HTTP/1.1" 200 None 2026-04-02 12:59:41,539 - lava_callback - ERROR - Error processing callback for node 69cbc5392a64fa9aff937c82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:00:21,457 - lava_callback - INFO - Received callback for node 69cbc5612a64fa9aff937c92 INFO: 172.21.0.1:43292 - "POST /node/69cbc5612a64fa9aff937c92 HTTP/1.0" 202 Accepted 2026-04-02 13:00:21,463 - lava_callback - INFO - Starting async job submit for node 69cbc5612a64fa9aff937c92 2026-04-02 13:00:21,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:00:21,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5612a64fa9aff937c92 HTTP/1.1" 200 None 2026-04-02 13:00:21,479 - lava_callback - DEBUG - Processing node 69cbc5612a64fa9aff937c92: baseline-arm-clabbe 2026-04-02 13:00:21,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5612a64fa9aff937c92 2026-04-02 13:00:21,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:00:21,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5612a64fa9aff937c92 HTTP/1.1" 200 None 2026-04-02 13:00:21,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:00:21,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 13:00:21,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:00:21,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5612a64fa9aff937c92 HTTP/1.1" 200 None 2026-04-02 13:00:21,539 - lava_callback - ERROR - Error processing callback for node 69cbc5612a64fa9aff937c92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:01:01,542 - lava_callback - INFO - Received callback for node 69cbc5892a64fa9aff937ca1 INFO: 172.21.0.1:50230 - "POST /node/69cbc5892a64fa9aff937ca1 HTTP/1.0" 202 Accepted 2026-04-02 13:01:01,548 - lava_callback - INFO - Starting async job submit for node 69cbc5892a64fa9aff937ca1 2026-04-02 13:01:01,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:01,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5892a64fa9aff937ca1 HTTP/1.1" 200 None 2026-04-02 13:01:01,605 - lava_callback - DEBUG - Processing node 69cbc5892a64fa9aff937ca1: baseline-arm-clabbe 2026-04-02 13:01:01,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5892a64fa9aff937ca1 2026-04-02 13:01:01,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:01,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5892a64fa9aff937ca1 HTTP/1.1" 200 None 2026-04-02 13:01:01,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:01,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 13:01:01,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:01,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5892a64fa9aff937ca1 HTTP/1.1" 200 None 2026-04-02 13:01:01,672 - lava_callback - ERROR - Error processing callback for node 69cbc5892a64fa9aff937ca1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:01:41,532 - lava_callback - INFO - Received callback for node 69cbc5b02a64fa9aff937ca9 INFO: 172.21.0.1:52260 - "POST /node/69cbc5b02a64fa9aff937ca9 HTTP/1.0" 202 Accepted 2026-04-02 13:01:41,538 - lava_callback - INFO - Starting async job submit for node 69cbc5b02a64fa9aff937ca9 2026-04-02 13:01:41,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:41,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5b02a64fa9aff937ca9 HTTP/1.1" 200 None 2026-04-02 13:01:41,554 - lava_callback - DEBUG - Processing node 69cbc5b02a64fa9aff937ca9: baseline-arm-clabbe 2026-04-02 13:01:41,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5b02a64fa9aff937ca9 2026-04-02 13:01:41,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:41,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5b02a64fa9aff937ca9 HTTP/1.1" 200 None 2026-04-02 13:01:41,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:41,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 13:01:41,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:41,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5b02a64fa9aff937ca9 HTTP/1.1" 200 None 2026-04-02 13:01:41,615 - lava_callback - ERROR - Error processing callback for node 69cbc5b02a64fa9aff937ca9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:02:21,594 - lava_callback - INFO - Received callback for node 69cbc5d82a64fa9aff937cb7 INFO: 172.21.0.1:56798 - "POST /node/69cbc5d82a64fa9aff937cb7 HTTP/1.0" 202 Accepted 2026-04-02 13:02:21,599 - lava_callback - INFO - Starting async job submit for node 69cbc5d82a64fa9aff937cb7 2026-04-02 13:02:21,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:02:21,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5d82a64fa9aff937cb7 HTTP/1.1" 200 None 2026-04-02 13:02:21,615 - lava_callback - DEBUG - Processing node 69cbc5d82a64fa9aff937cb7: baseline-arm-clabbe 2026-04-02 13:02:21,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5d82a64fa9aff937cb7 2026-04-02 13:02:21,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:02:21,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5d82a64fa9aff937cb7 HTTP/1.1" 200 None 2026-04-02 13:02:21,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:02:21,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 13:02:21,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:02:21,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5d82a64fa9aff937cb7 HTTP/1.1" 200 None 2026-04-02 13:02:21,666 - lava_callback - ERROR - Error processing callback for node 69cbc5d82a64fa9aff937cb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:06:56,336 - lava_callback - INFO - Received callback for node 69cbc6e32a64fa9aff937ce7 INFO: 172.21.0.1:33684 - "POST /node/69cbc6e32a64fa9aff937ce7 HTTP/1.0" 202 Accepted 2026-04-02 13:06:56,342 - lava_callback - INFO - Starting async job submit for node 69cbc6e32a64fa9aff937ce7 2026-04-02 13:06:56,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:06:56,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc6e32a64fa9aff937ce7 HTTP/1.1" 200 None 2026-04-02 13:06:56,358 - lava_callback - DEBUG - Processing node 69cbc6e32a64fa9aff937ce7: baseline-arm-baylibre 2026-04-02 13:06:56,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc6e32a64fa9aff937ce7 2026-04-02 13:06:56,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:06:56,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc6e32a64fa9aff937ce7 HTTP/1.1" 200 None 2026-04-02 13:06:56,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:06:56,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:06:56,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:06:56,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc6e32a64fa9aff937ce7 HTTP/1.1" 200 None 2026-04-02 13:06:56,421 - lava_callback - ERROR - Error processing callback for node 69cbc6e32a64fa9aff937ce7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:07:36,233 - lava_callback - INFO - Received callback for node 69cbc7092a64fa9aff937cf2 INFO: 172.21.0.1:59442 - "POST /node/69cbc7092a64fa9aff937cf2 HTTP/1.0" 202 Accepted 2026-04-02 13:07:36,238 - lava_callback - INFO - Starting async job submit for node 69cbc7092a64fa9aff937cf2 2026-04-02 13:07:36,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:07:36,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc7092a64fa9aff937cf2 HTTP/1.1" 200 None 2026-04-02 13:07:36,254 - lava_callback - DEBUG - Processing node 69cbc7092a64fa9aff937cf2: baseline-arm-baylibre 2026-04-02 13:07:36,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc7092a64fa9aff937cf2 2026-04-02 13:07:36,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:07:36,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc7092a64fa9aff937cf2 HTTP/1.1" 200 None 2026-04-02 13:07:36,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:07:36,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:07:36,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:07:36,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc7092a64fa9aff937cf2 HTTP/1.1" 200 None 2026-04-02 13:07:36,314 - lava_callback - ERROR - Error processing callback for node 69cbc7092a64fa9aff937cf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 13:08:16,288 - lava_callback - INFO - Received callback for node 69cbc72f2a64fa9aff937d04 INFO: 172.21.0.1:56032 - "POST /node/69cbc72f2a64fa9aff937d04 HTTP/1.0" 202 Accepted 2026-04-02 13:08:16,297 - lava_callback - INFO - Starting async job submit for node 69cbc72f2a64fa9aff937d04 2026-04-02 13:08:16,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:08:16,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc72f2a64fa9aff937d04 HTTP/1.1" 200 None 2026-04-02 13:08:16,320 - lava_callback - DEBUG - Processing node 69cbc72f2a64fa9aff937d04: baseline-arm-baylibre 2026-04-02 13:08:16,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc72f2a64fa9aff937d04 2026-04-02 13:08:16,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:08:16,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc72f2a64fa9aff937d04 HTTP/1.1" 200 None 2026-04-02 13:08:16,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:08:16,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:08:16,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:08:16,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc72f2a64fa9aff937d04 HTTP/1.1" 200 None 2026-04-02 13:08:16,378 - lava_callback - ERROR - Error processing callback for node 69cbc72f2a64fa9aff937d04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:09:36,387 - lava_callback - INFO - Received callback for node 69cbc77b2a64fa9aff937d18 INFO: 172.21.0.1:48706 - "POST /node/69cbc77b2a64fa9aff937d18 HTTP/1.0" 202 Accepted 2026-04-02 13:09:36,393 - lava_callback - INFO - Starting async job submit for node 69cbc77b2a64fa9aff937d18 2026-04-02 13:09:36,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:36,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc77b2a64fa9aff937d18 HTTP/1.1" 200 None 2026-04-02 13:09:36,409 - lava_callback - DEBUG - Processing node 69cbc77b2a64fa9aff937d18: baseline-arm-baylibre 2026-04-02 13:09:36,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc77b2a64fa9aff937d18 2026-04-02 13:09:36,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:36,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc77b2a64fa9aff937d18 HTTP/1.1" 200 None 2026-04-02 13:09:36,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:36,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:09:36,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:36,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc77b2a64fa9aff937d18 HTTP/1.1" 200 None 2026-04-02 13:09:36,459 - lava_callback - ERROR - Error processing callback for node 69cbc77b2a64fa9aff937d18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55972 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:09:56,354 - lava_callback - INFO - Received callback for node 69cbc7a02a64fa9aff937d2b INFO: 172.21.0.1:57818 - "POST /node/69cbc7a02a64fa9aff937d2b HTTP/1.0" 202 Accepted 2026-04-02 13:09:56,359 - lava_callback - INFO - Starting async job submit for node 69cbc7a02a64fa9aff937d2b 2026-04-02 13:09:56,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:56,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc7a02a64fa9aff937d2b HTTP/1.1" 200 None 2026-04-02 13:09:56,375 - lava_callback - DEBUG - Processing node 69cbc7a02a64fa9aff937d2b: baseline-arm-baylibre 2026-04-02 13:09:56,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc7a02a64fa9aff937d2b 2026-04-02 13:09:56,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:56,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc7a02a64fa9aff937d2b HTTP/1.1" 200 None 2026-04-02 13:09:56,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:56,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:09:56,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:56,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc7a02a64fa9aff937d2b HTTP/1.1" 200 None 2026-04-02 13:09:56,450 - lava_callback - ERROR - Error processing callback for node 69cbc7a02a64fa9aff937d2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45776 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:12:02,184 - lava_callback - INFO - Received callback for node 69cbc8102a64fa9aff937d50 INFO: 172.21.0.1:55992 - "POST /node/69cbc8102a64fa9aff937d50 HTTP/1.0" 202 Accepted 2026-04-02 13:12:02,190 - lava_callback - INFO - Starting async job submit for node 69cbc8102a64fa9aff937d50 2026-04-02 13:12:02,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:02,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8102a64fa9aff937d50 HTTP/1.1" 200 None 2026-04-02 13:12:02,208 - lava_callback - DEBUG - Processing node 69cbc8102a64fa9aff937d50: baseline-arm-clabbe 2026-04-02 13:12:02,208 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc8102a64fa9aff937d50 2026-04-02 13:12:02,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:02,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8102a64fa9aff937d50 HTTP/1.1" 200 None 2026-04-02 13:12:02,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:02,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:12:02,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:02,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc8102a64fa9aff937d50 HTTP/1.1" 200 None 2026-04-02 13:12:02,270 - lava_callback - ERROR - Error processing callback for node 69cbc8102a64fa9aff937d50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:12:41,983 - lava_callback - INFO - Received callback for node 69cbc8352a64fa9aff937d60 INFO: 172.21.0.1:46544 - "POST /node/69cbc8352a64fa9aff937d60 HTTP/1.0" 202 Accepted 2026-04-02 13:12:41,989 - lava_callback - INFO - Starting async job submit for node 69cbc8352a64fa9aff937d60 2026-04-02 13:12:41,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:42,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8352a64fa9aff937d60 HTTP/1.1" 200 None 2026-04-02 13:12:42,004 - lava_callback - DEBUG - Processing node 69cbc8352a64fa9aff937d60: baseline-arm-clabbe 2026-04-02 13:12:42,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc8352a64fa9aff937d60 2026-04-02 13:12:42,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:42,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8352a64fa9aff937d60 HTTP/1.1" 200 None 2026-04-02 13:12:42,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:42,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:12:42,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:42,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc8352a64fa9aff937d60 HTTP/1.1" 200 None 2026-04-02 13:12:42,080 - lava_callback - ERROR - Error processing callback for node 69cbc8352a64fa9aff937d60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:13:02,012 - lava_callback - INFO - Received callback for node 69cbc85b2a64fa9aff937d6c INFO: 172.21.0.1:36648 - "POST /node/69cbc85b2a64fa9aff937d6c HTTP/1.0" 202 Accepted 2026-04-02 13:13:02,017 - lava_callback - INFO - Starting async job submit for node 69cbc85b2a64fa9aff937d6c 2026-04-02 13:13:02,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:02,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc85b2a64fa9aff937d6c HTTP/1.1" 200 None 2026-04-02 13:13:02,207 - lava_callback - DEBUG - Processing node 69cbc85b2a64fa9aff937d6c: baseline-arm-clabbe 2026-04-02 13:13:02,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc85b2a64fa9aff937d6c 2026-04-02 13:13:02,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:02,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc85b2a64fa9aff937d6c HTTP/1.1" 200 None 2026-04-02 13:13:02,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:02,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:13:02,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:02,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc85b2a64fa9aff937d6c HTTP/1.1" 200 None 2026-04-02 13:13:02,273 - lava_callback - ERROR - Error processing callback for node 69cbc85b2a64fa9aff937d6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:13:42,030 - lava_callback - INFO - Received callback for node 69cbc87f2a64fa9aff937d76 INFO: 172.21.0.1:59036 - "POST /node/69cbc87f2a64fa9aff937d76 HTTP/1.0" 202 Accepted 2026-04-02 13:13:42,035 - lava_callback - INFO - Starting async job submit for node 69cbc87f2a64fa9aff937d76 2026-04-02 13:13:42,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:42,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc87f2a64fa9aff937d76 HTTP/1.1" 200 None 2026-04-02 13:13:42,051 - lava_callback - DEBUG - Processing node 69cbc87f2a64fa9aff937d76: baseline-arm-clabbe 2026-04-02 13:13:42,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc87f2a64fa9aff937d76 2026-04-02 13:13:42,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:42,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc87f2a64fa9aff937d76 HTTP/1.1" 200 None 2026-04-02 13:13:42,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:42,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:13:42,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:42,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc87f2a64fa9aff937d76 HTTP/1.1" 200 None 2026-04-02 13:13:42,122 - lava_callback - ERROR - Error processing callback for node 69cbc87f2a64fa9aff937d76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44864 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:14:22,101 - lava_callback - INFO - Received callback for node 69cbc8a42a64fa9aff937d83 INFO: 172.21.0.1:50040 - "POST /node/69cbc8a42a64fa9aff937d83 HTTP/1.0" 202 Accepted 2026-04-02 13:14:22,116 - lava_callback - INFO - Starting async job submit for node 69cbc8a42a64fa9aff937d83 2026-04-02 13:14:22,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:14:22,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8a42a64fa9aff937d83 HTTP/1.1" 200 None 2026-04-02 13:14:22,132 - lava_callback - DEBUG - Processing node 69cbc8a42a64fa9aff937d83: baseline-arm-clabbe 2026-04-02 13:14:22,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc8a42a64fa9aff937d83 2026-04-02 13:14:22,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:14:22,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8a42a64fa9aff937d83 HTTP/1.1" 200 None 2026-04-02 13:14:22,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:14:22,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:14:22,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:14:22,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc8a42a64fa9aff937d83 HTTP/1.1" 200 None 2026-04-02 13:14:22,189 - lava_callback - ERROR - Error processing callback for node 69cbc8a42a64fa9aff937d83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:30:17,599 - lava_callback - INFO - Received callback for node 69cbcc542a64fa9aff937dd7 INFO: 172.21.0.1:48522 - "POST /node/69cbcc542a64fa9aff937dd7 HTTP/1.0" 202 Accepted 2026-04-02 13:30:17,604 - lava_callback - INFO - Starting async job submit for node 69cbcc542a64fa9aff937dd7 2026-04-02 13:30:17,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:30:17,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcc542a64fa9aff937dd7 HTTP/1.1" 200 None 2026-04-02 13:30:17,620 - lava_callback - DEBUG - Processing node 69cbcc542a64fa9aff937dd7: baseline-arm64-baylibre 2026-04-02 13:30:17,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbcc542a64fa9aff937dd7 2026-04-02 13:30:17,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:30:17,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcc542a64fa9aff937dd7 HTTP/1.1" 200 None 2026-04-02 13:30:17,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:30:17,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:30:17,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:30:17,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbcc542a64fa9aff937dd7 HTTP/1.1" 200 None 2026-04-02 13:30:17,676 - lava_callback - ERROR - Error processing callback for node 69cbcc542a64fa9aff937dd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:34:17,699 - lava_callback - INFO - Received callback for node 69cbcd472a64fa9aff937de5 INFO: 172.21.0.1:43276 - "POST /node/69cbcd472a64fa9aff937de5 HTTP/1.0" 202 Accepted 2026-04-02 13:34:17,705 - lava_callback - INFO - Starting async job submit for node 69cbcd472a64fa9aff937de5 2026-04-02 13:34:17,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:34:17,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcd472a64fa9aff937de5 HTTP/1.1" 200 None 2026-04-02 13:34:17,721 - lava_callback - DEBUG - Processing node 69cbcd472a64fa9aff937de5: baseline-arm64-baylibre 2026-04-02 13:34:17,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbcd472a64fa9aff937de5 2026-04-02 13:34:17,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:34:17,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcd472a64fa9aff937de5 HTTP/1.1" 200 None 2026-04-02 13:34:17,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:34:17,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:34:17,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:34:17,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbcd472a64fa9aff937de5 HTTP/1.1" 200 None 2026-04-02 13:34:17,774 - lava_callback - ERROR - Error processing callback for node 69cbcd472a64fa9aff937de5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:36:23,145 - lava_callback - INFO - Received callback for node 69cbcdc62a64fa9aff937df4 INFO: 172.21.0.1:46772 - "POST /node/69cbcdc62a64fa9aff937df4 HTTP/1.0" 202 Accepted 2026-04-02 13:36:23,151 - lava_callback - INFO - Starting async job submit for node 69cbcdc62a64fa9aff937df4 2026-04-02 13:36:23,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:36:23,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcdc62a64fa9aff937df4 HTTP/1.1" 200 None 2026-04-02 13:36:23,168 - lava_callback - DEBUG - Processing node 69cbcdc62a64fa9aff937df4: baseline-arm64-clabbe 2026-04-02 13:36:23,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbcdc62a64fa9aff937df4 2026-04-02 13:36:23,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:36:23,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcdc62a64fa9aff937df4 HTTP/1.1" 200 None 2026-04-02 13:36:23,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:36:23,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:36:23,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:36:23,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbcdc62a64fa9aff937df4 HTTP/1.1" 200 None 2026-04-02 13:36:23,226 - lava_callback - ERROR - Error processing callback for node 69cbcdc62a64fa9aff937df4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49556 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:38:23,238 - lava_callback - INFO - Received callback for node 69cbce3d2a64fa9aff937e00 INFO: 172.21.0.1:60376 - "POST /node/69cbce3d2a64fa9aff937e00 HTTP/1.0" 202 Accepted 2026-04-02 13:38:23,244 - lava_callback - INFO - Starting async job submit for node 69cbce3d2a64fa9aff937e00 2026-04-02 13:38:23,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:38:23,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbce3d2a64fa9aff937e00 HTTP/1.1" 200 None 2026-04-02 13:38:23,261 - lava_callback - DEBUG - Processing node 69cbce3d2a64fa9aff937e00: baseline-arm64-clabbe 2026-04-02 13:38:23,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbce3d2a64fa9aff937e00 2026-04-02 13:38:23,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:38:23,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbce3d2a64fa9aff937e00 HTTP/1.1" 200 None 2026-04-02 13:38:23,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:38:23,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:38:23,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:38:23,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbce3d2a64fa9aff937e00 HTTP/1.1" 200 None 2026-04-02 13:38:23,313 - lava_callback - ERROR - Error processing callback for node 69cbce3d2a64fa9aff937e00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:39:43,266 - lava_callback - INFO - Received callback for node 69cbce892a64fa9aff937e0a INFO: 172.21.0.1:36894 - "POST /node/69cbce892a64fa9aff937e0a HTTP/1.0" 202 Accepted 2026-04-02 13:39:43,271 - lava_callback - INFO - Starting async job submit for node 69cbce892a64fa9aff937e0a 2026-04-02 13:39:43,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:39:43,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbce892a64fa9aff937e0a HTTP/1.1" 200 None 2026-04-02 13:39:43,287 - lava_callback - DEBUG - Processing node 69cbce892a64fa9aff937e0a: baseline-arm64-clabbe 2026-04-02 13:39:43,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbce892a64fa9aff937e0a 2026-04-02 13:39:43,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:39:43,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbce892a64fa9aff937e0a HTTP/1.1" 200 None 2026-04-02 13:39:43,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:39:43,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:39:43,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:39:43,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbce892a64fa9aff937e0a HTTP/1.1" 200 None 2026-04-02 13:39:43,350 - lava_callback - ERROR - Error processing callback for node 69cbce892a64fa9aff937e0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41732 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:40:43,294 - lava_callback - INFO - Received callback for node 69cbced62a64fa9aff937e18 INFO: 172.21.0.1:56388 - "POST /node/69cbced62a64fa9aff937e18 HTTP/1.0" 202 Accepted 2026-04-02 13:40:43,299 - lava_callback - INFO - Starting async job submit for node 69cbced62a64fa9aff937e18 2026-04-02 13:40:43,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:40:43,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbced62a64fa9aff937e18 HTTP/1.1" 200 None 2026-04-02 13:40:43,316 - lava_callback - DEBUG - Processing node 69cbced62a64fa9aff937e18: baseline-arm64-clabbe 2026-04-02 13:40:43,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbced62a64fa9aff937e18 2026-04-02 13:40:43,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:40:43,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbced62a64fa9aff937e18 HTTP/1.1" 200 None 2026-04-02 13:40:43,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:40:43,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:40:43,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:40:43,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbced62a64fa9aff937e18 HTTP/1.1" 200 None 2026-04-02 13:40:43,368 - lava_callback - ERROR - Error processing callback for node 69cbced62a64fa9aff937e18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:42:23,391 - lava_callback - INFO - Received callback for node 69cbcf2e2a64fa9aff937e24 INFO: 172.21.0.1:43838 - "POST /node/69cbcf2e2a64fa9aff937e24 HTTP/1.0" 202 Accepted 2026-04-02 13:42:23,397 - lava_callback - INFO - Starting async job submit for node 69cbcf2e2a64fa9aff937e24 2026-04-02 13:42:23,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:42:23,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcf2e2a64fa9aff937e24 HTTP/1.1" 200 None 2026-04-02 13:42:23,413 - lava_callback - DEBUG - Processing node 69cbcf2e2a64fa9aff937e24: baseline-arm64-clabbe 2026-04-02 13:42:23,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbcf2e2a64fa9aff937e24 2026-04-02 13:42:23,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:42:23,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcf2e2a64fa9aff937e24 HTTP/1.1" 200 None 2026-04-02 13:42:23,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:42:23,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:42:23,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:42:23,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbcf2e2a64fa9aff937e24 HTTP/1.1" 200 None 2026-04-02 13:42:23,470 - lava_callback - ERROR - Error processing callback for node 69cbcf2e2a64fa9aff937e24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:43:43,423 - lava_callback - INFO - Received callback for node 69cbcf7b2a64fa9aff937e31 INFO: 172.21.0.1:45692 - "POST /node/69cbcf7b2a64fa9aff937e31 HTTP/1.0" 202 Accepted 2026-04-02 13:43:43,428 - lava_callback - INFO - Starting async job submit for node 69cbcf7b2a64fa9aff937e31 2026-04-02 13:43:43,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:43:43,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcf7b2a64fa9aff937e31 HTTP/1.1" 200 None 2026-04-02 13:43:43,444 - lava_callback - DEBUG - Processing node 69cbcf7b2a64fa9aff937e31: baseline-arm64-clabbe 2026-04-02 13:43:43,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbcf7b2a64fa9aff937e31 2026-04-02 13:43:43,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:43:43,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcf7b2a64fa9aff937e31 HTTP/1.1" 200 None 2026-04-02 13:43:43,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:43:43,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:43:43,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:43:43,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbcf7b2a64fa9aff937e31 HTTP/1.1" 200 None 2026-04-02 13:43:43,496 - lava_callback - ERROR - Error processing callback for node 69cbcf7b2a64fa9aff937e31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:49:18,436 - lava_callback - INFO - Received callback for node 69cbd0cb2a64fa9aff937e45 INFO: 172.21.0.1:54094 - "POST /node/69cbd0cb2a64fa9aff937e45 HTTP/1.0" 202 Accepted 2026-04-02 13:49:18,441 - lava_callback - INFO - Starting async job submit for node 69cbd0cb2a64fa9aff937e45 2026-04-02 13:49:18,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:49:18,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd0cb2a64fa9aff937e45 HTTP/1.1" 200 None 2026-04-02 13:49:18,457 - lava_callback - DEBUG - Processing node 69cbd0cb2a64fa9aff937e45: baseline-arm64-baylibre 2026-04-02 13:49:18,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd0cb2a64fa9aff937e45 2026-04-02 13:49:18,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:49:18,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd0cb2a64fa9aff937e45 HTTP/1.1" 200 None 2026-04-02 13:49:18,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:49:18,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:49:18,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:49:18,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd0cb2a64fa9aff937e45 HTTP/1.1" 200 None 2026-04-02 13:49:18,514 - lava_callback - ERROR - Error processing callback for node 69cbd0cb2a64fa9aff937e45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50724 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:51:03,745 - lava_callback - INFO - Received callback for node 69cbd1322a64fa9aff937e4e INFO: 172.21.0.1:59088 - "POST /node/69cbd1322a64fa9aff937e4e HTTP/1.0" 202 Accepted 2026-04-02 13:51:03,750 - lava_callback - INFO - Starting async job submit for node 69cbd1322a64fa9aff937e4e 2026-04-02 13:51:03,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:51:03,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1322a64fa9aff937e4e HTTP/1.1" 200 None 2026-04-02 13:51:03,766 - lava_callback - DEBUG - Processing node 69cbd1322a64fa9aff937e4e: baseline-arm64-clabbe 2026-04-02 13:51:03,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd1322a64fa9aff937e4e 2026-04-02 13:51:03,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:51:03,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1322a64fa9aff937e4e HTTP/1.1" 200 None 2026-04-02 13:51:03,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:51:03,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:51:03,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:51:03,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd1322a64fa9aff937e4e HTTP/1.1" 200 None 2026-04-02 13:51:03,821 - lava_callback - ERROR - Error processing callback for node 69cbd1322a64fa9aff937e4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:52:43,764 - lava_callback - INFO - Received callback for node 69cbd1962a64fa9aff937e5b INFO: 172.21.0.1:42916 - "POST /node/69cbd1962a64fa9aff937e5b HTTP/1.0" 202 Accepted 2026-04-02 13:52:43,770 - lava_callback - INFO - Starting async job submit for node 69cbd1962a64fa9aff937e5b 2026-04-02 13:52:43,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:52:43,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1962a64fa9aff937e5b HTTP/1.1" 200 None 2026-04-02 13:52:43,785 - lava_callback - DEBUG - Processing node 69cbd1962a64fa9aff937e5b: baseline-arm64-clabbe 2026-04-02 13:52:43,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd1962a64fa9aff937e5b 2026-04-02 13:52:43,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:52:43,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1962a64fa9aff937e5b HTTP/1.1" 200 None 2026-04-02 13:52:43,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:52:43,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:52:43,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:52:43,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd1962a64fa9aff937e5b HTTP/1.1" 200 None 2026-04-02 13:52:43,848 - lava_callback - ERROR - Error processing callback for node 69cbd1962a64fa9aff937e5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:54:03,824 - lava_callback - INFO - Received callback for node 69cbd1e62a64fa9aff937e68 INFO: 172.21.0.1:56526 - "POST /node/69cbd1e62a64fa9aff937e68 HTTP/1.0" 202 Accepted 2026-04-02 13:54:03,830 - lava_callback - INFO - Starting async job submit for node 69cbd1e62a64fa9aff937e68 2026-04-02 13:54:03,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:54:03,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1e62a64fa9aff937e68 HTTP/1.1" 200 None 2026-04-02 13:54:03,845 - lava_callback - DEBUG - Processing node 69cbd1e62a64fa9aff937e68: baseline-arm64-clabbe 2026-04-02 13:54:03,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd1e62a64fa9aff937e68 2026-04-02 13:54:03,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:54:03,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1e62a64fa9aff937e68 HTTP/1.1" 200 None 2026-04-02 13:54:03,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:54:03,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:54:03,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:54:03,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd1e62a64fa9aff937e68 HTTP/1.1" 200 None 2026-04-02 13:54:03,909 - lava_callback - ERROR - Error processing callback for node 69cbd1e62a64fa9aff937e68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:55:23,926 - lava_callback - INFO - Received callback for node 69cbd2352a64fa9aff937e76 INFO: 172.21.0.1:49220 - "POST /node/69cbd2352a64fa9aff937e76 HTTP/1.0" 202 Accepted 2026-04-02 13:55:23,932 - lava_callback - INFO - Starting async job submit for node 69cbd2352a64fa9aff937e76 2026-04-02 13:55:23,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:55:23,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd2352a64fa9aff937e76 HTTP/1.1" 200 None 2026-04-02 13:55:23,948 - lava_callback - DEBUG - Processing node 69cbd2352a64fa9aff937e76: baseline-arm64-clabbe 2026-04-02 13:55:23,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd2352a64fa9aff937e76 2026-04-02 13:55:23,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:55:23,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd2352a64fa9aff937e76 HTTP/1.1" 200 None 2026-04-02 13:55:23,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:55:23,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:55:23,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:55:24,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd2352a64fa9aff937e76 HTTP/1.1" 200 None 2026-04-02 13:55:24,018 - lava_callback - ERROR - Error processing callback for node 69cbd2352a64fa9aff937e76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:57:43,991 - lava_callback - INFO - Received callback for node 69cbd2c22a64fa9aff937e81 INFO: 172.21.0.1:39734 - "POST /node/69cbd2c22a64fa9aff937e81 HTTP/1.0" 202 Accepted 2026-04-02 13:57:43,997 - lava_callback - INFO - Starting async job submit for node 69cbd2c22a64fa9aff937e81 2026-04-02 13:57:43,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:57:44,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd2c22a64fa9aff937e81 HTTP/1.1" 200 None 2026-04-02 13:57:44,021 - lava_callback - DEBUG - Processing node 69cbd2c22a64fa9aff937e81: baseline-arm64-clabbe 2026-04-02 13:57:44,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd2c22a64fa9aff937e81 2026-04-02 13:57:44,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:57:44,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd2c22a64fa9aff937e81 HTTP/1.1" 200 None 2026-04-02 13:57:44,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:57:44,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:57:44,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:57:44,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd2c22a64fa9aff937e81 HTTP/1.1" 200 None 2026-04-02 13:57:44,077 - lava_callback - ERROR - Error processing callback for node 69cbd2c22a64fa9aff937e81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:59:04,059 - lava_callback - INFO - Received callback for node 69cbd3122a64fa9aff937e8e INFO: 172.21.0.1:58858 - "POST /node/69cbd3122a64fa9aff937e8e HTTP/1.0" 202 Accepted 2026-04-02 13:59:04,064 - lava_callback - INFO - Starting async job submit for node 69cbd3122a64fa9aff937e8e 2026-04-02 13:59:04,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:59:04,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd3122a64fa9aff937e8e HTTP/1.1" 200 None 2026-04-02 13:59:04,083 - lava_callback - DEBUG - Processing node 69cbd3122a64fa9aff937e8e: baseline-arm64-clabbe 2026-04-02 13:59:04,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd3122a64fa9aff937e8e 2026-04-02 13:59:04,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:59:04,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd3122a64fa9aff937e8e HTTP/1.1" 200 None 2026-04-02 13:59:04,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:59:04,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:59:04,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:59:04,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd3122a64fa9aff937e8e HTTP/1.1" 200 None 2026-04-02 13:59:04,143 - lava_callback - ERROR - Error processing callback for node 69cbd3122a64fa9aff937e8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37608 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:12:19,653 - lava_callback - INFO - Received callback for node 69cbd6332a64fa9aff937eb3 INFO: 172.21.0.1:37624 - "POST /node/69cbd6332a64fa9aff937eb3 HTTP/1.0" 202 Accepted 2026-04-02 14:12:19,658 - lava_callback - INFO - Starting async job submit for node 69cbd6332a64fa9aff937eb3 2026-04-02 14:12:19,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:12:19,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6332a64fa9aff937eb3 HTTP/1.1" 200 None 2026-04-02 14:12:19,675 - lava_callback - DEBUG - Processing node 69cbd6332a64fa9aff937eb3: baseline-arm64-baylibre 2026-04-02 14:12:19,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd6332a64fa9aff937eb3 2026-04-02 14:12:19,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:12:19,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6332a64fa9aff937eb3 HTTP/1.1" 200 None 2026-04-02 14:12:19,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:12:19,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 14:12:19,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:12:19,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd6332a64fa9aff937eb3 HTTP/1.1" 200 None 2026-04-02 14:12:19,726 - lava_callback - ERROR - Error processing callback for node 69cbd6332a64fa9aff937eb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39458 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:13:44,690 - lava_callback - INFO - Received callback for node 69cbd6852a64fa9aff937ebf INFO: 172.21.0.1:37912 - "POST /node/69cbd6852a64fa9aff937ebf HTTP/1.0" 202 Accepted 2026-04-02 14:13:44,696 - lava_callback - INFO - Starting async job submit for node 69cbd6852a64fa9aff937ebf 2026-04-02 14:13:44,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:13:44,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6852a64fa9aff937ebf HTTP/1.1" 200 None 2026-04-02 14:13:44,712 - lava_callback - DEBUG - Processing node 69cbd6852a64fa9aff937ebf: baseline-arm64-clabbe 2026-04-02 14:13:44,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd6852a64fa9aff937ebf 2026-04-02 14:13:44,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:13:44,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6852a64fa9aff937ebf HTTP/1.1" 200 None 2026-04-02 14:13:44,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:13:44,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 14:13:44,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:13:44,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd6852a64fa9aff937ebf HTTP/1.1" 200 None 2026-04-02 14:13:44,778 - lava_callback - ERROR - Error processing callback for node 69cbd6852a64fa9aff937ebf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:15:04,775 - lava_callback - INFO - Received callback for node 69cbd6d22a64fa9aff937ec8 INFO: 172.21.0.1:43058 - "POST /node/69cbd6d22a64fa9aff937ec8 HTTP/1.0" 202 Accepted 2026-04-02 14:15:04,781 - lava_callback - INFO - Starting async job submit for node 69cbd6d22a64fa9aff937ec8 2026-04-02 14:15:04,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:15:04,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6d22a64fa9aff937ec8 HTTP/1.1" 200 None 2026-04-02 14:15:04,796 - lava_callback - DEBUG - Processing node 69cbd6d22a64fa9aff937ec8: baseline-arm64-clabbe 2026-04-02 14:15:04,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd6d22a64fa9aff937ec8 2026-04-02 14:15:04,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:15:04,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6d22a64fa9aff937ec8 HTTP/1.1" 200 None 2026-04-02 14:15:04,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:15:04,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 14:15:04,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:15:04,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd6d22a64fa9aff937ec8 HTTP/1.1" 200 None 2026-04-02 14:15:04,854 - lava_callback - ERROR - Error processing callback for node 69cbd6d22a64fa9aff937ec8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET /node/698f5ee73013abef95cf9749%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39356 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:38:01,116 - lava_callback - INFO - Received callback for node 69cbdc412a64fa9aff937f04 INFO: 172.21.0.1:35702 - "POST /node/69cbdc412a64fa9aff937f04 HTTP/1.0" 202 Accepted 2026-04-02 14:38:01,121 - lava_callback - INFO - Starting async job submit for node 69cbdc412a64fa9aff937f04 2026-04-02 14:38:01,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:38:01,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdc412a64fa9aff937f04 HTTP/1.1" 200 None 2026-04-02 14:38:01,138 - lava_callback - DEBUG - Processing node 69cbdc412a64fa9aff937f04: baseline-arm-baylibre 2026-04-02 14:38:01,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdc412a64fa9aff937f04 2026-04-02 14:38:01,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:38:01,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdc412a64fa9aff937f04 HTTP/1.1" 200 None 2026-04-02 14:38:01,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:38:01,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:38:01,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:38:01,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdc412a64fa9aff937f04 HTTP/1.1" 200 None 2026-04-02 14:38:01,204 - lava_callback - ERROR - Error processing callback for node 69cbdc412a64fa9aff937f04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36402 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:40:01,222 - lava_callback - INFO - Received callback for node 69cbdcb62a64fa9aff937f3b INFO: 172.21.0.1:42288 - "POST /node/69cbdcb62a64fa9aff937f3b HTTP/1.0" 202 Accepted 2026-04-02 14:40:01,228 - lava_callback - INFO - Starting async job submit for node 69cbdcb62a64fa9aff937f3b 2026-04-02 14:40:01,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:01,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdcb62a64fa9aff937f3b HTTP/1.1" 200 None 2026-04-02 14:40:01,244 - lava_callback - DEBUG - Processing node 69cbdcb62a64fa9aff937f3b: baseline-arm-baylibre 2026-04-02 14:40:01,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdcb62a64fa9aff937f3b 2026-04-02 14:40:01,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:01,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdcb62a64fa9aff937f3b HTTP/1.1" 200 None 2026-04-02 14:40:01,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:01,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:40:01,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:01,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdcb62a64fa9aff937f3b HTTP/1.1" 200 None 2026-04-02 14:40:01,300 - lava_callback - ERROR - Error processing callback for node 69cbdcb62a64fa9aff937f3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39012 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:40:41,142 - lava_callback - INFO - Received callback for node 69cbdcdc2a64fa9aff937f48 INFO: 172.21.0.1:41246 - "POST /node/69cbdcdc2a64fa9aff937f48 HTTP/1.0" 202 Accepted 2026-04-02 14:40:41,148 - lava_callback - INFO - Starting async job submit for node 69cbdcdc2a64fa9aff937f48 2026-04-02 14:40:41,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:41,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdcdc2a64fa9aff937f48 HTTP/1.1" 200 None 2026-04-02 14:40:41,164 - lava_callback - DEBUG - Processing node 69cbdcdc2a64fa9aff937f48: baseline-arm-baylibre 2026-04-02 14:40:41,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdcdc2a64fa9aff937f48 2026-04-02 14:40:41,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:41,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdcdc2a64fa9aff937f48 HTTP/1.1" 200 None 2026-04-02 14:40:41,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:41,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:40:41,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:41,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdcdc2a64fa9aff937f48 HTTP/1.1" 200 None 2026-04-02 14:40:41,273 - lava_callback - ERROR - Error processing callback for node 69cbdcdc2a64fa9aff937f48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:41:21,237 - lava_callback - INFO - Received callback for node 69cbdd012a64fa9aff937f57 INFO: 172.21.0.1:47434 - "POST /node/69cbdd012a64fa9aff937f57 HTTP/1.0" 202 Accepted 2026-04-02 14:41:21,243 - lava_callback - INFO - Starting async job submit for node 69cbdd012a64fa9aff937f57 2026-04-02 14:41:21,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:41:21,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd012a64fa9aff937f57 HTTP/1.1" 200 None 2026-04-02 14:41:21,274 - lava_callback - DEBUG - Processing node 69cbdd012a64fa9aff937f57: baseline-arm-baylibre 2026-04-02 14:41:21,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdd012a64fa9aff937f57 2026-04-02 14:41:21,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:41:21,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd012a64fa9aff937f57 HTTP/1.1" 200 None 2026-04-02 14:41:21,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:41:21,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:41:21,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:41:21,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdd012a64fa9aff937f57 HTTP/1.1" 200 None 2026-04-02 14:41:21,326 - lava_callback - ERROR - Error processing callback for node 69cbdd012a64fa9aff937f57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:42:01,221 - lava_callback - INFO - Received callback for node 69cbdd292a64fa9aff937f62 INFO: 172.21.0.1:56346 - "POST /node/69cbdd292a64fa9aff937f62 HTTP/1.0" 202 Accepted 2026-04-02 14:42:01,226 - lava_callback - INFO - Starting async job submit for node 69cbdd292a64fa9aff937f62 2026-04-02 14:42:01,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:01,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd292a64fa9aff937f62 HTTP/1.1" 200 None 2026-04-02 14:42:01,254 - lava_callback - DEBUG - Processing node 69cbdd292a64fa9aff937f62: baseline-arm-baylibre 2026-04-02 14:42:01,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdd292a64fa9aff937f62 2026-04-02 14:42:01,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:01,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd292a64fa9aff937f62 HTTP/1.1" 200 None 2026-04-02 14:42:01,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:01,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:42:01,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:01,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdd292a64fa9aff937f62 HTTP/1.1" 200 None 2026-04-02 14:42:01,328 - lava_callback - ERROR - Error processing callback for node 69cbdd292a64fa9aff937f62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:42:41,282 - lava_callback - INFO - Received callback for node 69cbdd512a64fa9aff937f70 INFO: 172.21.0.1:42158 - "POST /node/69cbdd512a64fa9aff937f70 HTTP/1.0" 202 Accepted 2026-04-02 14:42:41,288 - lava_callback - INFO - Starting async job submit for node 69cbdd512a64fa9aff937f70 2026-04-02 14:42:41,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:41,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd512a64fa9aff937f70 HTTP/1.1" 200 None 2026-04-02 14:42:41,304 - lava_callback - DEBUG - Processing node 69cbdd512a64fa9aff937f70: baseline-arm-baylibre 2026-04-02 14:42:41,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdd512a64fa9aff937f70 2026-04-02 14:42:41,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:41,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd512a64fa9aff937f70 HTTP/1.1" 200 None 2026-04-02 14:42:41,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:41,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:42:41,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:41,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdd512a64fa9aff937f70 HTTP/1.1" 200 None 2026-04-02 14:42:41,359 - lava_callback - ERROR - Error processing callback for node 69cbdd512a64fa9aff937f70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:43:21,319 - lava_callback - INFO - Received callback for node 69cbdd782a64fa9aff937f80 INFO: 172.21.0.1:38998 - "POST /node/69cbdd782a64fa9aff937f80 HTTP/1.0" 202 Accepted 2026-04-02 14:43:21,325 - lava_callback - INFO - Starting async job submit for node 69cbdd782a64fa9aff937f80 2026-04-02 14:43:21,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:43:21,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd782a64fa9aff937f80 HTTP/1.1" 200 None 2026-04-02 14:43:21,341 - lava_callback - DEBUG - Processing node 69cbdd782a64fa9aff937f80: baseline-arm-baylibre 2026-04-02 14:43:21,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdd782a64fa9aff937f80 2026-04-02 14:43:21,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:43:21,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd782a64fa9aff937f80 HTTP/1.1" 200 None 2026-04-02 14:43:21,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:43:21,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:43:21,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:43:21,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdd782a64fa9aff937f80 HTTP/1.1" 200 None 2026-04-02 14:43:21,396 - lava_callback - ERROR - Error processing callback for node 69cbdd782a64fa9aff937f80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45020 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:45:26,101 - lava_callback - INFO - Received callback for node 69cbddf12a64fa9aff937fac INFO: 172.21.0.1:53878 - "POST /node/69cbddf12a64fa9aff937fac HTTP/1.0" 202 Accepted 2026-04-02 14:45:26,107 - lava_callback - INFO - Starting async job submit for node 69cbddf12a64fa9aff937fac 2026-04-02 14:45:26,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:45:26,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbddf12a64fa9aff937fac HTTP/1.1" 200 None 2026-04-02 14:45:26,123 - lava_callback - DEBUG - Processing node 69cbddf12a64fa9aff937fac: baseline-arm-clabbe 2026-04-02 14:45:26,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbddf12a64fa9aff937fac 2026-04-02 14:45:26,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:45:26,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbddf12a64fa9aff937fac HTTP/1.1" 200 None 2026-04-02 14:45:26,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:45:26,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:45:26,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:45:26,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbddf12a64fa9aff937fac HTTP/1.1" 200 None 2026-04-02 14:45:26,194 - lava_callback - ERROR - Error processing callback for node 69cbddf12a64fa9aff937fac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:46:06,049 - lava_callback - INFO - Received callback for node 69cbde1b2a64fa9aff937fb9 INFO: 172.21.0.1:35266 - "POST /node/69cbde1b2a64fa9aff937fb9 HTTP/1.0" 202 Accepted 2026-04-02 14:46:06,054 - lava_callback - INFO - Starting async job submit for node 69cbde1b2a64fa9aff937fb9 2026-04-02 14:46:06,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:06,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde1b2a64fa9aff937fb9 HTTP/1.1" 200 None 2026-04-02 14:46:06,070 - lava_callback - DEBUG - Processing node 69cbde1b2a64fa9aff937fb9: baseline-arm-clabbe 2026-04-02 14:46:06,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbde1b2a64fa9aff937fb9 2026-04-02 14:46:06,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:06,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde1b2a64fa9aff937fb9 HTTP/1.1" 200 None 2026-04-02 14:46:06,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:06,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:46:06,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:06,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbde1b2a64fa9aff937fb9 HTTP/1.1" 200 None 2026-04-02 14:46:06,121 - lava_callback - ERROR - Error processing callback for node 69cbde1b2a64fa9aff937fb9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:46:46,128 - lava_callback - INFO - Received callback for node 69cbde432a64fa9aff937fcc INFO: 172.21.0.1:56336 - "POST /node/69cbde432a64fa9aff937fcc HTTP/1.0" 202 Accepted 2026-04-02 14:46:46,133 - lava_callback - INFO - Starting async job submit for node 69cbde432a64fa9aff937fcc 2026-04-02 14:46:46,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:46,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde432a64fa9aff937fcc HTTP/1.1" 200 None 2026-04-02 14:46:46,149 - lava_callback - DEBUG - Processing node 69cbde432a64fa9aff937fcc: baseline-arm-clabbe 2026-04-02 14:46:46,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbde432a64fa9aff937fcc 2026-04-02 14:46:46,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:46,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde432a64fa9aff937fcc HTTP/1.1" 200 None 2026-04-02 14:46:46,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:46,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:46:46,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:46,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbde432a64fa9aff937fcc HTTP/1.1" 200 None 2026-04-02 14:46:46,202 - lava_callback - ERROR - Error processing callback for node 69cbde432a64fa9aff937fcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50314 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:47:26,253 - lava_callback - INFO - Received callback for node 69cbde6a2a64fa9aff937fd6 INFO: 172.21.0.1:53406 - "POST /node/69cbde6a2a64fa9aff937fd6 HTTP/1.0" 202 Accepted 2026-04-02 14:47:26,258 - lava_callback - INFO - Starting async job submit for node 69cbde6a2a64fa9aff937fd6 2026-04-02 14:47:26,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:47:26,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde6a2a64fa9aff937fd6 HTTP/1.1" 200 None 2026-04-02 14:47:26,274 - lava_callback - DEBUG - Processing node 69cbde6a2a64fa9aff937fd6: baseline-arm-clabbe 2026-04-02 14:47:26,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbde6a2a64fa9aff937fd6 2026-04-02 14:47:26,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:47:26,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde6a2a64fa9aff937fd6 HTTP/1.1" 200 None 2026-04-02 14:47:26,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:47:26,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:47:26,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:47:26,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbde6a2a64fa9aff937fd6 HTTP/1.1" 200 None 2026-04-02 14:47:26,331 - lava_callback - ERROR - Error processing callback for node 69cbde6a2a64fa9aff937fd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:48:06,202 - lava_callback - INFO - Received callback for node 69cbde912a64fa9aff937fe3 INFO: 172.21.0.1:50542 - "POST /node/69cbde912a64fa9aff937fe3 HTTP/1.0" 202 Accepted 2026-04-02 14:48:06,208 - lava_callback - INFO - Starting async job submit for node 69cbde912a64fa9aff937fe3 2026-04-02 14:48:06,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:06,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde912a64fa9aff937fe3 HTTP/1.1" 200 None 2026-04-02 14:48:06,224 - lava_callback - DEBUG - Processing node 69cbde912a64fa9aff937fe3: baseline-arm-clabbe 2026-04-02 14:48:06,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbde912a64fa9aff937fe3 2026-04-02 14:48:06,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:06,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde912a64fa9aff937fe3 HTTP/1.1" 200 None 2026-04-02 14:48:06,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:06,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:48:06,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:06,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbde912a64fa9aff937fe3 HTTP/1.1" 200 None 2026-04-02 14:48:06,291 - lava_callback - ERROR - Error processing callback for node 69cbde912a64fa9aff937fe3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:48:21,557 - lava_callback - INFO - Received callback for node 69cbdeb12a64fa9aff937fef INFO: 172.21.0.1:41426 - "POST /node/69cbdeb12a64fa9aff937fef HTTP/1.0" 202 Accepted 2026-04-02 14:48:21,563 - lava_callback - INFO - Starting async job submit for node 69cbdeb12a64fa9aff937fef 2026-04-02 14:48:21,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:21,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdeb12a64fa9aff937fef HTTP/1.1" 200 None 2026-04-02 14:48:21,578 - lava_callback - DEBUG - Processing node 69cbdeb12a64fa9aff937fef: baseline-arm-baylibre 2026-04-02 14:48:21,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdeb12a64fa9aff937fef 2026-04-02 14:48:21,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:21,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdeb12a64fa9aff937fef HTTP/1.1" 200 None 2026-04-02 14:48:21,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:21,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:48:21,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:21,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdeb12a64fa9aff937fef HTTP/1.1" 200 None 2026-04-02 14:48:21,656 - lava_callback - ERROR - Error processing callback for node 69cbdeb12a64fa9aff937fef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:49:01,613 - lava_callback - INFO - Received callback for node 69cbded82a64fa9aff937ffa INFO: 172.21.0.1:55828 - "POST /node/69cbded82a64fa9aff937ffa HTTP/1.0" 202 Accepted 2026-04-02 14:49:01,619 - lava_callback - INFO - Starting async job submit for node 69cbded82a64fa9aff937ffa 2026-04-02 14:49:01,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:01,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbded82a64fa9aff937ffa HTTP/1.1" 200 None 2026-04-02 14:49:01,635 - lava_callback - DEBUG - Processing node 69cbded82a64fa9aff937ffa: baseline-arm-baylibre 2026-04-02 14:49:01,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbded82a64fa9aff937ffa 2026-04-02 14:49:01,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:01,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbded82a64fa9aff937ffa HTTP/1.1" 200 None 2026-04-02 14:49:01,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:01,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:49:01,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:01,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbded82a64fa9aff937ffa HTTP/1.1" 200 None 2026-04-02 14:49:01,699 - lava_callback - ERROR - Error processing callback for node 69cbded82a64fa9aff937ffa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35708 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:49:41,773 - lava_callback - INFO - Received callback for node 69cbdefe2a64fa9aff938005 INFO: 172.21.0.1:54332 - "POST /node/69cbdefe2a64fa9aff938005 HTTP/1.0" 202 Accepted 2026-04-02 14:49:41,778 - lava_callback - INFO - Starting async job submit for node 69cbdefe2a64fa9aff938005 2026-04-02 14:49:41,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:41,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdefe2a64fa9aff938005 HTTP/1.1" 200 None 2026-04-02 14:49:41,794 - lava_callback - DEBUG - Processing node 69cbdefe2a64fa9aff938005: baseline-arm-baylibre 2026-04-02 14:49:41,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdefe2a64fa9aff938005 2026-04-02 14:49:41,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:41,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdefe2a64fa9aff938005 HTTP/1.1" 200 None 2026-04-02 14:49:41,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:41,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:49:41,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:41,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdefe2a64fa9aff938005 HTTP/1.1" 200 None 2026-04-02 14:49:41,858 - lava_callback - ERROR - Error processing callback for node 69cbdefe2a64fa9aff938005: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:50:21,623 - lava_callback - INFO - Received callback for node 69cbdf252a64fa9aff938012 INFO: 172.21.0.1:33672 - "POST /node/69cbdf252a64fa9aff938012 HTTP/1.0" 202 Accepted 2026-04-02 14:50:21,628 - lava_callback - INFO - Starting async job submit for node 69cbdf252a64fa9aff938012 2026-04-02 14:50:21,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:50:21,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf252a64fa9aff938012 HTTP/1.1" 200 None 2026-04-02 14:50:21,644 - lava_callback - DEBUG - Processing node 69cbdf252a64fa9aff938012: baseline-arm-baylibre 2026-04-02 14:50:21,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdf252a64fa9aff938012 2026-04-02 14:50:21,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:50:21,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf252a64fa9aff938012 HTTP/1.1" 200 None 2026-04-02 14:50:21,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:50:21,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:50:21,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:50:21,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdf252a64fa9aff938012 HTTP/1.1" 200 None 2026-04-02 14:50:21,694 - lava_callback - ERROR - Error processing callback for node 69cbdf252a64fa9aff938012: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:51:01,848 - lava_callback - INFO - Received callback for node 69cbdf4c2a64fa9aff938020 INFO: 172.21.0.1:57960 - "POST /node/69cbdf4c2a64fa9aff938020 HTTP/1.0" 202 Accepted 2026-04-02 14:51:01,854 - lava_callback - INFO - Starting async job submit for node 69cbdf4c2a64fa9aff938020 2026-04-02 14:51:01,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:01,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf4c2a64fa9aff938020 HTTP/1.1" 200 None 2026-04-02 14:51:01,870 - lava_callback - DEBUG - Processing node 69cbdf4c2a64fa9aff938020: baseline-arm-baylibre 2026-04-02 14:51:01,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdf4c2a64fa9aff938020 2026-04-02 14:51:01,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:01,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf4c2a64fa9aff938020 HTTP/1.1" 200 None 2026-04-02 14:51:01,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:01,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:51:01,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:01,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdf4c2a64fa9aff938020 HTTP/1.1" 200 None 2026-04-02 14:51:01,928 - lava_callback - ERROR - Error processing callback for node 69cbdf4c2a64fa9aff938020: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:51:41,692 - lava_callback - INFO - Received callback for node 69cbdf712a64fa9aff93802c INFO: 172.21.0.1:54496 - "POST /node/69cbdf712a64fa9aff93802c HTTP/1.0" 202 Accepted 2026-04-02 14:51:41,697 - lava_callback - INFO - Starting async job submit for node 69cbdf712a64fa9aff93802c 2026-04-02 14:51:41,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:41,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf712a64fa9aff93802c HTTP/1.1" 200 None 2026-04-02 14:51:41,714 - lava_callback - DEBUG - Processing node 69cbdf712a64fa9aff93802c: baseline-arm-baylibre 2026-04-02 14:51:41,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdf712a64fa9aff93802c 2026-04-02 14:51:41,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:41,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf712a64fa9aff93802c HTTP/1.1" 200 None 2026-04-02 14:51:41,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:41,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:51:41,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:41,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdf712a64fa9aff93802c HTTP/1.1" 200 None 2026-04-02 14:51:41,772 - lava_callback - ERROR - Error processing callback for node 69cbdf712a64fa9aff93802c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37682 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:52:21,801 - lava_callback - INFO - Received callback for node 69cbdf982a64fa9aff938039 INFO: 172.21.0.1:55882 - "POST /node/69cbdf982a64fa9aff938039 HTTP/1.0" 202 Accepted 2026-04-02 14:52:21,807 - lava_callback - INFO - Starting async job submit for node 69cbdf982a64fa9aff938039 2026-04-02 14:52:21,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:52:21,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf982a64fa9aff938039 HTTP/1.1" 200 None 2026-04-02 14:52:21,823 - lava_callback - DEBUG - Processing node 69cbdf982a64fa9aff938039: baseline-arm-baylibre 2026-04-02 14:52:21,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdf982a64fa9aff938039 2026-04-02 14:52:21,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:52:21,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf982a64fa9aff938039 HTTP/1.1" 200 None 2026-04-02 14:52:21,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:52:21,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:52:21,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:52:21,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdf982a64fa9aff938039 HTTP/1.1" 200 None 2026-04-02 14:52:21,884 - lava_callback - ERROR - Error processing callback for node 69cbdf982a64fa9aff938039: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:53:06,477 - lava_callback - INFO - Received callback for node 69cbdfbf2a64fa9aff938046 INFO: 172.21.0.1:47528 - "POST /node/69cbdfbf2a64fa9aff938046 HTTP/1.0" 202 Accepted 2026-04-02 14:53:06,483 - lava_callback - INFO - Starting async job submit for node 69cbdfbf2a64fa9aff938046 2026-04-02 14:53:06,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:53:06,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdfbf2a64fa9aff938046 HTTP/1.1" 200 None 2026-04-02 14:53:06,500 - lava_callback - DEBUG - Processing node 69cbdfbf2a64fa9aff938046: baseline-arm-clabbe 2026-04-02 14:53:06,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdfbf2a64fa9aff938046 2026-04-02 14:53:06,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:53:06,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdfbf2a64fa9aff938046 HTTP/1.1" 200 None 2026-04-02 14:53:06,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:53:06,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:53:06,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:53:06,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdfbf2a64fa9aff938046 HTTP/1.1" 200 None 2026-04-02 14:53:06,574 - lava_callback - ERROR - Error processing callback for node 69cbdfbf2a64fa9aff938046: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:54:06,495 - lava_callback - INFO - Received callback for node 69cbe00a2a64fa9aff938061 INFO: 172.21.0.1:55814 - "POST /node/69cbe00a2a64fa9aff938061 HTTP/1.0" 202 Accepted 2026-04-02 14:54:06,500 - lava_callback - INFO - Starting async job submit for node 69cbe00a2a64fa9aff938061 2026-04-02 14:54:06,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:54:06,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe00a2a64fa9aff938061 HTTP/1.1" 200 None 2026-04-02 14:54:06,526 - lava_callback - DEBUG - Processing node 69cbe00a2a64fa9aff938061: baseline-arm-clabbe 2026-04-02 14:54:06,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe00a2a64fa9aff938061 2026-04-02 14:54:06,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:06,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe00a2a64fa9aff938061 HTTP/1.1" 200 None 2026-04-02 14:54:06,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:06,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:54:06,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:06,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe00a2a64fa9aff938061 HTTP/1.1" 200 None 2026-04-02 14:54:06,584 - lava_callback - ERROR - Error processing callback for node 69cbe00a2a64fa9aff938061: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:54:46,467 - lava_callback - INFO - Received callback for node 69cbe02f2a64fa9aff93806b INFO: 172.21.0.1:34836 - "POST /node/69cbe02f2a64fa9aff93806b HTTP/1.0" 202 Accepted 2026-04-02 14:54:46,473 - lava_callback - INFO - Starting async job submit for node 69cbe02f2a64fa9aff93806b 2026-04-02 14:54:46,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:46,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe02f2a64fa9aff93806b HTTP/1.1" 200 None 2026-04-02 14:54:46,490 - lava_callback - DEBUG - Processing node 69cbe02f2a64fa9aff93806b: baseline-arm-clabbe 2026-04-02 14:54:46,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe02f2a64fa9aff93806b 2026-04-02 14:54:46,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:46,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe02f2a64fa9aff93806b HTTP/1.1" 200 None 2026-04-02 14:54:46,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:54:46,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:54:46,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:46,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe02f2a64fa9aff93806b HTTP/1.1" 200 None 2026-04-02 14:54:46,556 - lava_callback - ERROR - Error processing callback for node 69cbe02f2a64fa9aff93806b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46020 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:55:41,964 - lava_callback - INFO - Received callback for node 69cbe0582a64fa9aff93807b INFO: 172.21.0.1:58732 - "POST /node/69cbe0582a64fa9aff93807b HTTP/1.0" 202 Accepted 2026-04-02 14:55:41,970 - lava_callback - INFO - Starting async job submit for node 69cbe0582a64fa9aff93807b 2026-04-02 14:55:41,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:55:41,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0582a64fa9aff93807b HTTP/1.1" 200 None 2026-04-02 14:55:41,989 - lava_callback - DEBUG - Processing node 69cbe0582a64fa9aff93807b: baseline-arm-baylibre 2026-04-02 14:55:41,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe0582a64fa9aff93807b 2026-04-02 14:55:41,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:55:42,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0582a64fa9aff93807b HTTP/1.1" 200 None 2026-04-02 14:55:42,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:55:42,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:55:42,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:55:42,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe0582a64fa9aff93807b HTTP/1.1" 200 None 2026-04-02 14:55:42,131 - lava_callback - ERROR - Error processing callback for node 69cbe0582a64fa9aff93807b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:56:06,543 - lava_callback - INFO - Received callback for node 69cbe0812a64fa9aff938099 INFO: 172.21.0.1:58852 - "POST /node/69cbe0812a64fa9aff938099 HTTP/1.0" 202 Accepted 2026-04-02 14:56:06,548 - lava_callback - INFO - Starting async job submit for node 69cbe0812a64fa9aff938099 2026-04-02 14:56:06,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:06,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0812a64fa9aff938099 HTTP/1.1" 200 None 2026-04-02 14:56:06,564 - lava_callback - DEBUG - Processing node 69cbe0812a64fa9aff938099: baseline-arm-clabbe 2026-04-02 14:56:06,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe0812a64fa9aff938099 2026-04-02 14:56:06,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:06,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0812a64fa9aff938099 HTTP/1.1" 200 None 2026-04-02 14:56:06,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:06,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:56:06,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:06,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe0812a64fa9aff938099 HTTP/1.1" 200 None 2026-04-02 14:56:06,617 - lava_callback - ERROR - Error processing callback for node 69cbe0812a64fa9aff938099: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:56:46,569 - lava_callback - INFO - Received callback for node 69cbe0a72a64fa9aff9380ad INFO: 172.21.0.1:33734 - "POST /node/69cbe0a72a64fa9aff9380ad HTTP/1.0" 202 Accepted 2026-04-02 14:56:46,575 - lava_callback - INFO - Starting async job submit for node 69cbe0a72a64fa9aff9380ad 2026-04-02 14:56:46,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:46,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0a72a64fa9aff9380ad HTTP/1.1" 200 None 2026-04-02 14:56:46,591 - lava_callback - DEBUG - Processing node 69cbe0a72a64fa9aff9380ad: baseline-arm-clabbe 2026-04-02 14:56:46,591 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe0a72a64fa9aff9380ad 2026-04-02 14:56:46,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:46,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0a72a64fa9aff9380ad HTTP/1.1" 200 None 2026-04-02 14:56:46,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:46,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:56:46,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:46,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe0a72a64fa9aff9380ad HTTP/1.1" 200 None 2026-04-02 14:56:46,645 - lava_callback - ERROR - Error processing callback for node 69cbe0a72a64fa9aff9380ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:57:26,637 - lava_callback - INFO - Received callback for node 69cbe0d02a64fa9aff9380cc INFO: 172.21.0.1:41402 - "POST /node/69cbe0d02a64fa9aff9380cc HTTP/1.0" 202 Accepted 2026-04-02 14:57:26,643 - lava_callback - INFO - Starting async job submit for node 69cbe0d02a64fa9aff9380cc 2026-04-02 14:57:26,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:57:26,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0d02a64fa9aff9380cc HTTP/1.1" 200 None 2026-04-02 14:57:26,662 - lava_callback - DEBUG - Processing node 69cbe0d02a64fa9aff9380cc: baseline-arm-clabbe 2026-04-02 14:57:26,662 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe0d02a64fa9aff9380cc 2026-04-02 14:57:26,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:57:26,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0d02a64fa9aff9380cc HTTP/1.1" 200 None 2026-04-02 14:57:26,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:57:26,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:57:26,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:57:26,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe0d02a64fa9aff9380cc HTTP/1.1" 200 None 2026-04-02 14:57:26,723 - lava_callback - ERROR - Error processing callback for node 69cbe0d02a64fa9aff9380cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:58:06,631 - lava_callback - INFO - Received callback for node 69cbe0f52a64fa9aff9380dc INFO: 172.21.0.1:53392 - "POST /node/69cbe0f52a64fa9aff9380dc HTTP/1.0" 202 Accepted 2026-04-02 14:58:06,636 - lava_callback - INFO - Starting async job submit for node 69cbe0f52a64fa9aff9380dc 2026-04-02 14:58:06,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:06,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0f52a64fa9aff9380dc HTTP/1.1" 200 None 2026-04-02 14:58:06,652 - lava_callback - DEBUG - Processing node 69cbe0f52a64fa9aff9380dc: baseline-arm-clabbe 2026-04-02 14:58:06,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe0f52a64fa9aff9380dc 2026-04-02 14:58:06,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:06,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0f52a64fa9aff9380dc HTTP/1.1" 200 None 2026-04-02 14:58:06,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:06,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:58:06,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:06,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe0f52a64fa9aff9380dc HTTP/1.1" 200 None 2026-04-02 14:58:06,705 - lava_callback - ERROR - Error processing callback for node 69cbe0f52a64fa9aff9380dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:58:46,690 - lava_callback - INFO - Received callback for node 69cbe11c2a64fa9aff9380e7 INFO: 172.21.0.1:49628 - "POST /node/69cbe11c2a64fa9aff9380e7 HTTP/1.0" 202 Accepted 2026-04-02 14:58:46,695 - lava_callback - INFO - Starting async job submit for node 69cbe11c2a64fa9aff9380e7 2026-04-02 14:58:46,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:46,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe11c2a64fa9aff9380e7 HTTP/1.1" 200 None 2026-04-02 14:58:46,712 - lava_callback - DEBUG - Processing node 69cbe11c2a64fa9aff9380e7: baseline-arm-clabbe 2026-04-02 14:58:46,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe11c2a64fa9aff9380e7 2026-04-02 14:58:46,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:46,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe11c2a64fa9aff9380e7 HTTP/1.1" 200 None 2026-04-02 14:58:46,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:46,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:58:46,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:46,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe11c2a64fa9aff9380e7 HTTP/1.1" 200 None 2026-04-02 14:58:46,782 - lava_callback - ERROR - Error processing callback for node 69cbe11c2a64fa9aff9380e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:59:26,659 - lava_callback - INFO - Received callback for node 69cbe1402a64fa9aff9380f2 INFO: 172.21.0.1:37210 - "POST /node/69cbe1402a64fa9aff9380f2 HTTP/1.0" 202 Accepted 2026-04-02 14:59:26,664 - lava_callback - INFO - Starting async job submit for node 69cbe1402a64fa9aff9380f2 2026-04-02 14:59:26,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:59:26,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1402a64fa9aff9380f2 HTTP/1.1" 200 None 2026-04-02 14:59:26,681 - lava_callback - DEBUG - Processing node 69cbe1402a64fa9aff9380f2: baseline-arm-clabbe 2026-04-02 14:59:26,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe1402a64fa9aff9380f2 2026-04-02 14:59:26,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:59:26,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1402a64fa9aff9380f2 HTTP/1.1" 200 None 2026-04-02 14:59:26,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:59:26,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:59:26,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:59:26,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe1402a64fa9aff9380f2 HTTP/1.1" 200 None 2026-04-02 14:59:26,763 - lava_callback - ERROR - Error processing callback for node 69cbe1402a64fa9aff9380f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:00:02,183 - lava_callback - INFO - Received callback for node 69cbe15f2a64fa9aff9380fb INFO: 172.21.0.1:59122 - "POST /node/69cbe15f2a64fa9aff9380fb HTTP/1.0" 202 Accepted 2026-04-02 15:00:02,189 - lava_callback - INFO - Starting async job submit for node 69cbe15f2a64fa9aff9380fb 2026-04-02 15:00:02,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:02,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe15f2a64fa9aff9380fb HTTP/1.1" 200 None 2026-04-02 15:00:02,230 - lava_callback - DEBUG - Processing node 69cbe15f2a64fa9aff9380fb: baseline-arm-baylibre 2026-04-02 15:00:02,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe15f2a64fa9aff9380fb 2026-04-02 15:00:02,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:02,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe15f2a64fa9aff9380fb HTTP/1.1" 200 None 2026-04-02 15:00:02,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:02,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:00:02,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:02,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe15f2a64fa9aff9380fb HTTP/1.1" 200 None 2026-04-02 15:00:02,293 - lava_callback - ERROR - Error processing callback for node 69cbe15f2a64fa9aff9380fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:00:46,765 - lava_callback - INFO - Received callback for node 69cbe1892a64fa9aff93810c INFO: 172.21.0.1:52354 - "POST /node/69cbe1892a64fa9aff93810c HTTP/1.0" 202 Accepted 2026-04-02 15:00:46,770 - lava_callback - INFO - Starting async job submit for node 69cbe1892a64fa9aff93810c 2026-04-02 15:00:46,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:46,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1892a64fa9aff93810c HTTP/1.1" 200 None 2026-04-02 15:00:46,789 - lava_callback - DEBUG - Processing node 69cbe1892a64fa9aff93810c: baseline-arm-clabbe 2026-04-02 15:00:46,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe1892a64fa9aff93810c 2026-04-02 15:00:46,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:46,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1892a64fa9aff93810c HTTP/1.1" 200 None 2026-04-02 15:00:46,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:46,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 15:00:46,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:46,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe1892a64fa9aff93810c HTTP/1.1" 200 None 2026-04-02 15:00:46,846 - lava_callback - ERROR - Error processing callback for node 69cbe1892a64fa9aff93810c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:01:02,269 - lava_callback - INFO - Received callback for node 69cbe1ab2a64fa9aff938117 INFO: 172.21.0.1:35740 - "POST /node/69cbe1ab2a64fa9aff938117 HTTP/1.0" 202 Accepted 2026-04-02 15:01:02,275 - lava_callback - INFO - Starting async job submit for node 69cbe1ab2a64fa9aff938117 2026-04-02 15:01:02,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:02,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1ab2a64fa9aff938117 HTTP/1.1" 200 None 2026-04-02 15:01:02,295 - lava_callback - DEBUG - Processing node 69cbe1ab2a64fa9aff938117: baseline-arm-baylibre 2026-04-02 15:01:02,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe1ab2a64fa9aff938117 2026-04-02 15:01:02,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:02,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1ab2a64fa9aff938117 HTTP/1.1" 200 None 2026-04-02 15:01:02,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:02,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:01:02,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:02,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe1ab2a64fa9aff938117 HTTP/1.1" 200 None 2026-04-02 15:01:02,352 - lava_callback - ERROR - Error processing callback for node 69cbe1ab2a64fa9aff938117: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:01:42,289 - lava_callback - INFO - Received callback for node 69cbe1d22a64fa9aff938123 INFO: 172.21.0.1:42184 - "POST /node/69cbe1d22a64fa9aff938123 HTTP/1.0" 202 Accepted 2026-04-02 15:01:42,295 - lava_callback - INFO - Starting async job submit for node 69cbe1d22a64fa9aff938123 2026-04-02 15:01:42,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:42,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1d22a64fa9aff938123 HTTP/1.1" 200 None 2026-04-02 15:01:42,312 - lava_callback - DEBUG - Processing node 69cbe1d22a64fa9aff938123: baseline-arm-baylibre 2026-04-02 15:01:42,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe1d22a64fa9aff938123 2026-04-02 15:01:42,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:42,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1d22a64fa9aff938123 HTTP/1.1" 200 None 2026-04-02 15:01:42,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:42,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:01:42,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:42,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe1d22a64fa9aff938123 HTTP/1.1" 200 None 2026-04-02 15:01:42,373 - lava_callback - ERROR - Error processing callback for node 69cbe1d22a64fa9aff938123: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:02:22,284 - lava_callback - INFO - Received callback for node 69cbe1fa2a64fa9aff93812d INFO: 172.21.0.1:40770 - "POST /node/69cbe1fa2a64fa9aff93812d HTTP/1.0" 202 Accepted 2026-04-02 15:02:22,289 - lava_callback - INFO - Starting async job submit for node 69cbe1fa2a64fa9aff93812d 2026-04-02 15:02:22,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:02:22,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1fa2a64fa9aff93812d HTTP/1.1" 200 None 2026-04-02 15:02:22,305 - lava_callback - DEBUG - Processing node 69cbe1fa2a64fa9aff93812d: baseline-arm-baylibre 2026-04-02 15:02:22,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe1fa2a64fa9aff93812d 2026-04-02 15:02:22,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:02:22,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1fa2a64fa9aff93812d HTTP/1.1" 200 None 2026-04-02 15:02:22,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:02:22,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:02:22,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:02:22,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe1fa2a64fa9aff93812d HTTP/1.1" 200 None 2026-04-02 15:02:22,376 - lava_callback - ERROR - Error processing callback for node 69cbe1fa2a64fa9aff93812d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:03:02,369 - lava_callback - INFO - Received callback for node 69cbe2232a64fa9aff93813b INFO: 172.21.0.1:57748 - "POST /node/69cbe2232a64fa9aff93813b HTTP/1.0" 202 Accepted 2026-04-02 15:03:02,374 - lava_callback - INFO - Starting async job submit for node 69cbe2232a64fa9aff93813b 2026-04-02 15:03:02,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:02,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2232a64fa9aff93813b HTTP/1.1" 200 None 2026-04-02 15:03:02,392 - lava_callback - DEBUG - Processing node 69cbe2232a64fa9aff93813b: baseline-arm-baylibre 2026-04-02 15:03:02,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe2232a64fa9aff93813b 2026-04-02 15:03:02,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:02,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2232a64fa9aff93813b HTTP/1.1" 200 None 2026-04-02 15:03:02,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:02,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:03:02,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:02,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe2232a64fa9aff93813b HTTP/1.1" 200 None 2026-04-02 15:03:02,454 - lava_callback - ERROR - Error processing callback for node 69cbe2232a64fa9aff93813b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:03:42,374 - lava_callback - INFO - Received callback for node 69cbe24c2a64fa9aff938145 INFO: 172.21.0.1:36940 - "POST /node/69cbe24c2a64fa9aff938145 HTTP/1.0" 202 Accepted 2026-04-02 15:03:42,379 - lava_callback - INFO - Starting async job submit for node 69cbe24c2a64fa9aff938145 2026-04-02 15:03:42,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:42,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe24c2a64fa9aff938145 HTTP/1.1" 200 None 2026-04-02 15:03:42,395 - lava_callback - DEBUG - Processing node 69cbe24c2a64fa9aff938145: baseline-arm-baylibre 2026-04-02 15:03:42,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe24c2a64fa9aff938145 2026-04-02 15:03:42,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:42,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe24c2a64fa9aff938145 HTTP/1.1" 200 None 2026-04-02 15:03:42,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:42,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:03:42,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:42,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe24c2a64fa9aff938145 HTTP/1.1" 200 None 2026-04-02 15:03:42,457 - lava_callback - ERROR - Error processing callback for node 69cbe24c2a64fa9aff938145: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:04:26,932 - lava_callback - INFO - Received callback for node 69cbe2752a64fa9aff938152 INFO: 172.21.0.1:53480 - "POST /node/69cbe2752a64fa9aff938152 HTTP/1.0" 202 Accepted 2026-04-02 15:04:26,939 - lava_callback - INFO - Starting async job submit for node 69cbe2752a64fa9aff938152 2026-04-02 15:04:26,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:04:26,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2752a64fa9aff938152 HTTP/1.1" 200 None 2026-04-02 15:04:26,956 - lava_callback - DEBUG - Processing node 69cbe2752a64fa9aff938152: baseline-arm-clabbe 2026-04-02 15:04:26,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe2752a64fa9aff938152 2026-04-02 15:04:26,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:04:26,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2752a64fa9aff938152 HTTP/1.1" 200 None 2026-04-02 15:04:26,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:04:26,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:04:26,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:04:27,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe2752a64fa9aff938152 HTTP/1.1" 200 None 2026-04-02 15:04:27,023 - lava_callback - ERROR - Error processing callback for node 69cbe2752a64fa9aff938152: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:05:02,442 - lava_callback - INFO - Received callback for node 69cbe2982a64fa9aff93815f INFO: 172.21.0.1:49132 - "POST /node/69cbe2982a64fa9aff93815f HTTP/1.0" 202 Accepted 2026-04-02 15:05:02,447 - lava_callback - INFO - Starting async job submit for node 69cbe2982a64fa9aff93815f 2026-04-02 15:05:02,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:02,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2982a64fa9aff93815f HTTP/1.1" 200 None 2026-04-02 15:05:02,464 - lava_callback - DEBUG - Processing node 69cbe2982a64fa9aff93815f: baseline-arm-baylibre 2026-04-02 15:05:02,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe2982a64fa9aff93815f 2026-04-02 15:05:02,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:02,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2982a64fa9aff93815f HTTP/1.1" 200 None 2026-04-02 15:05:02,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:02,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:05:02,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:02,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe2982a64fa9aff93815f HTTP/1.1" 200 None 2026-04-02 15:05:02,540 - lava_callback - ERROR - Error processing callback for node 69cbe2982a64fa9aff93815f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54242 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:05:42,437 - lava_callback - INFO - Received callback for node 69cbe2bf2a64fa9aff938169 INFO: 172.21.0.1:41986 - "POST /node/69cbe2bf2a64fa9aff938169 HTTP/1.0" 202 Accepted 2026-04-02 15:05:42,442 - lava_callback - INFO - Starting async job submit for node 69cbe2bf2a64fa9aff938169 2026-04-02 15:05:42,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:42,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2bf2a64fa9aff938169 HTTP/1.1" 200 None 2026-04-02 15:05:42,458 - lava_callback - DEBUG - Processing node 69cbe2bf2a64fa9aff938169: baseline-arm-baylibre 2026-04-02 15:05:42,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe2bf2a64fa9aff938169 2026-04-02 15:05:42,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:42,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2bf2a64fa9aff938169 HTTP/1.1" 200 None 2026-04-02 15:05:42,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:42,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:05:42,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:42,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe2bf2a64fa9aff938169 HTTP/1.1" 200 None 2026-04-02 15:05:42,514 - lava_callback - ERROR - Error processing callback for node 69cbe2bf2a64fa9aff938169: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:06:27,014 - lava_callback - INFO - Received callback for node 69cbe2ec2a64fa9aff938172 INFO: 172.21.0.1:56688 - "POST /node/69cbe2ec2a64fa9aff938172 HTTP/1.0" 202 Accepted 2026-04-02 15:06:27,020 - lava_callback - INFO - Starting async job submit for node 69cbe2ec2a64fa9aff938172 2026-04-02 15:06:27,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:06:27,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2ec2a64fa9aff938172 HTTP/1.1" 200 None 2026-04-02 15:06:27,037 - lava_callback - DEBUG - Processing node 69cbe2ec2a64fa9aff938172: baseline-arm-clabbe 2026-04-02 15:06:27,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe2ec2a64fa9aff938172 2026-04-02 15:06:27,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:06:27,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2ec2a64fa9aff938172 HTTP/1.1" 200 None 2026-04-02 15:06:27,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:06:27,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:06:27,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:06:27,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe2ec2a64fa9aff938172 HTTP/1.1" 200 None 2026-04-02 15:06:27,109 - lava_callback - ERROR - Error processing callback for node 69cbe2ec2a64fa9aff938172: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:07:02,525 - lava_callback - INFO - Received callback for node 69cbe30e2a64fa9aff93817f INFO: 172.21.0.1:54896 - "POST /node/69cbe30e2a64fa9aff93817f HTTP/1.0" 202 Accepted 2026-04-02 15:07:02,530 - lava_callback - INFO - Starting async job submit for node 69cbe30e2a64fa9aff93817f 2026-04-02 15:07:02,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:02,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe30e2a64fa9aff93817f HTTP/1.1" 200 None 2026-04-02 15:07:02,547 - lava_callback - DEBUG - Processing node 69cbe30e2a64fa9aff93817f: baseline-arm-baylibre 2026-04-02 15:07:02,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe30e2a64fa9aff93817f 2026-04-02 15:07:02,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:02,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe30e2a64fa9aff93817f HTTP/1.1" 200 None 2026-04-02 15:07:02,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:02,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:07:02,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:02,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe30e2a64fa9aff93817f HTTP/1.1" 200 None 2026-04-02 15:07:02,654 - lava_callback - ERROR - Error processing callback for node 69cbe30e2a64fa9aff93817f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38104 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:07:42,530 - lava_callback - INFO - Received callback for node 69cbe3342a64fa9aff938187 INFO: 172.21.0.1:51388 - "POST /node/69cbe3342a64fa9aff938187 HTTP/1.0" 202 Accepted 2026-04-02 15:07:42,536 - lava_callback - INFO - Starting async job submit for node 69cbe3342a64fa9aff938187 2026-04-02 15:07:42,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:42,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3342a64fa9aff938187 HTTP/1.1" 200 None 2026-04-02 15:07:42,556 - lava_callback - DEBUG - Processing node 69cbe3342a64fa9aff938187: baseline-arm-baylibre 2026-04-02 15:07:42,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe3342a64fa9aff938187 2026-04-02 15:07:42,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:42,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3342a64fa9aff938187 HTTP/1.1" 200 None 2026-04-02 15:07:42,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:42,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:07:42,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:42,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe3342a64fa9aff938187 HTTP/1.1" 200 None 2026-04-02 15:07:42,618 - lava_callback - ERROR - Error processing callback for node 69cbe3342a64fa9aff938187: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:08:22,614 - lava_callback - INFO - Received callback for node 69cbe35d2a64fa9aff938192 INFO: 172.21.0.1:41228 - "POST /node/69cbe35d2a64fa9aff938192 HTTP/1.0" 202 Accepted 2026-04-02 15:08:22,624 - lava_callback - INFO - Starting async job submit for node 69cbe35d2a64fa9aff938192 2026-04-02 15:08:22,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:08:22,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe35d2a64fa9aff938192 HTTP/1.1" 200 None 2026-04-02 15:08:22,642 - lava_callback - DEBUG - Processing node 69cbe35d2a64fa9aff938192: baseline-arm-baylibre 2026-04-02 15:08:22,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe35d2a64fa9aff938192 2026-04-02 15:08:22,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:08:22,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe35d2a64fa9aff938192 HTTP/1.1" 200 None 2026-04-02 15:08:22,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:08:22,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:08:22,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:08:22,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe35d2a64fa9aff938192 HTTP/1.1" 200 None 2026-04-02 15:08:22,710 - lava_callback - ERROR - Error processing callback for node 69cbe35d2a64fa9aff938192: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:09:02,618 - lava_callback - INFO - Received callback for node 69cbe3832a64fa9aff93819c INFO: 172.21.0.1:51622 - "POST /node/69cbe3832a64fa9aff93819c HTTP/1.0" 202 Accepted 2026-04-02 15:09:02,623 - lava_callback - INFO - Starting async job submit for node 69cbe3832a64fa9aff93819c 2026-04-02 15:09:02,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:02,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3832a64fa9aff93819c HTTP/1.1" 200 None 2026-04-02 15:09:02,641 - lava_callback - DEBUG - Processing node 69cbe3832a64fa9aff93819c: baseline-arm-baylibre 2026-04-02 15:09:02,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe3832a64fa9aff93819c 2026-04-02 15:09:02,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:02,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3832a64fa9aff93819c HTTP/1.1" 200 None 2026-04-02 15:09:02,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:02,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:09:02,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:02,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe3832a64fa9aff93819c HTTP/1.1" 200 None 2026-04-02 15:09:02,699 - lava_callback - ERROR - Error processing callback for node 69cbe3832a64fa9aff93819c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:09:47,087 - lava_callback - INFO - Received callback for node 69cbe3b22a64fa9aff9381aa INFO: 172.21.0.1:44572 - "POST /node/69cbe3b22a64fa9aff9381aa HTTP/1.0" 202 Accepted 2026-04-02 15:09:47,093 - lava_callback - INFO - Starting async job submit for node 69cbe3b22a64fa9aff9381aa 2026-04-02 15:09:47,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:47,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3b22a64fa9aff9381aa HTTP/1.1" 200 None 2026-04-02 15:09:47,110 - lava_callback - DEBUG - Processing node 69cbe3b22a64fa9aff9381aa: baseline-arm-clabbe 2026-04-02 15:09:47,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe3b22a64fa9aff9381aa 2026-04-02 15:09:47,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:47,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3b22a64fa9aff9381aa HTTP/1.1" 200 None 2026-04-02 15:09:47,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:47,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:09:47,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:47,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe3b22a64fa9aff9381aa HTTP/1.1" 200 None 2026-04-02 15:09:47,190 - lava_callback - ERROR - Error processing callback for node 69cbe3b22a64fa9aff9381aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:10:22,698 - lava_callback - INFO - Received callback for node 69cbe3d52a64fa9aff9381b3 INFO: 172.21.0.1:52098 - "POST /node/69cbe3d52a64fa9aff9381b3 HTTP/1.0" 202 Accepted 2026-04-02 15:10:22,704 - lava_callback - INFO - Starting async job submit for node 69cbe3d52a64fa9aff9381b3 2026-04-02 15:10:22,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:10:22,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3d52a64fa9aff9381b3 HTTP/1.1" 200 None 2026-04-02 15:10:22,742 - lava_callback - DEBUG - Processing node 69cbe3d52a64fa9aff9381b3: baseline-arm-baylibre 2026-04-02 15:10:22,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe3d52a64fa9aff9381b3 2026-04-02 15:10:22,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:10:22,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3d52a64fa9aff9381b3 HTTP/1.1" 200 None 2026-04-02 15:10:22,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:10:22,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:10:22,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:10:22,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe3d52a64fa9aff9381b3 HTTP/1.1" 200 None 2026-04-02 15:10:22,795 - lava_callback - ERROR - Error processing callback for node 69cbe3d52a64fa9aff9381b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:11:07,180 - lava_callback - INFO - Received callback for node 69cbe3ff2a64fa9aff9381c4 INFO: 172.21.0.1:53436 - "POST /node/69cbe3ff2a64fa9aff9381c4 HTTP/1.0" 202 Accepted 2026-04-02 15:11:07,187 - lava_callback - INFO - Starting async job submit for node 69cbe3ff2a64fa9aff9381c4 2026-04-02 15:11:07,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:11:07,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3ff2a64fa9aff9381c4 HTTP/1.1" 200 None 2026-04-02 15:11:07,204 - lava_callback - DEBUG - Processing node 69cbe3ff2a64fa9aff9381c4: baseline-arm-clabbe 2026-04-02 15:11:07,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe3ff2a64fa9aff9381c4 2026-04-02 15:11:07,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:11:07,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3ff2a64fa9aff9381c4 HTTP/1.1" 200 None 2026-04-02 15:11:07,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:11:07,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:11:07,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:11:07,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe3ff2a64fa9aff9381c4 HTTP/1.1" 200 None 2026-04-02 15:11:07,262 - lava_callback - ERROR - Error processing callback for node 69cbe3ff2a64fa9aff9381c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:12:22,772 - lava_callback - INFO - Received callback for node 69cbe44c2a64fa9aff9381d6 INFO: 172.21.0.1:42326 - "POST /node/69cbe44c2a64fa9aff9381d6 HTTP/1.0" 202 Accepted 2026-04-02 15:12:22,777 - lava_callback - INFO - Starting async job submit for node 69cbe44c2a64fa9aff9381d6 2026-04-02 15:12:22,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:12:22,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe44c2a64fa9aff9381d6 HTTP/1.1" 200 None 2026-04-02 15:12:22,794 - lava_callback - DEBUG - Processing node 69cbe44c2a64fa9aff9381d6: baseline-arm-baylibre 2026-04-02 15:12:22,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe44c2a64fa9aff9381d6 2026-04-02 15:12:22,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:12:22,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe44c2a64fa9aff9381d6 HTTP/1.1" 200 None 2026-04-02 15:12:22,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:12:22,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:12:22,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:12:22,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe44c2a64fa9aff9381d6 HTTP/1.1" 200 None 2026-04-02 15:12:22,847 - lava_callback - ERROR - Error processing callback for node 69cbe44c2a64fa9aff9381d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:13:07,287 - lava_callback - INFO - Received callback for node 69cbe4762a64fa9aff9381e1 INFO: 172.21.0.1:47370 - "POST /node/69cbe4762a64fa9aff9381e1 HTTP/1.0" 202 Accepted 2026-04-02 15:13:07,293 - lava_callback - INFO - Starting async job submit for node 69cbe4762a64fa9aff9381e1 2026-04-02 15:13:07,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:13:07,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe4762a64fa9aff9381e1 HTTP/1.1" 200 None 2026-04-02 15:13:07,309 - lava_callback - DEBUG - Processing node 69cbe4762a64fa9aff9381e1: baseline-arm-clabbe 2026-04-02 15:13:07,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe4762a64fa9aff9381e1 2026-04-02 15:13:07,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:13:07,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe4762a64fa9aff9381e1 HTTP/1.1" 200 None 2026-04-02 15:13:07,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:13:07,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:13:07,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:13:07,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe4762a64fa9aff9381e1 HTTP/1.1" 200 None 2026-04-02 15:13:07,378 - lava_callback - ERROR - Error processing callback for node 69cbe4762a64fa9aff9381e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET /node/69903db0985e4efca431e421%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:19:43,256 - lava_callback - INFO - Received callback for node 69cbe6012a64fa9aff93822b INFO: 172.21.0.1:58464 - "POST /node/69cbe6012a64fa9aff93822b HTTP/1.0" 202 Accepted 2026-04-02 15:19:43,262 - lava_callback - INFO - Starting async job submit for node 69cbe6012a64fa9aff93822b 2026-04-02 15:19:43,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:19:43,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6012a64fa9aff93822b HTTP/1.1" 200 None 2026-04-02 15:19:43,306 - lava_callback - DEBUG - Processing node 69cbe6012a64fa9aff93822b: baseline-arm-baylibre 2026-04-02 15:19:43,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe6012a64fa9aff93822b 2026-04-02 15:19:43,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:19:43,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6012a64fa9aff93822b HTTP/1.1" 200 None 2026-04-02 15:19:43,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:19:43,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:19:43,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:19:43,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe6012a64fa9aff93822b HTTP/1.1" 200 None 2026-04-02 15:19:43,369 - lava_callback - ERROR - Error processing callback for node 69cbe6012a64fa9aff93822b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41820 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:20:23,192 - lava_callback - INFO - Received callback for node 69cbe6302a64fa9aff938238 INFO: 172.21.0.1:41014 - "POST /node/69cbe6302a64fa9aff938238 HTTP/1.0" 202 Accepted 2026-04-02 15:20:23,198 - lava_callback - INFO - Starting async job submit for node 69cbe6302a64fa9aff938238 2026-04-02 15:20:23,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:20:23,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6302a64fa9aff938238 HTTP/1.1" 200 None 2026-04-02 15:20:23,213 - lava_callback - DEBUG - Processing node 69cbe6302a64fa9aff938238: baseline-arm64-baylibre 2026-04-02 15:20:23,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe6302a64fa9aff938238 2026-04-02 15:20:23,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:20:23,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6302a64fa9aff938238 HTTP/1.1" 200 None 2026-04-02 15:20:23,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:20:23,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:20:23,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:20:23,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe6302a64fa9aff938238 HTTP/1.1" 200 None 2026-04-02 15:20:23,285 - lava_callback - ERROR - Error processing callback for node 69cbe6302a64fa9aff938238: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:22:03,368 - lava_callback - INFO - Received callback for node 69cbe6882a64fa9aff938242 INFO: 172.21.0.1:35752 - "POST /node/69cbe6882a64fa9aff938242 HTTP/1.0" 202 Accepted 2026-04-02 15:22:03,373 - lava_callback - INFO - Starting async job submit for node 69cbe6882a64fa9aff938242 2026-04-02 15:22:03,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:22:03,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6882a64fa9aff938242 HTTP/1.1" 200 None 2026-04-02 15:22:03,393 - lava_callback - DEBUG - Processing node 69cbe6882a64fa9aff938242: baseline-arm64-baylibre 2026-04-02 15:22:03,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe6882a64fa9aff938242 2026-04-02 15:22:03,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:22:03,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6882a64fa9aff938242 HTTP/1.1" 200 None 2026-04-02 15:22:03,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:22:03,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:22:03,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:22:03,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe6882a64fa9aff938242 HTTP/1.1" 200 None 2026-04-02 15:22:03,455 - lava_callback - ERROR - Error processing callback for node 69cbe6882a64fa9aff938242: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33574 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:23:23,520 - lava_callback - INFO - Received callback for node 69cbe6e02a64fa9aff93824c INFO: 172.21.0.1:60196 - "POST /node/69cbe6e02a64fa9aff93824c HTTP/1.0" 202 Accepted 2026-04-02 15:23:23,526 - lava_callback - INFO - Starting async job submit for node 69cbe6e02a64fa9aff93824c 2026-04-02 15:23:23,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:23:23,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6e02a64fa9aff93824c HTTP/1.1" 200 None 2026-04-02 15:23:23,549 - lava_callback - DEBUG - Processing node 69cbe6e02a64fa9aff93824c: baseline-arm64-baylibre 2026-04-02 15:23:23,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe6e02a64fa9aff93824c 2026-04-02 15:23:23,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:23:23,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6e02a64fa9aff93824c HTTP/1.1" 200 None 2026-04-02 15:23:23,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:23:23,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:23:23,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:23:23,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe6e02a64fa9aff93824c HTTP/1.1" 200 None 2026-04-02 15:23:23,625 - lava_callback - ERROR - Error processing callback for node 69cbe6e02a64fa9aff93824c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:24:43,472 - lava_callback - INFO - Received callback for node 69cbe7372a64fa9aff938257 INFO: 172.21.0.1:35552 - "POST /node/69cbe7372a64fa9aff938257 HTTP/1.0" 202 Accepted 2026-04-02 15:24:43,478 - lava_callback - INFO - Starting async job submit for node 69cbe7372a64fa9aff938257 2026-04-02 15:24:43,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:24:43,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe7372a64fa9aff938257 HTTP/1.1" 200 None 2026-04-02 15:24:43,503 - lava_callback - DEBUG - Processing node 69cbe7372a64fa9aff938257: baseline-arm64-baylibre 2026-04-02 15:24:43,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe7372a64fa9aff938257 2026-04-02 15:24:43,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:24:43,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe7372a64fa9aff938257 HTTP/1.1" 200 None 2026-04-02 15:24:43,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:24:43,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:24:43,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:24:43,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe7372a64fa9aff938257 HTTP/1.1" 200 None 2026-04-02 15:24:43,558 - lava_callback - ERROR - Error processing callback for node 69cbe7372a64fa9aff938257: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:26:23,572 - lava_callback - INFO - Received callback for node 69cbe78f2a64fa9aff938263 INFO: 172.21.0.1:53246 - "POST /node/69cbe78f2a64fa9aff938263 HTTP/1.0" 202 Accepted 2026-04-02 15:26:23,577 - lava_callback - INFO - Starting async job submit for node 69cbe78f2a64fa9aff938263 2026-04-02 15:26:23,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:26:23,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe78f2a64fa9aff938263 HTTP/1.1" 200 None 2026-04-02 15:26:23,602 - lava_callback - DEBUG - Processing node 69cbe78f2a64fa9aff938263: baseline-arm64-baylibre 2026-04-02 15:26:23,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe78f2a64fa9aff938263 2026-04-02 15:26:23,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:26:23,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe78f2a64fa9aff938263 HTTP/1.1" 200 None 2026-04-02 15:26:23,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:26:23,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:26:23,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:26:23,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe78f2a64fa9aff938263 HTTP/1.1" 200 None 2026-04-02 15:26:23,655 - lava_callback - ERROR - Error processing callback for node 69cbe78f2a64fa9aff938263: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:27:43,618 - lava_callback - INFO - Received callback for node 69cbe7e92a64fa9aff93826f INFO: 172.21.0.1:45618 - "POST /node/69cbe7e92a64fa9aff93826f HTTP/1.0" 202 Accepted 2026-04-02 15:27:43,623 - lava_callback - INFO - Starting async job submit for node 69cbe7e92a64fa9aff93826f 2026-04-02 15:27:43,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:27:43,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe7e92a64fa9aff93826f HTTP/1.1" 200 None 2026-04-02 15:27:43,640 - lava_callback - DEBUG - Processing node 69cbe7e92a64fa9aff93826f: baseline-arm64-baylibre 2026-04-02 15:27:43,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe7e92a64fa9aff93826f 2026-04-02 15:27:43,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:27:43,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe7e92a64fa9aff93826f HTTP/1.1" 200 None 2026-04-02 15:27:43,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:27:43,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:27:43,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:27:43,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe7e92a64fa9aff93826f HTTP/1.1" 200 None 2026-04-02 15:27:43,696 - lava_callback - ERROR - Error processing callback for node 69cbe7e92a64fa9aff93826f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:29:03,839 - lava_callback - INFO - Received callback for node 69cbe8342a64fa9aff938276 INFO: 172.21.0.1:57144 - "POST /node/69cbe8342a64fa9aff938276 HTTP/1.0" 202 Accepted 2026-04-02 15:29:03,845 - lava_callback - INFO - Starting async job submit for node 69cbe8342a64fa9aff938276 2026-04-02 15:29:03,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:29:03,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8342a64fa9aff938276 HTTP/1.1" 200 None 2026-04-02 15:29:03,862 - lava_callback - DEBUG - Processing node 69cbe8342a64fa9aff938276: baseline-arm-baylibre 2026-04-02 15:29:03,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe8342a64fa9aff938276 2026-04-02 15:29:03,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:29:03,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8342a64fa9aff938276 HTTP/1.1" 200 None 2026-04-02 15:29:03,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:29:03,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:29:03,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:29:03,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe8342a64fa9aff938276 HTTP/1.1" 200 None 2026-04-02 15:29:03,949 - lava_callback - ERROR - Error processing callback for node 69cbe8342a64fa9aff938276: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41624 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:30:08,120 - lava_callback - INFO - Received callback for node 69cbe8712a64fa9aff938283 INFO: 172.21.0.1:41626 - "POST /node/69cbe8712a64fa9aff938283 HTTP/1.0" 202 Accepted 2026-04-02 15:30:08,129 - lava_callback - INFO - Starting async job submit for node 69cbe8712a64fa9aff938283 2026-04-02 15:30:08,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:30:08,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8712a64fa9aff938283 HTTP/1.1" 200 None 2026-04-02 15:30:08,146 - lava_callback - DEBUG - Processing node 69cbe8712a64fa9aff938283: baseline-arm64-clabbe 2026-04-02 15:30:08,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe8712a64fa9aff938283 2026-04-02 15:30:08,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:30:08,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8712a64fa9aff938283 HTTP/1.1" 200 None 2026-04-02 15:30:08,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:30:08,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:30:08,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:30:08,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe8712a64fa9aff938283 HTTP/1.1" 200 None 2026-04-02 15:30:08,203 - lava_callback - ERROR - Error processing callback for node 69cbe8712a64fa9aff938283: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46752 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:31:28,030 - lava_callback - INFO - Received callback for node 69cbe8c62a64fa9aff938290 INFO: 172.21.0.1:46768 - "POST /node/69cbe8c62a64fa9aff938290 HTTP/1.0" 202 Accepted 2026-04-02 15:31:28,035 - lava_callback - INFO - Starting async job submit for node 69cbe8c62a64fa9aff938290 2026-04-02 15:31:28,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:31:28,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8c62a64fa9aff938290 HTTP/1.1" 200 None 2026-04-02 15:31:28,052 - lava_callback - DEBUG - Processing node 69cbe8c62a64fa9aff938290: baseline-arm64-clabbe 2026-04-02 15:31:28,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe8c62a64fa9aff938290 2026-04-02 15:31:28,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:31:28,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8c62a64fa9aff938290 HTTP/1.1" 200 None 2026-04-02 15:31:28,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:31:28,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:31:28,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:31:28,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe8c62a64fa9aff938290 HTTP/1.1" 200 None 2026-04-02 15:31:28,111 - lava_callback - ERROR - Error processing callback for node 69cbe8c62a64fa9aff938290: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39308 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:32:48,115 - lava_callback - INFO - Received callback for node 69cbe91d2a64fa9aff93829b INFO: 172.21.0.1:39318 - "POST /node/69cbe91d2a64fa9aff93829b HTTP/1.0" 202 Accepted 2026-04-02 15:32:48,121 - lava_callback - INFO - Starting async job submit for node 69cbe91d2a64fa9aff93829b 2026-04-02 15:32:48,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:32:48,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe91d2a64fa9aff93829b HTTP/1.1" 200 None 2026-04-02 15:32:48,138 - lava_callback - DEBUG - Processing node 69cbe91d2a64fa9aff93829b: baseline-arm64-clabbe 2026-04-02 15:32:48,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe91d2a64fa9aff93829b 2026-04-02 15:32:48,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:32:48,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe91d2a64fa9aff93829b HTTP/1.1" 200 None 2026-04-02 15:32:48,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:32:48,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:32:48,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:32:48,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe91d2a64fa9aff93829b HTTP/1.1" 200 None 2026-04-02 15:32:48,197 - lava_callback - ERROR - Error processing callback for node 69cbe91d2a64fa9aff93829b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:34:28,196 - lava_callback - INFO - Received callback for node 69cbe9782a64fa9aff9382aa INFO: 172.21.0.1:40450 - "POST /node/69cbe9782a64fa9aff9382aa HTTP/1.0" 202 Accepted 2026-04-02 15:34:28,201 - lava_callback - INFO - Starting async job submit for node 69cbe9782a64fa9aff9382aa 2026-04-02 15:34:28,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:34:28,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe9782a64fa9aff9382aa HTTP/1.1" 200 None 2026-04-02 15:34:28,229 - lava_callback - DEBUG - Processing node 69cbe9782a64fa9aff9382aa: baseline-arm64-clabbe 2026-04-02 15:34:28,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe9782a64fa9aff9382aa 2026-04-02 15:34:28,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:34:28,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe9782a64fa9aff9382aa HTTP/1.1" 200 None 2026-04-02 15:34:28,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:34:28,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:34:28,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:34:28,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe9782a64fa9aff9382aa HTTP/1.1" 200 None 2026-04-02 15:34:28,293 - lava_callback - ERROR - Error processing callback for node 69cbe9782a64fa9aff9382aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:36:08,254 - lava_callback - INFO - Received callback for node 69cbe9d32a64fa9aff9382ba INFO: 172.21.0.1:37850 - "POST /node/69cbe9d32a64fa9aff9382ba HTTP/1.0" 202 Accepted 2026-04-02 15:36:08,259 - lava_callback - INFO - Starting async job submit for node 69cbe9d32a64fa9aff9382ba 2026-04-02 15:36:08,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:36:08,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe9d32a64fa9aff9382ba HTTP/1.1" 200 None 2026-04-02 15:36:08,275 - lava_callback - DEBUG - Processing node 69cbe9d32a64fa9aff9382ba: baseline-arm64-clabbe 2026-04-02 15:36:08,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe9d32a64fa9aff9382ba 2026-04-02 15:36:08,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:36:08,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe9d32a64fa9aff9382ba HTTP/1.1" 200 None 2026-04-02 15:36:08,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:36:08,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:36:08,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:36:08,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe9d32a64fa9aff9382ba HTTP/1.1" 200 None 2026-04-02 15:36:08,337 - lava_callback - ERROR - Error processing callback for node 69cbe9d32a64fa9aff9382ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:37:28,309 - lava_callback - INFO - Received callback for node 69cbea292a64fa9aff9382c4 INFO: 172.21.0.1:56188 - "POST /node/69cbea292a64fa9aff9382c4 HTTP/1.0" 202 Accepted 2026-04-02 15:37:28,314 - lava_callback - INFO - Starting async job submit for node 69cbea292a64fa9aff9382c4 2026-04-02 15:37:28,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:37:28,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea292a64fa9aff9382c4 HTTP/1.1" 200 None 2026-04-02 15:37:28,331 - lava_callback - DEBUG - Processing node 69cbea292a64fa9aff9382c4: baseline-arm64-clabbe 2026-04-02 15:37:28,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbea292a64fa9aff9382c4 2026-04-02 15:37:28,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:37:28,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea292a64fa9aff9382c4 HTTP/1.1" 200 None 2026-04-02 15:37:28,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:37:28,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:37:28,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:37:28,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbea292a64fa9aff9382c4 HTTP/1.1" 200 None 2026-04-02 15:37:28,389 - lava_callback - ERROR - Error processing callback for node 69cbea292a64fa9aff9382c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:38:28,327 - lava_callback - INFO - Received callback for node 69cbea6f2a64fa9aff9382cb INFO: 172.21.0.1:60064 - "POST /node/69cbea6f2a64fa9aff9382cb HTTP/1.0" 202 Accepted 2026-04-02 15:38:28,333 - lava_callback - INFO - Starting async job submit for node 69cbea6f2a64fa9aff9382cb 2026-04-02 15:38:28,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:38:28,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea6f2a64fa9aff9382cb HTTP/1.1" 200 None 2026-04-02 15:38:28,352 - lava_callback - DEBUG - Processing node 69cbea6f2a64fa9aff9382cb: baseline-arm-clabbe 2026-04-02 15:38:28,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbea6f2a64fa9aff9382cb 2026-04-02 15:38:28,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:38:28,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea6f2a64fa9aff9382cb HTTP/1.1" 200 None 2026-04-02 15:38:28,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:38:28,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:38:28,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:38:28,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbea6f2a64fa9aff9382cb HTTP/1.1" 200 None 2026-04-02 15:38:28,418 - lava_callback - ERROR - Error processing callback for node 69cbea6f2a64fa9aff9382cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48936 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:39:08,328 - lava_callback - INFO - Received callback for node 69cbea992a64fa9aff9382dc INFO: 172.21.0.1:48942 - "POST /node/69cbea992a64fa9aff9382dc HTTP/1.0" 202 Accepted 2026-04-02 15:39:08,334 - lava_callback - INFO - Starting async job submit for node 69cbea992a64fa9aff9382dc 2026-04-02 15:39:08,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:39:08,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea992a64fa9aff9382dc HTTP/1.1" 200 None 2026-04-02 15:39:08,355 - lava_callback - DEBUG - Processing node 69cbea992a64fa9aff9382dc: baseline-arm-clabbe 2026-04-02 15:39:08,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbea992a64fa9aff9382dc 2026-04-02 15:39:08,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:39:08,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea992a64fa9aff9382dc HTTP/1.1" 200 None 2026-04-02 15:39:08,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:39:08,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:39:08,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:39:08,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbea992a64fa9aff9382dc HTTP/1.1" 200 None 2026-04-02 15:39:08,417 - lava_callback - ERROR - Error processing callback for node 69cbea992a64fa9aff9382dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:40:08,470 - lava_callback - INFO - Received callback for node 69cbeac22a64fa9aff9382e8 INFO: 172.21.0.1:54730 - "POST /node/69cbeac22a64fa9aff9382e8 HTTP/1.0" 202 Accepted 2026-04-02 15:40:08,475 - lava_callback - INFO - Starting async job submit for node 69cbeac22a64fa9aff9382e8 2026-04-02 15:40:08,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:08,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeac22a64fa9aff9382e8 HTTP/1.1" 200 None 2026-04-02 15:40:08,492 - lava_callback - DEBUG - Processing node 69cbeac22a64fa9aff9382e8: baseline-arm-clabbe 2026-04-02 15:40:08,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeac22a64fa9aff9382e8 2026-04-02 15:40:08,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:08,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeac22a64fa9aff9382e8 HTTP/1.1" 200 None 2026-04-02 15:40:08,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:08,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:40:08,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:08,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeac22a64fa9aff9382e8 HTTP/1.1" 200 None 2026-04-02 15:40:08,547 - lava_callback - ERROR - Error processing callback for node 69cbeac22a64fa9aff9382e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:40:48,374 - lava_callback - INFO - Received callback for node 69cbeaec2a64fa9aff9382f9 INFO: 172.21.0.1:40040 - "POST /node/69cbeaec2a64fa9aff9382f9 HTTP/1.0" 202 Accepted 2026-04-02 15:40:48,380 - lava_callback - INFO - Starting async job submit for node 69cbeaec2a64fa9aff9382f9 2026-04-02 15:40:48,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:48,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeaec2a64fa9aff9382f9 HTTP/1.1" 200 None 2026-04-02 15:40:48,406 - lava_callback - DEBUG - Processing node 69cbeaec2a64fa9aff9382f9: baseline-arm-clabbe 2026-04-02 15:40:48,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeaec2a64fa9aff9382f9 2026-04-02 15:40:48,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:48,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeaec2a64fa9aff9382f9 HTTP/1.1" 200 None 2026-04-02 15:40:48,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:48,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:40:48,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:48,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeaec2a64fa9aff9382f9 HTTP/1.1" 200 None 2026-04-02 15:40:48,461 - lava_callback - ERROR - Error processing callback for node 69cbeaec2a64fa9aff9382f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:41:28,416 - lava_callback - INFO - Received callback for node 69cbeb162a64fa9aff938302 INFO: 172.21.0.1:49462 - "POST /node/69cbeb162a64fa9aff938302 HTTP/1.0" 202 Accepted 2026-04-02 15:41:28,421 - lava_callback - INFO - Starting async job submit for node 69cbeb162a64fa9aff938302 2026-04-02 15:41:28,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:41:28,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb162a64fa9aff938302 HTTP/1.1" 200 None 2026-04-02 15:41:28,438 - lava_callback - DEBUG - Processing node 69cbeb162a64fa9aff938302: baseline-arm-clabbe 2026-04-02 15:41:28,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeb162a64fa9aff938302 2026-04-02 15:41:28,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:41:28,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb162a64fa9aff938302 HTTP/1.1" 200 None 2026-04-02 15:41:28,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:41:28,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:41:28,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:41:28,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeb162a64fa9aff938302 HTTP/1.1" 200 None 2026-04-02 15:41:28,503 - lava_callback - ERROR - Error processing callback for node 69cbeb162a64fa9aff938302: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:42:08,393 - lava_callback - INFO - Received callback for node 69cbeb402a64fa9aff93830d INFO: 172.21.0.1:42108 - "POST /node/69cbeb402a64fa9aff93830d HTTP/1.0" 202 Accepted 2026-04-02 15:42:08,399 - lava_callback - INFO - Starting async job submit for node 69cbeb402a64fa9aff93830d 2026-04-02 15:42:08,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:08,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb402a64fa9aff93830d HTTP/1.1" 200 None 2026-04-02 15:42:08,414 - lava_callback - DEBUG - Processing node 69cbeb402a64fa9aff93830d: baseline-arm-clabbe 2026-04-02 15:42:08,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeb402a64fa9aff93830d 2026-04-02 15:42:08,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:08,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb402a64fa9aff93830d HTTP/1.1" 200 None 2026-04-02 15:42:08,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:08,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:42:08,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:08,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeb402a64fa9aff93830d HTTP/1.1" 200 None 2026-04-02 15:42:08,484 - lava_callback - ERROR - Error processing callback for node 69cbeb402a64fa9aff93830d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:42:48,489 - lava_callback - INFO - Received callback for node 69cbeb682a64fa9aff93831c INFO: 172.21.0.1:41622 - "POST /node/69cbeb682a64fa9aff93831c HTTP/1.0" 202 Accepted 2026-04-02 15:42:48,494 - lava_callback - INFO - Starting async job submit for node 69cbeb682a64fa9aff93831c 2026-04-02 15:42:48,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:48,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb682a64fa9aff93831c HTTP/1.1" 200 None 2026-04-02 15:42:48,513 - lava_callback - DEBUG - Processing node 69cbeb682a64fa9aff93831c: baseline-arm-clabbe 2026-04-02 15:42:48,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeb682a64fa9aff93831c 2026-04-02 15:42:48,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:48,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb682a64fa9aff93831c HTTP/1.1" 200 None 2026-04-02 15:42:48,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:48,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:42:48,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:48,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeb682a64fa9aff93831c HTTP/1.1" 200 None 2026-04-02 15:42:48,577 - lava_callback - ERROR - Error processing callback for node 69cbeb682a64fa9aff93831c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55870 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:43:28,458 - lava_callback - INFO - Received callback for node 69cbeb902a64fa9aff938325 INFO: 172.21.0.1:55884 - "POST /node/69cbeb902a64fa9aff938325 HTTP/1.0" 202 Accepted 2026-04-02 15:43:28,463 - lava_callback - INFO - Starting async job submit for node 69cbeb902a64fa9aff938325 2026-04-02 15:43:28,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:43:28,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb902a64fa9aff938325 HTTP/1.1" 200 None 2026-04-02 15:43:28,495 - lava_callback - DEBUG - Processing node 69cbeb902a64fa9aff938325: baseline-arm-clabbe 2026-04-02 15:43:28,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeb902a64fa9aff938325 2026-04-02 15:43:28,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:43:28,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb902a64fa9aff938325 HTTP/1.1" 200 None 2026-04-02 15:43:28,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:43:28,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:43:28,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:43:28,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeb902a64fa9aff938325 HTTP/1.1" 200 None 2026-04-02 15:43:28,579 - lava_callback - ERROR - Error processing callback for node 69cbeb902a64fa9aff938325: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:44:08,541 - lava_callback - INFO - Received callback for node 69cbebb72a64fa9aff938332 INFO: 172.21.0.1:50148 - "POST /node/69cbebb72a64fa9aff938332 HTTP/1.0" 202 Accepted 2026-04-02 15:44:08,547 - lava_callback - INFO - Starting async job submit for node 69cbebb72a64fa9aff938332 2026-04-02 15:44:08,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:08,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbebb72a64fa9aff938332 HTTP/1.1" 200 None 2026-04-02 15:44:08,570 - lava_callback - DEBUG - Processing node 69cbebb72a64fa9aff938332: baseline-arm-clabbe 2026-04-02 15:44:08,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbebb72a64fa9aff938332 2026-04-02 15:44:08,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:08,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbebb72a64fa9aff938332 HTTP/1.1" 200 None 2026-04-02 15:44:08,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:08,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:44:08,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:08,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbebb72a64fa9aff938332 HTTP/1.1" 200 None 2026-04-02 15:44:08,645 - lava_callback - ERROR - Error processing callback for node 69cbebb72a64fa9aff938332: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57602 - "GET /node/69c6495cb98d4d3c02068932%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:44:48,551 - lava_callback - INFO - Received callback for node 69cbebdf2a64fa9aff93833f INFO: 172.21.0.1:54932 - "POST /node/69cbebdf2a64fa9aff93833f HTTP/1.0" 202 Accepted 2026-04-02 15:44:48,557 - lava_callback - INFO - Starting async job submit for node 69cbebdf2a64fa9aff93833f 2026-04-02 15:44:48,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:48,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbebdf2a64fa9aff93833f HTTP/1.1" 200 None 2026-04-02 15:44:48,577 - lava_callback - DEBUG - Processing node 69cbebdf2a64fa9aff93833f: baseline-arm-clabbe 2026-04-02 15:44:48,578 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbebdf2a64fa9aff93833f 2026-04-02 15:44:48,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:48,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbebdf2a64fa9aff93833f HTTP/1.1" 200 None 2026-04-02 15:44:48,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:48,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:44:48,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:48,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbebdf2a64fa9aff93833f HTTP/1.1" 200 None 2026-04-02 15:44:48,629 - lava_callback - ERROR - Error processing callback for node 69cbebdf2a64fa9aff93833f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49810 - "GET /favicon.ico HTTP/1.0" 404 Not Found 2026-04-02 15:45:24,569 - lava_callback - INFO - Received callback for node 69cbec0e2a64fa9aff93834a INFO: 172.21.0.1:49826 - "POST /node/69cbec0e2a64fa9aff93834a HTTP/1.0" 202 Accepted 2026-04-02 15:45:24,575 - lava_callback - INFO - Starting async job submit for node 69cbec0e2a64fa9aff93834a 2026-04-02 15:45:24,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:45:24,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbec0e2a64fa9aff93834a HTTP/1.1" 200 None 2026-04-02 15:45:24,592 - lava_callback - DEBUG - Processing node 69cbec0e2a64fa9aff93834a: baseline-arm64-baylibre 2026-04-02 15:45:24,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbec0e2a64fa9aff93834a 2026-04-02 15:45:24,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:45:24,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbec0e2a64fa9aff93834a HTTP/1.1" 200 None 2026-04-02 15:45:24,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:45:24,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:45:24,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:45:24,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbec0e2a64fa9aff93834a HTTP/1.1" 200 None 2026-04-02 15:45:24,665 - lava_callback - ERROR - Error processing callback for node 69cbec0e2a64fa9aff93834a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:47:04,615 - lava_callback - INFO - Received callback for node 69cbec642a64fa9aff938353 INFO: 172.21.0.1:38812 - "POST /node/69cbec642a64fa9aff938353 HTTP/1.0" 202 Accepted 2026-04-02 15:47:04,621 - lava_callback - INFO - Starting async job submit for node 69cbec642a64fa9aff938353 2026-04-02 15:47:04,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:47:04,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbec642a64fa9aff938353 HTTP/1.1" 200 None 2026-04-02 15:47:04,637 - lava_callback - DEBUG - Processing node 69cbec642a64fa9aff938353: baseline-arm64-baylibre 2026-04-02 15:47:04,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbec642a64fa9aff938353 2026-04-02 15:47:04,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:47:04,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbec642a64fa9aff938353 HTTP/1.1" 200 None 2026-04-02 15:47:04,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:47:04,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:47:04,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:47:04,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbec642a64fa9aff938353 HTTP/1.1" 200 None 2026-04-02 15:47:04,696 - lava_callback - ERROR - Error processing callback for node 69cbec642a64fa9aff938353: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:48:24,714 - lava_callback - INFO - Received callback for node 69cbecbc2a64fa9aff93835d INFO: 172.21.0.1:47586 - "POST /node/69cbecbc2a64fa9aff93835d HTTP/1.0" 202 Accepted 2026-04-02 15:48:24,719 - lava_callback - INFO - Starting async job submit for node 69cbecbc2a64fa9aff93835d 2026-04-02 15:48:24,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:48:24,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbecbc2a64fa9aff93835d HTTP/1.1" 200 None 2026-04-02 15:48:24,735 - lava_callback - DEBUG - Processing node 69cbecbc2a64fa9aff93835d: baseline-arm64-baylibre 2026-04-02 15:48:24,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbecbc2a64fa9aff93835d 2026-04-02 15:48:24,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:48:24,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbecbc2a64fa9aff93835d HTTP/1.1" 200 None 2026-04-02 15:48:24,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:48:24,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:48:24,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:48:24,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbecbc2a64fa9aff93835d HTTP/1.1" 200 None 2026-04-02 15:48:24,795 - lava_callback - ERROR - Error processing callback for node 69cbecbc2a64fa9aff93835d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:49:44,757 - lava_callback - INFO - Received callback for node 69cbed162a64fa9aff938369 INFO: 172.21.0.1:44382 - "POST /node/69cbed162a64fa9aff938369 HTTP/1.0" 202 Accepted 2026-04-02 15:49:44,763 - lava_callback - INFO - Starting async job submit for node 69cbed162a64fa9aff938369 2026-04-02 15:49:44,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:49:44,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbed162a64fa9aff938369 HTTP/1.1" 200 None 2026-04-02 15:49:44,779 - lava_callback - DEBUG - Processing node 69cbed162a64fa9aff938369: baseline-arm64-baylibre 2026-04-02 15:49:44,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbed162a64fa9aff938369 2026-04-02 15:49:44,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:49:44,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbed162a64fa9aff938369 HTTP/1.1" 200 None 2026-04-02 15:49:44,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:49:44,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:49:44,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:49:44,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbed162a64fa9aff938369 HTTP/1.1" 200 None 2026-04-02 15:49:44,866 - lava_callback - ERROR - Error processing callback for node 69cbed162a64fa9aff938369: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:51:24,873 - lava_callback - INFO - Received callback for node 69cbed6f2a64fa9aff938373 INFO: 172.21.0.1:48632 - "POST /node/69cbed6f2a64fa9aff938373 HTTP/1.0" 202 Accepted 2026-04-02 15:51:24,879 - lava_callback - INFO - Starting async job submit for node 69cbed6f2a64fa9aff938373 2026-04-02 15:51:24,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:51:24,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbed6f2a64fa9aff938373 HTTP/1.1" 200 None 2026-04-02 15:51:24,895 - lava_callback - DEBUG - Processing node 69cbed6f2a64fa9aff938373: baseline-arm64-baylibre 2026-04-02 15:51:24,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbed6f2a64fa9aff938373 2026-04-02 15:51:24,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:51:24,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbed6f2a64fa9aff938373 HTTP/1.1" 200 None 2026-04-02 15:51:24,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:51:24,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:51:24,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:51:24,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbed6f2a64fa9aff938373 HTTP/1.1" 200 None 2026-04-02 15:51:24,968 - lava_callback - ERROR - Error processing callback for node 69cbed6f2a64fa9aff938373: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:52:44,891 - lava_callback - INFO - Received callback for node 69cbedc42a64fa9aff93837f INFO: 172.21.0.1:41310 - "POST /node/69cbedc42a64fa9aff93837f HTTP/1.0" 202 Accepted 2026-04-02 15:52:44,896 - lava_callback - INFO - Starting async job submit for node 69cbedc42a64fa9aff93837f 2026-04-02 15:52:44,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:52:44,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbedc42a64fa9aff93837f HTTP/1.1" 200 None 2026-04-02 15:52:44,912 - lava_callback - DEBUG - Processing node 69cbedc42a64fa9aff93837f: baseline-arm64-baylibre 2026-04-02 15:52:44,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbedc42a64fa9aff93837f 2026-04-02 15:52:44,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:52:44,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbedc42a64fa9aff93837f HTTP/1.1" 200 None 2026-04-02 15:52:44,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:52:44,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:52:44,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:52:44,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbedc42a64fa9aff93837f HTTP/1.1" 200 None 2026-04-02 15:52:44,972 - lava_callback - ERROR - Error processing callback for node 69cbedc42a64fa9aff93837f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:54:04,999 - lava_callback - INFO - Received callback for node 69cbee182a64fa9aff93838d INFO: 172.21.0.1:44554 - "POST /node/69cbee182a64fa9aff93838d HTTP/1.0" 202 Accepted 2026-04-02 15:54:05,006 - lava_callback - INFO - Starting async job submit for node 69cbee182a64fa9aff93838d 2026-04-02 15:54:05,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:54:05,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbee182a64fa9aff93838d HTTP/1.1" 200 None 2026-04-02 15:54:05,029 - lava_callback - DEBUG - Processing node 69cbee182a64fa9aff93838d: baseline-arm64-baylibre 2026-04-02 15:54:05,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbee182a64fa9aff93838d 2026-04-02 15:54:05,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:54:05,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbee182a64fa9aff93838d HTTP/1.1" 200 None 2026-04-02 15:54:05,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:54:05,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:54:05,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:54:05,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbee182a64fa9aff93838d HTTP/1.1" 200 None 2026-04-02 15:54:05,092 - lava_callback - ERROR - Error processing callback for node 69cbee182a64fa9aff93838d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53620 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:55:49,088 - lava_callback - INFO - Received callback for node 69cbee782a64fa9aff93839b INFO: 172.21.0.1:53630 - "POST /node/69cbee782a64fa9aff93839b HTTP/1.0" 202 Accepted 2026-04-02 15:55:49,093 - lava_callback - INFO - Starting async job submit for node 69cbee782a64fa9aff93839b 2026-04-02 15:55:49,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:55:49,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbee782a64fa9aff93839b HTTP/1.1" 200 None 2026-04-02 15:55:49,110 - lava_callback - DEBUG - Processing node 69cbee782a64fa9aff93839b: baseline-arm64-clabbe 2026-04-02 15:55:49,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbee782a64fa9aff93839b 2026-04-02 15:55:49,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:55:49,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbee782a64fa9aff93839b HTTP/1.1" 200 None 2026-04-02 15:55:49,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:55:49,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:55:49,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:55:49,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbee782a64fa9aff93839b HTTP/1.1" 200 None 2026-04-02 15:55:49,169 - lava_callback - ERROR - Error processing callback for node 69cbee782a64fa9aff93839b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:57:09,087 - lava_callback - INFO - Received callback for node 69cbeecf2a64fa9aff9383a7 INFO: 172.21.0.1:35834 - "POST /node/69cbeecf2a64fa9aff9383a7 HTTP/1.0" 202 Accepted 2026-04-02 15:57:09,096 - lava_callback - INFO - Starting async job submit for node 69cbeecf2a64fa9aff9383a7 2026-04-02 15:57:09,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:57:09,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeecf2a64fa9aff9383a7 HTTP/1.1" 200 None 2026-04-02 15:57:09,112 - lava_callback - DEBUG - Processing node 69cbeecf2a64fa9aff9383a7: baseline-arm64-clabbe 2026-04-02 15:57:09,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeecf2a64fa9aff9383a7 2026-04-02 15:57:09,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:57:09,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeecf2a64fa9aff9383a7 HTTP/1.1" 200 None 2026-04-02 15:57:09,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:57:09,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:57:09,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:57:09,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeecf2a64fa9aff9383a7 HTTP/1.1" 200 None 2026-04-02 15:57:09,193 - lava_callback - ERROR - Error processing callback for node 69cbeecf2a64fa9aff9383a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:58:25,260 - lava_callback - INFO - Received callback for node 69cbef1c2a64fa9aff9383b0 INFO: 172.21.0.1:44610 - "POST /node/69cbef1c2a64fa9aff9383b0 HTTP/1.0" 202 Accepted 2026-04-02 15:58:25,265 - lava_callback - INFO - Starting async job submit for node 69cbef1c2a64fa9aff9383b0 2026-04-02 15:58:25,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:58:25,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbef1c2a64fa9aff9383b0 HTTP/1.1" 200 None 2026-04-02 15:58:25,285 - lava_callback - DEBUG - Processing node 69cbef1c2a64fa9aff9383b0: baseline-arm64-baylibre 2026-04-02 15:58:25,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbef1c2a64fa9aff9383b0 2026-04-02 15:58:25,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:58:25,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbef1c2a64fa9aff9383b0 HTTP/1.1" 200 None 2026-04-02 15:58:25,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:58:25,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:58:25,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:58:25,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbef1c2a64fa9aff9383b0 HTTP/1.1" 200 None 2026-04-02 15:58:25,348 - lava_callback - ERROR - Error processing callback for node 69cbef1c2a64fa9aff9383b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45704 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:00:09,462 - lava_callback - INFO - Received callback for node 69cbef7c2a64fa9aff9383ba INFO: 172.21.0.1:45706 - "POST /node/69cbef7c2a64fa9aff9383ba HTTP/1.0" 202 Accepted 2026-04-02 16:00:09,468 - lava_callback - INFO - Starting async job submit for node 69cbef7c2a64fa9aff9383ba 2026-04-02 16:00:09,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:00:09,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbef7c2a64fa9aff9383ba HTTP/1.1" 200 None 2026-04-02 16:00:09,484 - lava_callback - DEBUG - Processing node 69cbef7c2a64fa9aff9383ba: baseline-arm64-clabbe 2026-04-02 16:00:09,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbef7c2a64fa9aff9383ba 2026-04-02 16:00:09,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:00:09,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbef7c2a64fa9aff9383ba HTTP/1.1" 200 None 2026-04-02 16:00:09,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:00:09,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:00:09,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:00:09,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbef7c2a64fa9aff9383ba HTTP/1.1" 200 None 2026-04-02 16:00:09,560 - lava_callback - ERROR - Error processing callback for node 69cbef7c2a64fa9aff9383ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56468 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:01:25,389 - lava_callback - INFO - Received callback for node 69cbefc82a64fa9aff9383c9 INFO: 172.21.0.1:43694 - "POST /node/69cbefc82a64fa9aff9383c9 HTTP/1.0" 202 Accepted 2026-04-02 16:01:25,395 - lava_callback - INFO - Starting async job submit for node 69cbefc82a64fa9aff9383c9 2026-04-02 16:01:25,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:01:25,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbefc82a64fa9aff9383c9 HTTP/1.1" 200 None 2026-04-02 16:01:25,410 - lava_callback - DEBUG - Processing node 69cbefc82a64fa9aff9383c9: baseline-arm64-baylibre 2026-04-02 16:01:25,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbefc82a64fa9aff9383c9 2026-04-02 16:01:25,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:01:25,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbefc82a64fa9aff9383c9 HTTP/1.1" 200 None 2026-04-02 16:01:25,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:01:25,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:01:25,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:01:25,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbefc82a64fa9aff9383c9 HTTP/1.1" 200 None 2026-04-02 16:01:25,467 - lava_callback - ERROR - Error processing callback for node 69cbefc82a64fa9aff9383c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:02:45,459 - lava_callback - INFO - Received callback for node 69cbf01d2a64fa9aff9383d5 INFO: 172.21.0.1:57028 - "POST /node/69cbf01d2a64fa9aff9383d5 HTTP/1.0" 202 Accepted 2026-04-02 16:02:45,464 - lava_callback - INFO - Starting async job submit for node 69cbf01d2a64fa9aff9383d5 2026-04-02 16:02:45,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:02:45,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf01d2a64fa9aff9383d5 HTTP/1.1" 200 None 2026-04-02 16:02:45,480 - lava_callback - DEBUG - Processing node 69cbf01d2a64fa9aff9383d5: baseline-arm64-baylibre 2026-04-02 16:02:45,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf01d2a64fa9aff9383d5 2026-04-02 16:02:45,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:02:45,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf01d2a64fa9aff9383d5 HTTP/1.1" 200 None 2026-04-02 16:02:45,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:02:45,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:02:45,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:02:45,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf01d2a64fa9aff9383d5 HTTP/1.1" 200 None 2026-04-02 16:02:45,542 - lava_callback - ERROR - Error processing callback for node 69cbf01d2a64fa9aff9383d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:04:29,407 - lava_callback - INFO - Received callback for node 69cbf0782a64fa9aff9383e2 INFO: 172.21.0.1:49630 - "POST /node/69cbf0782a64fa9aff9383e2 HTTP/1.0" 202 Accepted 2026-04-02 16:04:29,414 - lava_callback - INFO - Starting async job submit for node 69cbf0782a64fa9aff9383e2 2026-04-02 16:04:29,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:04:29,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf0782a64fa9aff9383e2 HTTP/1.1" 200 None 2026-04-02 16:04:29,435 - lava_callback - DEBUG - Processing node 69cbf0782a64fa9aff9383e2: baseline-arm64-clabbe 2026-04-02 16:04:29,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf0782a64fa9aff9383e2 2026-04-02 16:04:29,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:04:29,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf0782a64fa9aff9383e2 HTTP/1.1" 200 None 2026-04-02 16:04:29,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:04:29,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:04:29,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:04:29,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf0782a64fa9aff9383e2 HTTP/1.1" 200 None 2026-04-02 16:04:29,504 - lava_callback - ERROR - Error processing callback for node 69cbf0782a64fa9aff9383e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:05:49,434 - lava_callback - INFO - Received callback for node 69cbf0cf2a64fa9aff9383f1 INFO: 172.21.0.1:53048 - "POST /node/69cbf0cf2a64fa9aff9383f1 HTTP/1.0" 202 Accepted 2026-04-02 16:05:49,441 - lava_callback - INFO - Starting async job submit for node 69cbf0cf2a64fa9aff9383f1 2026-04-02 16:05:49,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:05:49,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf0cf2a64fa9aff9383f1 HTTP/1.1" 200 None 2026-04-02 16:05:49,456 - lava_callback - DEBUG - Processing node 69cbf0cf2a64fa9aff9383f1: baseline-arm64-clabbe 2026-04-02 16:05:49,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf0cf2a64fa9aff9383f1 2026-04-02 16:05:49,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:05:49,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf0cf2a64fa9aff9383f1 HTTP/1.1" 200 None 2026-04-02 16:05:49,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:05:49,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:05:49,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:05:49,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf0cf2a64fa9aff9383f1 HTTP/1.1" 200 None 2026-04-02 16:05:49,507 - lava_callback - ERROR - Error processing callback for node 69cbf0cf2a64fa9aff9383f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:07:05,736 - lava_callback - INFO - Received callback for node 69cbf11e2a64fa9aff9383fa INFO: 172.21.0.1:56670 - "POST /node/69cbf11e2a64fa9aff9383fa HTTP/1.0" 202 Accepted 2026-04-02 16:07:05,742 - lava_callback - INFO - Starting async job submit for node 69cbf11e2a64fa9aff9383fa 2026-04-02 16:07:05,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:07:05,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf11e2a64fa9aff9383fa HTTP/1.1" 200 None 2026-04-02 16:07:05,758 - lava_callback - DEBUG - Processing node 69cbf11e2a64fa9aff9383fa: baseline-arm64-baylibre 2026-04-02 16:07:05,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf11e2a64fa9aff9383fa 2026-04-02 16:07:05,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:07:05,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf11e2a64fa9aff9383fa HTTP/1.1" 200 None 2026-04-02 16:07:05,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:07:05,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:07:05,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:07:05,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf11e2a64fa9aff9383fa HTTP/1.1" 200 None 2026-04-02 16:07:05,810 - lava_callback - ERROR - Error processing callback for node 69cbf11e2a64fa9aff9383fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:08:29,532 - lava_callback - INFO - Received callback for node 69cbf17a2a64fa9aff938404 INFO: 172.21.0.1:50476 - "POST /node/69cbf17a2a64fa9aff938404 HTTP/1.0" 202 Accepted 2026-04-02 16:08:29,537 - lava_callback - INFO - Starting async job submit for node 69cbf17a2a64fa9aff938404 2026-04-02 16:08:29,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:08:29,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf17a2a64fa9aff938404 HTTP/1.1" 200 None 2026-04-02 16:08:29,553 - lava_callback - DEBUG - Processing node 69cbf17a2a64fa9aff938404: baseline-arm64-clabbe 2026-04-02 16:08:29,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf17a2a64fa9aff938404 2026-04-02 16:08:29,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:08:29,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf17a2a64fa9aff938404 HTTP/1.1" 200 None 2026-04-02 16:08:29,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:08:29,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:08:29,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:08:29,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf17a2a64fa9aff938404 HTTP/1.1" 200 None 2026-04-02 16:08:29,611 - lava_callback - ERROR - Error processing callback for node 69cbf17a2a64fa9aff938404: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:09:45,815 - lava_callback - INFO - Received callback for node 69cbf1c72a64fa9aff938411 INFO: 172.21.0.1:32926 - "POST /node/69cbf1c72a64fa9aff938411 HTTP/1.0" 202 Accepted 2026-04-02 16:09:45,821 - lava_callback - INFO - Starting async job submit for node 69cbf1c72a64fa9aff938411 2026-04-02 16:09:45,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:09:45,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf1c72a64fa9aff938411 HTTP/1.1" 200 None 2026-04-02 16:09:45,836 - lava_callback - DEBUG - Processing node 69cbf1c72a64fa9aff938411: baseline-arm64-baylibre 2026-04-02 16:09:45,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf1c72a64fa9aff938411 2026-04-02 16:09:45,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:09:45,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf1c72a64fa9aff938411 HTTP/1.1" 200 None 2026-04-02 16:09:45,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:09:45,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:09:45,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:09:45,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf1c72a64fa9aff938411 HTTP/1.1" 200 None 2026-04-02 16:09:45,910 - lava_callback - ERROR - Error processing callback for node 69cbf1c72a64fa9aff938411: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:11:29,704 - lava_callback - INFO - Received callback for node 69cbf2202a64fa9aff93841c INFO: 172.21.0.1:43472 - "POST /node/69cbf2202a64fa9aff93841c HTTP/1.0" 202 Accepted 2026-04-02 16:11:29,709 - lava_callback - INFO - Starting async job submit for node 69cbf2202a64fa9aff93841c 2026-04-02 16:11:29,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:11:29,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf2202a64fa9aff93841c HTTP/1.1" 200 None 2026-04-02 16:11:29,732 - lava_callback - DEBUG - Processing node 69cbf2202a64fa9aff93841c: baseline-arm64-clabbe 2026-04-02 16:11:29,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf2202a64fa9aff93841c 2026-04-02 16:11:29,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:11:29,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf2202a64fa9aff93841c HTTP/1.1" 200 None 2026-04-02 16:11:29,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:11:29,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:11:29,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:11:29,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf2202a64fa9aff93841c HTTP/1.1" 200 None 2026-04-02 16:11:29,809 - lava_callback - ERROR - Error processing callback for node 69cbf2202a64fa9aff93841c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:12:49,727 - lava_callback - INFO - Received callback for node 69cbf2772a64fa9aff938427 INFO: 172.21.0.1:43900 - "POST /node/69cbf2772a64fa9aff938427 HTTP/1.0" 202 Accepted 2026-04-02 16:12:49,733 - lava_callback - INFO - Starting async job submit for node 69cbf2772a64fa9aff938427 2026-04-02 16:12:49,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:12:49,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf2772a64fa9aff938427 HTTP/1.1" 200 None 2026-04-02 16:12:49,757 - lava_callback - DEBUG - Processing node 69cbf2772a64fa9aff938427: baseline-arm64-clabbe 2026-04-02 16:12:49,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf2772a64fa9aff938427 2026-04-02 16:12:49,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:12:49,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf2772a64fa9aff938427 HTTP/1.1" 200 None 2026-04-02 16:12:49,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:12:49,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:12:49,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:12:49,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf2772a64fa9aff938427 HTTP/1.1" 200 None 2026-04-02 16:12:49,809 - lava_callback - ERROR - Error processing callback for node 69cbf2772a64fa9aff938427: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1] INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:46814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50584 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57344 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59806 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:36:24,223 - lava_callback - INFO - Received callback for node 69ce2a0ecb08ea23a1f6827e 2026-04-02 08:36:24,234 - lava_callback - INFO - Starting async job submit for node 69ce2a0ecb08ea23a1f6827e INFO: 172.21.0.1:34672 - "POST /node/69ce2a0ecb08ea23a1f6827e HTTP/1.0" 202 Accepted 2026-04-02 08:36:24,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:36:24,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2a0ecb08ea23a1f6827e HTTP/1.1" 200 None 2026-04-02 08:36:24,324 - lava_callback - DEBUG - Processing node 69ce2a0ecb08ea23a1f6827e: baseline-arm 2026-04-02 08:36:24,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:36:25,005 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:36:25,007 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2a0ecb08ea23a1f6827e/log.txt.gz 2026-04-02 08:36:25,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:36:25,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:36:25,727 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2a0ecb08ea23a1f6827e/lava-logs.yaml 2026-04-02 08:36:25,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:36:26,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:36:26,229 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2a0ecb08ea23a1f6827e/lava_callback.json.gz 2026-04-02 08:36:26,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:36:26,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2a0ecb08ea23a1f6827e HTTP/1.1" 200 None 2026-04-02 08:36:26,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:36:26,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce266ecb08ea23a1f68074 HTTP/1.1" 200 None 2026-04-02 08:36:26,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:36:26,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2a0ecb08ea23a1f6827e HTTP/1.1" 200 None 2026-04-02 08:36:26,384 - lava_callback - INFO - Completed processing callback for node 69ce2a0ecb08ea23a1f6827e INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:36:56,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:36:56,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34464 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:37:01,710 - lava_callback - INFO - Received callback for node 69cb87a22a64fa9aff936f5f INFO: 172.21.0.1:54736 - "POST /node/69cb87a22a64fa9aff936f5f HTTP/1.0" 202 Accepted 2026-04-02 08:37:01,722 - lava_callback - INFO - Starting async job submit for node 69cb87a22a64fa9aff936f5f 2026-04-02 08:37:01,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:01,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87a22a64fa9aff936f5f HTTP/1.1" 200 None 2026-04-02 08:37:01,760 - lava_callback - DEBUG - Processing node 69cb87a22a64fa9aff936f5f: baseline-arm-baylibre 2026-04-02 08:37:01,761 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87a22a64fa9aff936f5f 2026-04-02 08:37:01,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:01,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87a22a64fa9aff936f5f HTTP/1.1" 200 None 2026-04-02 08:37:01,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:01,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:37:01,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:01,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87a22a64fa9aff936f5f HTTP/1.1" 200 None 2026-04-02 08:37:01,868 - lava_callback - ERROR - Error processing callback for node 69cb87a22a64fa9aff936f5f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:02,370 - lava_callback - INFO - Received callback for node 69cb87aa2a64fa9aff936f7c INFO: 172.21.0.1:54744 - "POST /node/69cb87aa2a64fa9aff936f7c HTTP/1.0" 202 Accepted 2026-04-02 08:37:02,380 - lava_callback - INFO - Starting async job submit for node 69cb87aa2a64fa9aff936f7c 2026-04-02 08:37:02,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:02,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87aa2a64fa9aff936f7c HTTP/1.1" 200 None 2026-04-02 08:37:02,406 - lava_callback - DEBUG - Processing node 69cb87aa2a64fa9aff936f7c: baseline-arm-baylibre 2026-04-02 08:37:02,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87aa2a64fa9aff936f7c 2026-04-02 08:37:02,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:02,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87aa2a64fa9aff936f7c HTTP/1.1" 200 None 2026-04-02 08:37:02,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:02,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:02,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:02,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87aa2a64fa9aff936f7c HTTP/1.1" 200 None 2026-04-02 08:37:02,505 - lava_callback - ERROR - Error processing callback for node 69cb87aa2a64fa9aff936f7c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:03,040 - lava_callback - INFO - Received callback for node 69cb87ab2a64fa9aff936f7f INFO: 172.21.0.1:54760 - "POST /node/69cb87ab2a64fa9aff936f7f HTTP/1.0" 202 Accepted 2026-04-02 08:37:03,050 - lava_callback - INFO - Starting async job submit for node 69cb87ab2a64fa9aff936f7f 2026-04-02 08:37:03,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:03,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ab2a64fa9aff936f7f HTTP/1.1" 200 None 2026-04-02 08:37:03,087 - lava_callback - DEBUG - Processing node 69cb87ab2a64fa9aff936f7f: baseline-arm-baylibre 2026-04-02 08:37:03,088 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87ab2a64fa9aff936f7f 2026-04-02 08:37:03,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:03,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ab2a64fa9aff936f7f HTTP/1.1" 200 None 2026-04-02 08:37:03,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:03,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:03,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:03,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87ab2a64fa9aff936f7f HTTP/1.1" 200 None 2026-04-02 08:37:03,190 - lava_callback - ERROR - Error processing callback for node 69cb87ab2a64fa9aff936f7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34192 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34200 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:37:21,623 - lava_callback - INFO - Received callback for node 69cb87b12a64fa9aff936f90 INFO: 172.21.0.1:56244 - "POST /node/69cb87b12a64fa9aff936f90 HTTP/1.0" 202 Accepted 2026-04-02 08:37:21,629 - lava_callback - INFO - Starting async job submit for node 69cb87b12a64fa9aff936f90 2026-04-02 08:37:21,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:21,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87b12a64fa9aff936f90 HTTP/1.1" 200 None 2026-04-02 08:37:21,645 - lava_callback - DEBUG - Processing node 69cb87b12a64fa9aff936f90: baseline-arm-baylibre 2026-04-02 08:37:21,645 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87b12a64fa9aff936f90 2026-04-02 08:37:21,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:21,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87b12a64fa9aff936f90 HTTP/1.1" 200 None 2026-04-02 08:37:21,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:21,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:21,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:21,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87b12a64fa9aff936f90 HTTP/1.1" 200 None 2026-04-02 08:37:21,722 - lava_callback - ERROR - Error processing callback for node 69cb87b12a64fa9aff936f90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:22,310 - lava_callback - INFO - Received callback for node 69cb87ad2a64fa9aff936f82 INFO: 172.21.0.1:56258 - "POST /node/69cb87ad2a64fa9aff936f82 HTTP/1.0" 202 Accepted 2026-04-02 08:37:22,317 - lava_callback - INFO - Starting async job submit for node 69cb87ad2a64fa9aff936f82 2026-04-02 08:37:22,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:22,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ad2a64fa9aff936f82 HTTP/1.1" 200 None 2026-04-02 08:37:22,341 - lava_callback - DEBUG - Processing node 69cb87ad2a64fa9aff936f82: baseline-arm-baylibre 2026-04-02 08:37:22,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87ad2a64fa9aff936f82 2026-04-02 08:37:22,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:22,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ad2a64fa9aff936f82 HTTP/1.1" 200 None 2026-04-02 08:37:22,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:22,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:22,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:22,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87ad2a64fa9aff936f82 HTTP/1.1" 200 None 2026-04-02 08:37:22,419 - lava_callback - ERROR - Error processing callback for node 69cb87ad2a64fa9aff936f82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:22,954 - lava_callback - INFO - Received callback for node 69cb87ae2a64fa9aff936f85 INFO: 172.21.0.1:56272 - "POST /node/69cb87ae2a64fa9aff936f85 HTTP/1.0" 202 Accepted 2026-04-02 08:37:22,961 - lava_callback - INFO - Starting async job submit for node 69cb87ae2a64fa9aff936f85 2026-04-02 08:37:22,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:22,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ae2a64fa9aff936f85 HTTP/1.1" 200 None 2026-04-02 08:37:22,979 - lava_callback - DEBUG - Processing node 69cb87ae2a64fa9aff936f85: baseline-arm-baylibre 2026-04-02 08:37:22,979 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87ae2a64fa9aff936f85 2026-04-02 08:37:22,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87ae2a64fa9aff936f85 HTTP/1.1" 200 None 2026-04-02 08:37:23,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:23,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87ae2a64fa9aff936f85 HTTP/1.1" 200 None 2026-04-02 08:37:23,045 - lava_callback - ERROR - Error processing callback for node 69cb87ae2a64fa9aff936f85: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:23,615 - lava_callback - INFO - Received callback for node 69cb87b22a64fa9aff936f98 INFO: 172.21.0.1:56288 - "POST /node/69cb87b22a64fa9aff936f98 HTTP/1.0" 202 Accepted 2026-04-02 08:37:23,621 - lava_callback - INFO - Starting async job submit for node 69cb87b22a64fa9aff936f98 2026-04-02 08:37:23,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87b22a64fa9aff936f98 HTTP/1.1" 200 None 2026-04-02 08:37:23,637 - lava_callback - DEBUG - Processing node 69cb87b22a64fa9aff936f98: baseline-arm-baylibre 2026-04-02 08:37:23,637 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87b22a64fa9aff936f98 2026-04-02 08:37:23,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87b22a64fa9aff936f98 HTTP/1.1" 200 None 2026-04-02 08:37:23,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:23,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:23,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87b22a64fa9aff936f98 HTTP/1.1" 200 None 2026-04-02 08:37:23,699 - lava_callback - ERROR - Error processing callback for node 69cb87b22a64fa9aff936f98: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:37:30,462 - lava_callback - INFO - Received callback for node 69cb87bb2a64fa9aff936fd6 INFO: 172.21.0.1:34976 - "POST /node/69cb87bb2a64fa9aff936fd6 HTTP/1.0" 202 Accepted 2026-04-02 08:37:30,479 - lava_callback - INFO - Starting async job submit for node 69cb87bb2a64fa9aff936fd6 2026-04-02 08:37:30,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:30,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87bb2a64fa9aff936fd6 HTTP/1.1" 200 None 2026-04-02 08:37:30,538 - lava_callback - DEBUG - Processing node 69cb87bb2a64fa9aff936fd6: baseline-arm-clabbe 2026-04-02 08:37:30,538 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87bb2a64fa9aff936fd6 2026-04-02 08:37:30,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:30,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87bb2a64fa9aff936fd6 HTTP/1.1" 200 None 2026-04-02 08:37:30,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:30,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:30,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:30,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87bb2a64fa9aff936fd6 HTTP/1.1" 200 None 2026-04-02 08:37:30,669 - lava_callback - ERROR - Error processing callback for node 69cb87bb2a64fa9aff936fd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:31,143 - lava_callback - INFO - Received callback for node 69cb87c02a64fa9aff936fe3 INFO: 172.21.0.1:34980 - "POST /node/69cb87c02a64fa9aff936fe3 HTTP/1.0" 202 Accepted 2026-04-02 08:37:31,149 - lava_callback - INFO - Starting async job submit for node 69cb87c02a64fa9aff936fe3 2026-04-02 08:37:31,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c02a64fa9aff936fe3 HTTP/1.1" 200 None 2026-04-02 08:37:31,166 - lava_callback - DEBUG - Processing node 69cb87c02a64fa9aff936fe3: baseline-arm-clabbe 2026-04-02 08:37:31,166 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87c02a64fa9aff936fe3 2026-04-02 08:37:31,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c02a64fa9aff936fe3 HTTP/1.1" 200 None 2026-04-02 08:37:31,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:31,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87c02a64fa9aff936fe3 HTTP/1.1" 200 None 2026-04-02 08:37:31,261 - lava_callback - ERROR - Error processing callback for node 69cb87c02a64fa9aff936fe3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:31,809 - lava_callback - INFO - Received callback for node 69cb87c12a64fa9aff936fe6 INFO: 172.21.0.1:34996 - "POST /node/69cb87c12a64fa9aff936fe6 HTTP/1.0" 202 Accepted 2026-04-02 08:37:31,815 - lava_callback - INFO - Starting async job submit for node 69cb87c12a64fa9aff936fe6 2026-04-02 08:37:31,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c12a64fa9aff936fe6 HTTP/1.1" 200 None 2026-04-02 08:37:31,834 - lava_callback - DEBUG - Processing node 69cb87c12a64fa9aff936fe6: baseline-arm-clabbe 2026-04-02 08:37:31,834 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87c12a64fa9aff936fe6 2026-04-02 08:37:31,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c12a64fa9aff936fe6 HTTP/1.1" 200 None 2026-04-02 08:37:31,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:31,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:31,884 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87c12a64fa9aff936fe6 HTTP/1.1" 200 None 2026-04-02 08:37:31,889 - lava_callback - ERROR - Error processing callback for node 69cb87c12a64fa9aff936fe6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:32,479 - lava_callback - INFO - Received callback for node 69cb87c22a64fa9aff936fe9 INFO: 172.21.0.1:35010 - "POST /node/69cb87c22a64fa9aff936fe9 HTTP/1.0" 202 Accepted 2026-04-02 08:37:32,485 - lava_callback - INFO - Starting async job submit for node 69cb87c22a64fa9aff936fe9 2026-04-02 08:37:32,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:32,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c22a64fa9aff936fe9 HTTP/1.1" 200 None 2026-04-02 08:37:32,504 - lava_callback - DEBUG - Processing node 69cb87c22a64fa9aff936fe9: baseline-arm-clabbe 2026-04-02 08:37:32,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87c22a64fa9aff936fe9 2026-04-02 08:37:32,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:32,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c22a64fa9aff936fe9 HTTP/1.1" 200 None 2026-04-02 08:37:32,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:32,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:32,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:32,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87c22a64fa9aff936fe9 HTTP/1.1" 200 None 2026-04-02 08:37:32,560 - lava_callback - ERROR - Error processing callback for node 69cb87c22a64fa9aff936fe9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:37:33,170 - lava_callback - INFO - Received callback for node 69cb87c52a64fa9aff936ff2 INFO: 172.21.0.1:35026 - "POST /node/69cb87c52a64fa9aff936ff2 HTTP/1.0" 202 Accepted 2026-04-02 08:37:33,176 - lava_callback - INFO - Starting async job submit for node 69cb87c52a64fa9aff936ff2 2026-04-02 08:37:33,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:33,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c52a64fa9aff936ff2 HTTP/1.1" 200 None 2026-04-02 08:37:33,195 - lava_callback - DEBUG - Processing node 69cb87c52a64fa9aff936ff2: baseline-arm-clabbe 2026-04-02 08:37:33,196 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87c52a64fa9aff936ff2 2026-04-02 08:37:33,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:33,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c52a64fa9aff936ff2 HTTP/1.1" 200 None 2026-04-02 08:37:33,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:33,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 08:37:33,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:33,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87c52a64fa9aff936ff2 HTTP/1.1" 200 None 2026-04-02 08:37:33,272 - lava_callback - ERROR - Error processing callback for node 69cb87c52a64fa9aff936ff2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35042 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:37:41,642 - lava_callback - INFO - Received callback for node 69cb87c82a64fa9aff936ffd INFO: 172.21.0.1:33222 - "POST /node/69cb87c82a64fa9aff936ffd HTTP/1.0" 202 Accepted 2026-04-02 08:37:41,649 - lava_callback - INFO - Starting async job submit for node 69cb87c82a64fa9aff936ffd 2026-04-02 08:37:41,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:41,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c82a64fa9aff936ffd HTTP/1.1" 200 None 2026-04-02 08:37:41,667 - lava_callback - DEBUG - Processing node 69cb87c82a64fa9aff936ffd: baseline-arm-baylibre 2026-04-02 08:37:41,668 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb87c82a64fa9aff936ffd 2026-04-02 08:37:41,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:41,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb87c82a64fa9aff936ffd HTTP/1.1" 200 None 2026-04-02 08:37:41,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:41,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:37:41,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:37:41,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb87c82a64fa9aff936ffd HTTP/1.1" 200 None 2026-04-02 08:37:41,757 - lava_callback - ERROR - Error processing callback for node 69cb87c82a64fa9aff936ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:38:49,731 - lava_callback - INFO - Received callback for node 69ce2b09cb08ea23a1f682cf INFO: 172.21.0.1:44218 - "POST /node/69ce2b09cb08ea23a1f682cf HTTP/1.0" 202 Accepted 2026-04-02 08:38:49,737 - lava_callback - INFO - Starting async job submit for node 69ce2b09cb08ea23a1f682cf 2026-04-02 08:38:49,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:38:49,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b09cb08ea23a1f682cf HTTP/1.1" 200 None 2026-04-02 08:38:49,755 - lava_callback - DEBUG - Processing node 69ce2b09cb08ea23a1f682cf: baseline-arm 2026-04-02 08:38:49,760 - lava_callback - WARNING - Failed to upload log 2026-04-02 08:38:49,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:38:49,880 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:38:49,882 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b09cb08ea23a1f682cf/lava-logs.yaml 2026-04-02 08:38:49,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:38:49,997 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:38:49,998 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b09cb08ea23a1f682cf/lava_callback.json.gz 2026-04-02 08:38:50,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:38:50,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b09cb08ea23a1f682cf HTTP/1.1" 200 None 2026-04-02 08:38:50,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:38:50,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:38:50,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:38:50,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b09cb08ea23a1f682cf HTTP/1.1" 200 None 2026-04-02 08:38:50,096 - lava_callback - INFO - Completed processing callback for node 69ce2b09cb08ea23a1f682cf 2026-04-02 08:38:56,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:38:56,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:39:05,835 - lava_callback - INFO - Received callback for node 69ce2b0acb08ea23a1f682d2 INFO: 172.21.0.1:60382 - "POST /node/69ce2b0acb08ea23a1f682d2 HTTP/1.0" 202 Accepted 2026-04-02 08:39:05,882 - lava_callback - INFO - Starting async job submit for node 69ce2b0acb08ea23a1f682d2 2026-04-02 08:39:05,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:05,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0acb08ea23a1f682d2 HTTP/1.1" 200 None 2026-04-02 08:39:05,916 - lava_callback - DEBUG - Processing node 69ce2b0acb08ea23a1f682d2: baseline-arm 2026-04-02 08:39:06,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:39:06,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:06,188 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0acb08ea23a1f682d2/log.txt.gz 2026-04-02 08:39:06,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:60396 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:39:06,620 - lava_callback - INFO - Received callback for node 69ce2b0dcb08ea23a1f682db 2026-04-02 08:39:06,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:06,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0acb08ea23a1f682d2/lava-logs.yaml 2026-04-02 08:39:06,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:39:06,677 - lava_callback - INFO - Starting async job submit for node 69ce2b0dcb08ea23a1f682db INFO: 172.21.0.1:60412 - "POST /node/69ce2b0dcb08ea23a1f682db HTTP/1.0" 202 Accepted 2026-04-02 08:39:06,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:06,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0dcb08ea23a1f682db HTTP/1.1" 200 None 2026-04-02 08:39:06,772 - lava_callback - DEBUG - Processing node 69ce2b0dcb08ea23a1f682db: baseline-arm 2026-04-02 08:39:06,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:06,946 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0acb08ea23a1f682d2/lava_callback.json.gz 2026-04-02 08:39:06,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:06,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:39:06,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0acb08ea23a1f682d2 HTTP/1.1" 200 None 2026-04-02 08:39:06,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:06,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:39:07,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:07,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b0acb08ea23a1f682d2 HTTP/1.1" 200 None 2026-04-02 08:39:07,039 - lava_callback - INFO - Completed processing callback for node 69ce2b0acb08ea23a1f682d2 2026-04-02 08:39:07,127 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:07,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0dcb08ea23a1f682db/log.txt.gz 2026-04-02 08:39:07,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:39:07,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:07,494 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0dcb08ea23a1f682db/lava-logs.yaml 2026-04-02 08:39:07,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:39:07,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:39:07,629 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0dcb08ea23a1f682db/lava_callback.json.gz 2026-04-02 08:39:07,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:07,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0dcb08ea23a1f682db HTTP/1.1" 200 None 2026-04-02 08:39:07,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:07,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:39:07,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:07,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b0dcb08ea23a1f682db HTTP/1.1" 200 None 2026-04-02 08:39:07,715 - lava_callback - INFO - Completed processing callback for node 69ce2b0dcb08ea23a1f682db INFO: 172.21.0.1:36254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:39:26,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:26,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60162 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:39:41,836 - lava_callback - INFO - Received callback for node 69cb883b2a64fa9aff9370d2 INFO: 172.21.0.1:52088 - "POST /node/69cb883b2a64fa9aff9370d2 HTTP/1.0" 202 Accepted 2026-04-02 08:39:41,845 - lava_callback - INFO - Starting async job submit for node 69cb883b2a64fa9aff9370d2 2026-04-02 08:39:41,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:41,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb883b2a64fa9aff9370d2 HTTP/1.1" 200 None 2026-04-02 08:39:41,871 - lava_callback - DEBUG - Processing node 69cb883b2a64fa9aff9370d2: baseline-arm-baylibre 2026-04-02 08:39:41,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb883b2a64fa9aff9370d2 2026-04-02 08:39:41,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:41,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb883b2a64fa9aff9370d2 HTTP/1.1" 200 None 2026-04-02 08:39:41,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:41,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:39:41,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:39:41,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb883b2a64fa9aff9370d2 HTTP/1.1" 200 None 2026-04-02 08:39:41,937 - lava_callback - ERROR - Error processing callback for node 69cb883b2a64fa9aff9370d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45388 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:40:08,538 - lava_callback - INFO - Received callback for node 69ce2b09cb08ea23a1f682cc INFO: 172.21.0.1:45402 - "POST /node/69ce2b09cb08ea23a1f682cc HTTP/1.0" 202 Accepted 2026-04-02 08:40:08,544 - lava_callback - INFO - Starting async job submit for node 69ce2b09cb08ea23a1f682cc 2026-04-02 08:40:08,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:08,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b09cb08ea23a1f682cc HTTP/1.1" 200 None 2026-04-02 08:40:08,580 - lava_callback - DEBUG - Processing node 69ce2b09cb08ea23a1f682cc: baseline-arm 2026-04-02 08:40:08,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:08,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:08,934 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b09cb08ea23a1f682cc/log.txt.gz 2026-04-02 08:40:09,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:09,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:09,234 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b09cb08ea23a1f682cc/lava-logs.yaml 2026-04-02 08:40:09,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:09,490 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:09,491 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b09cb08ea23a1f682cc/lava_callback.json.gz 2026-04-02 08:40:09,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:09,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b09cb08ea23a1f682cc HTTP/1.1" 200 None 2026-04-02 08:40:09,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:09,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:40:09,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:09,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b09cb08ea23a1f682cc HTTP/1.1" 200 None 2026-04-02 08:40:09,585 - lava_callback - INFO - Completed processing callback for node 69ce2b09cb08ea23a1f682cc 2026-04-02 08:40:10,755 - lava_callback - INFO - Received callback for node 69cb88652a64fa9aff9370ec INFO: 172.21.0.1:59644 - "POST /node/69cb88652a64fa9aff9370ec HTTP/1.0" 202 Accepted 2026-04-02 08:40:10,761 - lava_callback - INFO - Starting async job submit for node 69cb88652a64fa9aff9370ec 2026-04-02 08:40:10,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:10,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88652a64fa9aff9370ec HTTP/1.1" 200 None 2026-04-02 08:40:10,777 - lava_callback - DEBUG - Processing node 69cb88652a64fa9aff9370ec: baseline-arm-clabbe 2026-04-02 08:40:10,777 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb88652a64fa9aff9370ec 2026-04-02 08:40:10,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:10,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88652a64fa9aff9370ec HTTP/1.1" 200 None 2026-04-02 08:40:10,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:10,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:40:10,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:10,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb88652a64fa9aff9370ec HTTP/1.1" 200 None 2026-04-02 08:40:10,869 - lava_callback - ERROR - Error processing callback for node 69cb88652a64fa9aff9370ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59662 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:40:17,778 - lava_callback - INFO - Received callback for node 69ce2b30cb08ea23a1f6836f INFO: 172.21.0.1:59674 - "POST /node/69ce2b30cb08ea23a1f6836f HTTP/1.0" 202 Accepted 2026-04-02 08:40:17,825 - lava_callback - INFO - Starting async job submit for node 69ce2b30cb08ea23a1f6836f 2026-04-02 08:40:17,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:17,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b30cb08ea23a1f6836f HTTP/1.1" 200 None 2026-04-02 08:40:17,860 - lava_callback - DEBUG - Processing node 69ce2b30cb08ea23a1f6836f: baseline-arm-pengutronix 2026-04-02 08:40:17,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:18,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:18,082 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b30cb08ea23a1f6836f/log.txt.gz 2026-04-02 08:40:18,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:18,299 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:18,301 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b30cb08ea23a1f6836f/lava-logs.yaml 2026-04-02 08:40:18,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:18,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:18,423 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b30cb08ea23a1f6836f/lava_callback.json.gz 2026-04-02 08:40:18,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:18,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b30cb08ea23a1f6836f HTTP/1.1" 200 None 2026-04-02 08:40:18,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:18,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:40:18,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:18,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b30cb08ea23a1f6836f HTTP/1.1" 200 None 2026-04-02 08:40:18,504 - lava_callback - INFO - Completed processing callback for node 69ce2b30cb08ea23a1f6836f 2026-04-02 08:40:23,504 - lava_callback - INFO - Received callback for node 69ce2b2dcb08ea23a1f68369 INFO: 172.21.0.1:49602 - "POST /node/69ce2b2dcb08ea23a1f68369 HTTP/1.0" 202 Accepted 2026-04-02 08:40:23,510 - lava_callback - INFO - Starting async job submit for node 69ce2b2dcb08ea23a1f68369 2026-04-02 08:40:23,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:23,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2dcb08ea23a1f68369 HTTP/1.1" 200 None 2026-04-02 08:40:23,544 - lava_callback - DEBUG - Processing node 69ce2b2dcb08ea23a1f68369: baseline-arm-pengutronix 2026-04-02 08:40:23,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:23,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:23,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2dcb08ea23a1f68369/log.txt.gz 2026-04-02 08:40:23,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:24,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:24,114 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2dcb08ea23a1f68369/lava-logs.yaml 2026-04-02 08:40:24,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:24,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:24,250 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2dcb08ea23a1f68369/lava_callback.json.gz 2026-04-02 08:40:24,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:24,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2dcb08ea23a1f68369 HTTP/1.1" 200 None 2026-04-02 08:40:24,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:24,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:40:24,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:24,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b2dcb08ea23a1f68369 HTTP/1.1" 200 None 2026-04-02 08:40:24,338 - lava_callback - INFO - Completed processing callback for node 69ce2b2dcb08ea23a1f68369 2026-04-02 08:40:26,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:26,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55794 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:40:43,982 - lava_callback - INFO - Received callback for node 69ce2b23cb08ea23a1f68322 INFO: 172.21.0.1:40016 - "POST /node/69ce2b23cb08ea23a1f68322 HTTP/1.0" 202 Accepted 2026-04-02 08:40:43,988 - lava_callback - INFO - Starting async job submit for node 69ce2b23cb08ea23a1f68322 2026-04-02 08:40:44,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:44,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b23cb08ea23a1f68322 HTTP/1.1" 200 None 2026-04-02 08:40:44,025 - lava_callback - DEBUG - Processing node 69ce2b23cb08ea23a1f68322: baseline-arm-clabbe 2026-04-02 08:40:44,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:44,338 - lava_callback - INFO - Received callback for node 69ce2b1bcb08ea23a1f68308 INFO: 172.21.0.1:40018 - "POST /node/69ce2b1bcb08ea23a1f68308 HTTP/1.0" 202 Accepted 2026-04-02 08:40:44,344 - lava_callback - INFO - Starting async job submit for node 69ce2b1bcb08ea23a1f68308 2026-04-02 08:40:44,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:44,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:44,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b23cb08ea23a1f68322/log.txt.gz 2026-04-02 08:40:44,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1bcb08ea23a1f68308 HTTP/1.1" 200 None 2026-04-02 08:40:44,463 - lava_callback - DEBUG - Processing node 69ce2b1bcb08ea23a1f68308: baseline-arm-broonie 2026-04-02 08:40:44,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:44,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:44,931 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:44,932 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1bcb08ea23a1f68308/log.txt.gz 2026-04-02 08:40:44,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:44,987 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b23cb08ea23a1f68322/lava-logs.yaml 2026-04-02 08:40:45,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:45,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:45,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:45,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b23cb08ea23a1f68322/lava_callback.json.gz 2026-04-02 08:40:45,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:45,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,279 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1bcb08ea23a1f68308/lava-logs.yaml 2026-04-02 08:40:45,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:40:45,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b23cb08ea23a1f68322 HTTP/1.1" 200 None 2026-04-02 08:40:45,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:40:45,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b23cb08ea23a1f68322 HTTP/1.1" 200 None 2026-04-02 08:40:45,349 - lava_callback - INFO - Completed processing callback for node 69ce2b23cb08ea23a1f68322 2026-04-02 08:40:45,480 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:40:45,482 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1bcb08ea23a1f68308/lava_callback.json.gz 2026-04-02 08:40:45,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1bcb08ea23a1f68308 HTTP/1.1" 200 None 2026-04-02 08:40:45,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:40:45,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:45,568 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b1bcb08ea23a1f68308 HTTP/1.1" 200 None 2026-04-02 08:40:45,575 - lava_callback - INFO - Completed processing callback for node 69ce2b1bcb08ea23a1f68308 INFO: 172.21.0.1:40022 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:40:56,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:40:56,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:01,814 - lava_callback - INFO - Received callback for node 69cb888a2a64fa9aff937107 INFO: 172.21.0.1:58710 - "POST /node/69cb888a2a64fa9aff937107 HTTP/1.0" 202 Accepted 2026-04-02 08:41:01,820 - lava_callback - INFO - Starting async job submit for node 69cb888a2a64fa9aff937107 2026-04-02 08:41:01,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:01,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb888a2a64fa9aff937107 HTTP/1.1" 200 None 2026-04-02 08:41:01,837 - lava_callback - DEBUG - Processing node 69cb888a2a64fa9aff937107: baseline-arm-baylibre 2026-04-02 08:41:01,837 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb888a2a64fa9aff937107 2026-04-02 08:41:01,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:01,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb888a2a64fa9aff937107 HTTP/1.1" 200 None 2026-04-02 08:41:01,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:01,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:41:01,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:01,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb888a2a64fa9aff937107 HTTP/1.1" 200 None 2026-04-02 08:41:01,893 - lava_callback - ERROR - Error processing callback for node 69cb888a2a64fa9aff937107: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:41:05,591 - lava_callback - INFO - Received callback for node 69ce2b1dcb08ea23a1f6830b INFO: 172.21.0.1:58724 - "POST /node/69ce2b1dcb08ea23a1f6830b HTTP/1.0" 202 Accepted 2026-04-02 08:41:05,597 - lava_callback - INFO - Starting async job submit for node 69ce2b1dcb08ea23a1f6830b 2026-04-02 08:41:05,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:05,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1dcb08ea23a1f6830b HTTP/1.1" 200 None 2026-04-02 08:41:05,636 - lava_callback - DEBUG - Processing node 69ce2b1dcb08ea23a1f6830b: baseline-arm-broonie 2026-04-02 08:41:05,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:41:06,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:06,146 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1dcb08ea23a1f6830b/log.txt.gz 2026-04-02 08:41:06,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:41:06,481 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:06,482 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1dcb08ea23a1f6830b/lava-logs.yaml 2026-04-02 08:41:06,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58736 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:06,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:06,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1dcb08ea23a1f6830b/lava_callback.json.gz 2026-04-02 08:41:06,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:06,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1dcb08ea23a1f6830b HTTP/1.1" 200 None 2026-04-02 08:41:06,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:06,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:41:06,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:06,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b1dcb08ea23a1f6830b HTTP/1.1" 200 None 2026-04-02 08:41:06,748 - lava_callback - INFO - Completed processing callback for node 69ce2b1dcb08ea23a1f6830b INFO: 172.21.0.1:43902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:26,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:40436 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:26,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:30,446 - lava_callback - INFO - Received callback for node 69cb88b42a64fa9aff937111 INFO: 172.21.0.1:39576 - "POST /node/69cb88b42a64fa9aff937111 HTTP/1.0" 202 Accepted 2026-04-02 08:41:30,454 - lava_callback - INFO - Starting async job submit for node 69cb88b42a64fa9aff937111 2026-04-02 08:41:30,456 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:30,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88b42a64fa9aff937111 HTTP/1.1" 200 None 2026-04-02 08:41:30,484 - lava_callback - DEBUG - Processing node 69cb88b42a64fa9aff937111: baseline-arm-clabbe 2026-04-02 08:41:30,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb88b42a64fa9aff937111 2026-04-02 08:41:30,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:30,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88b42a64fa9aff937111 HTTP/1.1" 200 None 2026-04-02 08:41:30,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:30,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:41:30,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:30,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb88b42a64fa9aff937111 HTTP/1.1" 200 None 2026-04-02 08:41:30,544 - lava_callback - ERROR - Error processing callback for node 69cb88b42a64fa9aff937111: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39592 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:38,062 - lava_callback - INFO - Received callback for node 69ce2b2ccb08ea23a1f68366 INFO: 172.21.0.1:39596 - "POST /node/69ce2b2ccb08ea23a1f68366 HTTP/1.0" 202 Accepted 2026-04-02 08:41:38,068 - lava_callback - INFO - Starting async job submit for node 69ce2b2ccb08ea23a1f68366 2026-04-02 08:41:38,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:38,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2ccb08ea23a1f68366 HTTP/1.1" 200 None 2026-04-02 08:41:38,104 - lava_callback - DEBUG - Processing node 69ce2b2ccb08ea23a1f68366: baseline-arm-pengutronix 2026-04-02 08:41:38,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:41:38,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:38,585 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ccb08ea23a1f68366/log.txt.gz 2026-04-02 08:41:38,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:41:38,878 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:38,880 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ccb08ea23a1f68366/lava-logs.yaml 2026-04-02 08:41:38,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:41:39,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:41:39,370 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ccb08ea23a1f68366/lava_callback.json.gz 2026-04-02 08:41:39,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:39,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2ccb08ea23a1f68366 HTTP/1.1" 200 None 2026-04-02 08:41:39,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:39,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:41:39,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:39,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b2ccb08ea23a1f68366 HTTP/1.1" 200 None 2026-04-02 08:41:39,495 - lava_callback - INFO - Completed processing callback for node 69ce2b2ccb08ea23a1f68366 INFO: 172.21.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58266 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:41:56,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:41:56,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57726 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:14,069 - lava_callback - INFO - Received callback for node 69ce2b0ccb08ea23a1f682d8 INFO: 172.21.0.1:53260 - "POST /node/69ce2b0ccb08ea23a1f682d8 HTTP/1.0" 202 Accepted 2026-04-02 08:42:14,079 - lava_callback - INFO - Starting async job submit for node 69ce2b0ccb08ea23a1f682d8 2026-04-02 08:42:14,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:14,159 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0ccb08ea23a1f682d8 HTTP/1.1" 200 None 2026-04-02 08:42:14,160 - lava_callback - DEBUG - Processing node 69ce2b0ccb08ea23a1f682d8: baseline-arm 2026-04-02 08:42:14,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53264 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 08:42:15,548 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:15,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0ccb08ea23a1f682d8/log.txt.gz 2026-04-02 08:42:15,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:16,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:16,013 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0ccb08ea23a1f682d8/lava-logs.yaml 2026-04-02 08:42:16,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53274 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:16,763 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:16,766 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0ccb08ea23a1f682d8/lava_callback.json.gz 2026-04-02 08:42:16,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:16,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0ccb08ea23a1f682d8 HTTP/1.1" 200 None 2026-04-02 08:42:16,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:16,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:42:16,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:16,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b0ccb08ea23a1f682d8 HTTP/1.1" 200 None 2026-04-02 08:42:16,899 - lava_callback - INFO - Completed processing callback for node 69ce2b0ccb08ea23a1f682d8 2026-04-02 08:42:19,005 - lava_callback - INFO - Received callback for node 69ce2b26cb08ea23a1f6832e INFO: 172.21.0.1:53276 - "POST /node/69ce2b26cb08ea23a1f6832e HTTP/1.0" 202 Accepted 2026-04-02 08:42:19,018 - lava_callback - INFO - Starting async job submit for node 69ce2b26cb08ea23a1f6832e 2026-04-02 08:42:19,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:19,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b26cb08ea23a1f6832e HTTP/1.1" 200 None 2026-04-02 08:42:19,084 - lava_callback - DEBUG - Processing node 69ce2b26cb08ea23a1f6832e: baseline-arm-clabbe 2026-04-02 08:42:19,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:20,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:20,293 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b26cb08ea23a1f6832e/log.txt.gz 2026-04-02 08:42:20,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:21,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:21,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b26cb08ea23a1f6832e/lava-logs.yaml 2026-04-02 08:42:21,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:21,939 - lava_callback - INFO - Received callback for node 69cb88db2a64fa9aff93711e INFO: 172.21.0.1:36878 - "POST /node/69cb88db2a64fa9aff93711e HTTP/1.0" 202 Accepted 2026-04-02 08:42:21,949 - lava_callback - INFO - Starting async job submit for node 69cb88db2a64fa9aff93711e 2026-04-02 08:42:21,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:21,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88db2a64fa9aff93711e HTTP/1.1" 200 None 2026-04-02 08:42:21,982 - lava_callback - DEBUG - Processing node 69cb88db2a64fa9aff93711e: baseline-arm-baylibre 2026-04-02 08:42:21,982 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb88db2a64fa9aff93711e 2026-04-02 08:42:21,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb88db2a64fa9aff93711e HTTP/1.1" 200 None 2026-04-02 08:42:22,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:42:22,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb88db2a64fa9aff93711e HTTP/1.1" 200 None 2026-04-02 08:42:22,089 - lava_callback - ERROR - Error processing callback for node 69cb88db2a64fa9aff93711e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:42:22,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:22,526 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b26cb08ea23a1f6832e/lava_callback.json.gz 2026-04-02 08:42:22,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b26cb08ea23a1f6832e HTTP/1.1" 200 None 2026-04-02 08:42:22,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:42:22,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:22,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b26cb08ea23a1f6832e HTTP/1.1" 200 None 2026-04-02 08:42:22,699 - lava_callback - INFO - Completed processing callback for node 69ce2b26cb08ea23a1f6832e INFO: 172.21.0.1:36880 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:26,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:26,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58308 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:41,202 - lava_callback - INFO - Received callback for node 69ce2be1cb08ea23a1f68445 INFO: 172.21.0.1:45864 - "POST /node/69ce2be1cb08ea23a1f68445 HTTP/1.0" 202 Accepted 2026-04-02 08:42:41,211 - lava_callback - INFO - Starting async job submit for node 69ce2be1cb08ea23a1f68445 2026-04-02 08:42:41,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:41,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be1cb08ea23a1f68445 HTTP/1.1" 200 None 2026-04-02 08:42:41,272 - lava_callback - DEBUG - Processing node 69ce2be1cb08ea23a1f68445: baseline-x86 2026-04-02 08:42:41,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:41,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:41,777 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be1cb08ea23a1f68445/log.txt.gz 2026-04-02 08:42:41,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:42,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:42,848 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be1cb08ea23a1f68445/lava-logs.yaml 2026-04-02 08:42:42,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:42,952 - lava_callback - INFO - Received callback for node 69ce2bdecb08ea23a1f68437 INFO: 172.21.0.1:45870 - "POST /node/69ce2bdecb08ea23a1f68437 HTTP/1.0" 202 Accepted 2026-04-02 08:42:42,962 - lava_callback - INFO - Starting async job submit for node 69ce2bdecb08ea23a1f68437 2026-04-02 08:42:42,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:43,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2bdecb08ea23a1f68437 HTTP/1.1" 200 None 2026-04-02 08:42:43,023 - lava_callback - DEBUG - Processing node 69ce2bdecb08ea23a1f68437: baseline-x86 2026-04-02 08:42:43,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:43,130 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be1cb08ea23a1f68445/lava_callback.json.gz 2026-04-02 08:42:43,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:43,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be1cb08ea23a1f68445 HTTP/1.1" 200 None 2026-04-02 08:42:43,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:43,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:43,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce268acb08ea23a1f68099 HTTP/1.1" 200 None 2026-04-02 08:42:43,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:43,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2be1cb08ea23a1f68445 HTTP/1.1" 200 None 2026-04-02 08:42:43,375 - lava_callback - INFO - Completed processing callback for node 69ce2be1cb08ea23a1f68445 2026-04-02 08:42:44,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:44,147 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdecb08ea23a1f68437/log.txt.gz 2026-04-02 08:42:44,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:44,569 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:44,572 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdecb08ea23a1f68437/lava-logs.yaml 2026-04-02 08:42:44,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:42:45,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:42:45,358 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdecb08ea23a1f68437/lava_callback.json.gz 2026-04-02 08:42:45,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:45,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2bdecb08ea23a1f68437 HTTP/1.1" 200 None 2026-04-02 08:42:45,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:45,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce268acb08ea23a1f68099 HTTP/1.1" 200 None 2026-04-02 08:42:45,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:45,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2bdecb08ea23a1f68437 HTTP/1.1" 200 None 2026-04-02 08:42:45,491 - lava_callback - INFO - Completed processing callback for node 69ce2bdecb08ea23a1f68437 INFO: 172.21.0.1:45876 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:51,402 - lava_callback - INFO - Received callback for node 69cb89072a64fa9aff93714b INFO: 172.21.0.1:32770 - "POST /node/69cb89072a64fa9aff93714b HTTP/1.0" 202 Accepted 2026-04-02 08:42:51,411 - lava_callback - INFO - Starting async job submit for node 69cb89072a64fa9aff93714b 2026-04-02 08:42:51,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:51,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89072a64fa9aff93714b HTTP/1.1" 200 None 2026-04-02 08:42:51,430 - lava_callback - DEBUG - Processing node 69cb89072a64fa9aff93714b: baseline-arm-clabbe 2026-04-02 08:42:51,430 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb89072a64fa9aff93714b 2026-04-02 08:42:51,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:51,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89072a64fa9aff93714b HTTP/1.1" 200 None 2026-04-02 08:42:51,455 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:51,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:42:51,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:51,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb89072a64fa9aff93714b HTTP/1.1" 200 None 2026-04-02 08:42:51,508 - lava_callback - ERROR - Error processing callback for node 69cb89072a64fa9aff93714b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:42:56,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:42:56,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:43:01,064 - lava_callback - INFO - Received callback for node 69ce2b4acb08ea23a1f683a0 INFO: 172.21.0.1:57266 - "POST /node/69ce2b4acb08ea23a1f683a0 HTTP/1.0" 202 Accepted 2026-04-02 08:43:01,075 - lava_callback - INFO - Starting async job submit for node 69ce2b4acb08ea23a1f683a0 2026-04-02 08:43:01,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:01,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4acb08ea23a1f683a0 HTTP/1.1" 200 None 2026-04-02 08:43:01,138 - lava_callback - DEBUG - Processing node 69ce2b4acb08ea23a1f683a0: ltp-dio 2026-04-02 08:43:01,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:02,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:02,572 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69ce2b4acb08ea23a1f683a0/log.txt.gz 2026-04-02 08:43:02,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:03,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:03,774 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69ce2b4acb08ea23a1f683a0/lava-logs.yaml 2026-04-02 08:43:03,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:04,535 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:04,537 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69ce2b4acb08ea23a1f683a0/lava_callback.json.gz 2026-04-02 08:43:04,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:04,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4acb08ea23a1f683a0 HTTP/1.1" 200 None 2026-04-02 08:43:04,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:04,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:43:04,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:04,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b4acb08ea23a1f683a0 HTTP/1.1" 200 None 2026-04-02 08:43:04,663 - lava_callback - INFO - Completed processing callback for node 69ce2b4acb08ea23a1f683a0 INFO: 172.21.0.1:57270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45822 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:43:26,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:26,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46704 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:43:34,520 - lava_callback - INFO - Received callback for node 69ce2bdfcb08ea23a1f6843f INFO: 172.21.0.1:46710 - "POST /node/69ce2bdfcb08ea23a1f6843f HTTP/1.0" 202 Accepted 2026-04-02 08:43:34,534 - lava_callback - INFO - Starting async job submit for node 69ce2bdfcb08ea23a1f6843f 2026-04-02 08:43:34,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:34,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2bdfcb08ea23a1f6843f HTTP/1.1" 200 None 2026-04-02 08:43:34,592 - lava_callback - DEBUG - Processing node 69ce2bdfcb08ea23a1f6843f: baseline-x86 2026-04-02 08:43:34,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:35,329 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:35,331 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdfcb08ea23a1f6843f/log.txt.gz 2026-04-02 08:43:35,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:36,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:36,130 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdfcb08ea23a1f6843f/lava-logs.yaml 2026-04-02 08:43:36,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:36,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:36,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2bdfcb08ea23a1f6843f/lava_callback.json.gz 2026-04-02 08:43:36,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:36,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2bdfcb08ea23a1f6843f HTTP/1.1" 200 None 2026-04-02 08:43:36,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:36,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce268acb08ea23a1f68099 HTTP/1.1" 200 None 2026-04-02 08:43:36,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:36,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2bdfcb08ea23a1f6843f HTTP/1.1" 200 None 2026-04-02 08:43:36,345 - lava_callback - INFO - Completed processing callback for node 69ce2bdfcb08ea23a1f6843f INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52818 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:43:48,474 - lava_callback - INFO - Received callback for node 69ce2be0cb08ea23a1f68442 INFO: 172.21.0.1:52832 - "POST /node/69ce2be0cb08ea23a1f68442 HTTP/1.0" 202 Accepted 2026-04-02 08:43:48,484 - lava_callback - INFO - Starting async job submit for node 69ce2be0cb08ea23a1f68442 2026-04-02 08:43:48,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:48,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be0cb08ea23a1f68442 HTTP/1.1" 200 None 2026-04-02 08:43:48,544 - lava_callback - DEBUG - Processing node 69ce2be0cb08ea23a1f68442: baseline-x86 2026-04-02 08:43:48,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:49,189 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:49,191 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be0cb08ea23a1f68442/log.txt.gz 2026-04-02 08:43:49,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:49,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:49,837 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be0cb08ea23a1f68442/lava-logs.yaml 2026-04-02 08:43:49,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:43:50,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:43:50,406 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be0cb08ea23a1f68442/lava_callback.json.gz 2026-04-02 08:43:50,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be0cb08ea23a1f68442 HTTP/1.1" 200 None 2026-04-02 08:43:50,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce268acb08ea23a1f68099 HTTP/1.1" 200 None 2026-04-02 08:43:50,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2be0cb08ea23a1f68442 HTTP/1.1" 200 None 2026-04-02 08:43:50,536 - lava_callback - INFO - Completed processing callback for node 69ce2be0cb08ea23a1f68442 2026-04-02 08:43:50,614 - lava_callback - INFO - Received callback for node 69cb89312a64fa9aff93715a INFO: 172.21.0.1:43822 - "POST /node/69cb89312a64fa9aff93715a HTTP/1.0" 202 Accepted 2026-04-02 08:43:50,632 - lava_callback - INFO - Starting async job submit for node 69cb89312a64fa9aff93715a 2026-04-02 08:43:50,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89312a64fa9aff93715a HTTP/1.1" 200 None 2026-04-02 08:43:50,671 - lava_callback - DEBUG - Processing node 69cb89312a64fa9aff93715a: baseline-arm-clabbe 2026-04-02 08:43:50,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb89312a64fa9aff93715a 2026-04-02 08:43:50,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89312a64fa9aff93715a HTTP/1.1" 200 None 2026-04-02 08:43:50,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:43:50,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:50,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb89312a64fa9aff93715a HTTP/1.1" 200 None 2026-04-02 08:43:50,759 - lava_callback - ERROR - Error processing callback for node 69cb89312a64fa9aff93715a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43828 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:43:56,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:43:56,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:44:02,028 - lava_callback - INFO - Received callback for node 69ce2b27cb08ea23a1f68331 INFO: 172.21.0.1:48096 - "POST /node/69ce2b27cb08ea23a1f68331 HTTP/1.0" 202 Accepted 2026-04-02 08:44:02,034 - lava_callback - INFO - Starting async job submit for node 69ce2b27cb08ea23a1f68331 2026-04-02 08:44:02,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:02,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b27cb08ea23a1f68331 HTTP/1.1" 200 None 2026-04-02 08:44:02,070 - lava_callback - DEBUG - Processing node 69ce2b27cb08ea23a1f68331: baseline-arm-clabbe 2026-04-02 08:44:02,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:02,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:02,456 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b27cb08ea23a1f68331/log.txt.gz 2026-04-02 08:44:02,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:02,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:02,750 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b27cb08ea23a1f68331/lava-logs.yaml 2026-04-02 08:44:02,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:02,898 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:02,900 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69ce2b27cb08ea23a1f68331/lava_callback.json.gz 2026-04-02 08:44:02,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:02,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b27cb08ea23a1f68331 HTTP/1.1" 200 None 2026-04-02 08:44:02,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:02,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:44:02,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:02,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b27cb08ea23a1f68331 HTTP/1.1" 200 None 2026-04-02 08:44:02,982 - lava_callback - INFO - Completed processing callback for node 69ce2b27cb08ea23a1f68331 INFO: 172.21.0.1:48098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40892 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:44:26,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:26,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:44:28,037 - lava_callback - INFO - Received callback for node 69ce2b1ecb08ea23a1f6830e INFO: 172.21.0.1:40900 - "POST /node/69ce2b1ecb08ea23a1f6830e HTTP/1.0" 202 Accepted 2026-04-02 08:44:28,043 - lava_callback - INFO - Starting async job submit for node 69ce2b1ecb08ea23a1f6830e 2026-04-02 08:44:28,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:28,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1ecb08ea23a1f6830e HTTP/1.1" 200 None 2026-04-02 08:44:28,081 - lava_callback - DEBUG - Processing node 69ce2b1ecb08ea23a1f6830e: baseline-arm-broonie 2026-04-02 08:44:28,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:28,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:28,431 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1ecb08ea23a1f6830e/log.txt.gz 2026-04-02 08:44:28,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:28,759 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:28,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1ecb08ea23a1f6830e/lava-logs.yaml 2026-04-02 08:44:28,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:44:28,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:44:28,901 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1ecb08ea23a1f6830e/lava_callback.json.gz 2026-04-02 08:44:28,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:28,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1ecb08ea23a1f6830e HTTP/1.1" 200 None 2026-04-02 08:44:28,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:28,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:44:28,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:28,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b1ecb08ea23a1f6830e HTTP/1.1" 200 None 2026-04-02 08:44:28,984 - lava_callback - INFO - Completed processing callback for node 69ce2b1ecb08ea23a1f6830e INFO: 172.21.0.1:60366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38630 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:44:56,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:44:56,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60890 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:45:30,834 - lava_callback - INFO - Received callback for node 69cb89a62a64fa9aff937187 INFO: 172.21.0.1:60078 - "POST /node/69cb89a62a64fa9aff937187 HTTP/1.0" 202 Accepted 2026-04-02 08:45:30,843 - lava_callback - INFO - Starting async job submit for node 69cb89a62a64fa9aff937187 2026-04-02 08:45:30,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:45:30,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89a62a64fa9aff937187 HTTP/1.1" 200 None 2026-04-02 08:45:30,872 - lava_callback - DEBUG - Processing node 69cb89a62a64fa9aff937187: baseline-arm-clabbe 2026-04-02 08:45:30,872 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb89a62a64fa9aff937187 2026-04-02 08:45:30,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:45:30,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb89a62a64fa9aff937187 HTTP/1.1" 200 None 2026-04-02 08:45:30,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:45:30,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 08:45:30,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:45:30,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb89a62a64fa9aff937187 HTTP/1.1" 200 None 2026-04-02 08:45:30,994 - lava_callback - ERROR - Error processing callback for node 69cb89a62a64fa9aff937187: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56216 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:47:49,840 - lava_callback - INFO - Received callback for node 69ce2b5bcb08ea23a1f683ba INFO: 172.21.0.1:56968 - "POST /node/69ce2b5bcb08ea23a1f683ba HTTP/1.0" 202 Accepted 2026-04-02 08:47:49,848 - lava_callback - INFO - Starting async job submit for node 69ce2b5bcb08ea23a1f683ba 2026-04-02 08:47:49,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:47:49,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5bcb08ea23a1f683ba HTTP/1.1" 200 None 2026-04-02 08:47:49,898 - lava_callback - DEBUG - Processing node 69ce2b5bcb08ea23a1f683ba: ltp-syscalls 2026-04-02 08:47:50,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:47:50,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:47:50,975 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ce2b5bcb08ea23a1f683ba/log.txt.gz 2026-04-02 08:47:51,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:47:51,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:47:51,743 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ce2b5bcb08ea23a1f683ba/lava-logs.yaml 2026-04-02 08:47:51,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:47:51,923 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:47:51,926 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69ce2b5bcb08ea23a1f683ba/lava_callback.json.gz 2026-04-02 08:47:51,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:47:52,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5bcb08ea23a1f683ba HTTP/1.1" 200 None 2026-04-02 08:47:52,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:47:52,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:47:52,035 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:47:52,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b5bcb08ea23a1f683ba HTTP/1.1" 200 None 2026-04-02 08:47:52,061 - lava_callback - INFO - Completed processing callback for node 69ce2b5bcb08ea23a1f683ba INFO: 172.21.0.1:56972 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:47:56,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:47:56,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:48:13,166 - lava_callback - INFO - Received callback for node 69ce2d37cb08ea23a1f68514 INFO: 172.21.0.1:33546 - "POST /node/69ce2d37cb08ea23a1f68514 HTTP/1.0" 202 Accepted 2026-04-02 08:48:13,171 - lava_callback - INFO - Starting async job submit for node 69ce2d37cb08ea23a1f68514 2026-04-02 08:48:13,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:48:13,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2d37cb08ea23a1f68514 HTTP/1.1" 200 None 2026-04-02 08:48:13,201 - lava_callback - DEBUG - Processing node 69ce2d37cb08ea23a1f68514: baseline-arm 2026-04-02 08:48:13,206 - lava_callback - WARNING - Failed to upload log 2026-04-02 08:48:13,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:48:13,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:48:13,338 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2d37cb08ea23a1f68514/lava-logs.yaml 2026-04-02 08:48:13,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:48:13,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:48:13,462 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2d37cb08ea23a1f68514/lava_callback.json.gz 2026-04-02 08:48:13,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:48:13,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2d37cb08ea23a1f68514 HTTP/1.1" 200 None 2026-04-02 08:48:13,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:48:13,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:48:13,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:48:13,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2d37cb08ea23a1f68514 HTTP/1.1" 200 None 2026-04-02 08:48:13,533 - lava_callback - INFO - Completed processing callback for node 69ce2d37cb08ea23a1f68514 INFO: 172.21.0.1:33550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46370 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:48:26,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:48:26,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:49:22,261 - lava_callback - INFO - Received callback for node 69cb8a8a2a64fa9aff9371f6 INFO: 172.21.0.1:33350 - "POST /node/69cb8a8a2a64fa9aff9371f6 HTTP/1.0" 202 Accepted 2026-04-02 08:49:22,266 - lava_callback - INFO - Starting async job submit for node 69cb8a8a2a64fa9aff9371f6 2026-04-02 08:49:22,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:49:22,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8a8a2a64fa9aff9371f6 HTTP/1.1" 200 None 2026-04-02 08:49:22,282 - lava_callback - DEBUG - Processing node 69cb8a8a2a64fa9aff9371f6: baseline-arm-baylibre 2026-04-02 08:49:22,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8a8a2a64fa9aff9371f6 2026-04-02 08:49:22,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:49:22,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8a8a2a64fa9aff9371f6 HTTP/1.1" 200 None 2026-04-02 08:49:22,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:49:22,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:49:22,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:49:22,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8a8a2a64fa9aff9371f6 HTTP/1.1" 200 None 2026-04-02 08:49:22,366 - lava_callback - ERROR - Error processing callback for node 69cb8a8a2a64fa9aff9371f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40900 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:50:02,258 - lava_callback - INFO - Received callback for node 69cb8ab32a64fa9aff937201 INFO: 172.21.0.1:55952 - "POST /node/69cb8ab32a64fa9aff937201 HTTP/1.0" 202 Accepted 2026-04-02 08:50:02,267 - lava_callback - INFO - Starting async job submit for node 69cb8ab32a64fa9aff937201 2026-04-02 08:50:02,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:02,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8ab32a64fa9aff937201 HTTP/1.1" 200 None 2026-04-02 08:50:02,284 - lava_callback - DEBUG - Processing node 69cb8ab32a64fa9aff937201: baseline-arm-baylibre 2026-04-02 08:50:02,284 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8ab32a64fa9aff937201 2026-04-02 08:50:02,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:02,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8ab32a64fa9aff937201 HTTP/1.1" 200 None 2026-04-02 08:50:02,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:02,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:50:02,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:02,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8ab32a64fa9aff937201 HTTP/1.1" 200 None 2026-04-02 08:50:02,347 - lava_callback - ERROR - Error processing callback for node 69cb8ab32a64fa9aff937201: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55966 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:50:08,336 - lava_callback - INFO - Received callback for node 69ce2b1acb08ea23a1f68305 INFO: 172.21.0.1:55968 - "POST /node/69ce2b1acb08ea23a1f68305 HTTP/1.0" 202 Accepted 2026-04-02 08:50:08,343 - lava_callback - INFO - Starting async job submit for node 69ce2b1acb08ea23a1f68305 2026-04-02 08:50:08,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:08,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1acb08ea23a1f68305 HTTP/1.1" 200 None 2026-04-02 08:50:08,392 - lava_callback - DEBUG - Processing node 69ce2b1acb08ea23a1f68305: baseline-arm-broonie 2026-04-02 08:50:08,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:50:08,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:50:08,836 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1acb08ea23a1f68305/log.txt.gz 2026-04-02 08:50:08,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:50:09,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:50:09,172 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1acb08ea23a1f68305/lava-logs.yaml 2026-04-02 08:50:09,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:50:09,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:50:09,325 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69ce2b1acb08ea23a1f68305/lava_callback.json.gz 2026-04-02 08:50:09,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:09,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b1acb08ea23a1f68305 HTTP/1.1" 200 None 2026-04-02 08:50:09,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:09,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:50:09,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:09,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b1acb08ea23a1f68305 HTTP/1.1" 200 None 2026-04-02 08:50:09,406 - lava_callback - INFO - Completed processing callback for node 69ce2b1acb08ea23a1f68305 INFO: 172.21.0.1:43112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54932 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:50:26,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:50:26,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46568 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:51:22,384 - lava_callback - INFO - Received callback for node 69cb8b032a64fa9aff937223 INFO: 172.21.0.1:49948 - "POST /node/69cb8b032a64fa9aff937223 HTTP/1.0" 202 Accepted 2026-04-02 08:51:22,389 - lava_callback - INFO - Starting async job submit for node 69cb8b032a64fa9aff937223 2026-04-02 08:51:22,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:51:22,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b032a64fa9aff937223 HTTP/1.1" 200 None 2026-04-02 08:51:22,414 - lava_callback - DEBUG - Processing node 69cb8b032a64fa9aff937223: baseline-arm-baylibre 2026-04-02 08:51:22,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8b032a64fa9aff937223 2026-04-02 08:51:22,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:51:22,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b032a64fa9aff937223 HTTP/1.1" 200 None 2026-04-02 08:51:22,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:51:22,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:51:22,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:51:22,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8b032a64fa9aff937223 HTTP/1.1" 200 None 2026-04-02 08:51:22,497 - lava_callback - ERROR - Error processing callback for node 69cb8b032a64fa9aff937223: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38474 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:52:42,451 - lava_callback - INFO - Received callback for node 69cb8b4f2a64fa9aff937258 INFO: 172.21.0.1:37060 - "POST /node/69cb8b4f2a64fa9aff937258 HTTP/1.0" 202 Accepted 2026-04-02 08:52:42,461 - lava_callback - INFO - Starting async job submit for node 69cb8b4f2a64fa9aff937258 2026-04-02 08:52:42,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:52:42,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b4f2a64fa9aff937258 HTTP/1.1" 200 None 2026-04-02 08:52:42,488 - lava_callback - DEBUG - Processing node 69cb8b4f2a64fa9aff937258: baseline-arm-baylibre 2026-04-02 08:52:42,488 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8b4f2a64fa9aff937258 2026-04-02 08:52:42,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:52:42,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b4f2a64fa9aff937258 HTTP/1.1" 200 None 2026-04-02 08:52:42,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:52:42,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:52:42,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:52:42,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8b4f2a64fa9aff937258 HTTP/1.1" 200 None 2026-04-02 08:52:42,564 - lava_callback - ERROR - Error processing callback for node 69cb8b4f2a64fa9aff937258: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38154 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:53:22,451 - lava_callback - INFO - Received callback for node 69cb8b762a64fa9aff937270 INFO: 172.21.0.1:50448 - "POST /node/69cb8b762a64fa9aff937270 HTTP/1.0" 202 Accepted 2026-04-02 08:53:22,457 - lava_callback - INFO - Starting async job submit for node 69cb8b762a64fa9aff937270 2026-04-02 08:53:22,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:53:22,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b762a64fa9aff937270 HTTP/1.1" 200 None 2026-04-02 08:53:22,484 - lava_callback - DEBUG - Processing node 69cb8b762a64fa9aff937270: baseline-arm-baylibre 2026-04-02 08:53:22,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8b762a64fa9aff937270 2026-04-02 08:53:22,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:53:22,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8b762a64fa9aff937270 HTTP/1.1" 200 None 2026-04-02 08:53:22,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:53:22,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:53:22,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:53:22,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8b762a64fa9aff937270 HTTP/1.1" 200 None 2026-04-02 08:53:22,573 - lava_callback - ERROR - Error processing callback for node 69cb8b762a64fa9aff937270: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44644 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:54:05,627 - lava_callback - INFO - Received callback for node 69ce2a0fcb08ea23a1f68281 INFO: 172.21.0.1:35318 - "POST /node/69ce2a0fcb08ea23a1f68281 HTTP/1.0" 202 Accepted 2026-04-02 08:54:05,639 - lava_callback - INFO - Starting async job submit for node 69ce2a0fcb08ea23a1f68281 2026-04-02 08:54:05,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:05,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2a0fcb08ea23a1f68281 HTTP/1.1" 200 None 2026-04-02 08:54:05,769 - lava_callback - DEBUG - Processing node 69ce2a0fcb08ea23a1f68281: ltp-smoke 2026-04-02 08:54:06,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:54:06,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:06,650 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2a0fcb08ea23a1f68281/log.txt.gz 2026-04-02 08:54:07,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:07,272 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:07,274 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2a0fcb08ea23a1f68281/lava-logs.yaml 2026-04-02 08:54:07,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:07,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:07,446 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2a0fcb08ea23a1f68281/lava_callback.json.gz 2026-04-02 08:54:07,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:07,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2a0fcb08ea23a1f68281 HTTP/1.1" 200 None 2026-04-02 08:54:07,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:07,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce266ecb08ea23a1f68074 HTTP/1.1" 200 None 2026-04-02 08:54:07,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:07,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2a0fcb08ea23a1f68281 HTTP/1.1" 200 None 2026-04-02 08:54:07,986 - lava_callback - INFO - Completed processing callback for node 69ce2a0fcb08ea23a1f68281 INFO: 172.21.0.1:36206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42152 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:54:26,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:26,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:54:28,879 - lava_callback - INFO - Received callback for node 69ce2b43cb08ea23a1f6837f INFO: 172.21.0.1:42162 - "POST /node/69ce2b43cb08ea23a1f6837f HTTP/1.0" 202 Accepted 2026-04-02 08:54:28,887 - lava_callback - INFO - Starting async job submit for node 69ce2b43cb08ea23a1f6837f 2026-04-02 08:54:28,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:28,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b43cb08ea23a1f6837f HTTP/1.1" 200 None 2026-04-02 08:54:28,927 - lava_callback - DEBUG - Processing node 69ce2b43cb08ea23a1f6837f: ltp-cap_bounds 2026-04-02 08:54:29,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:29,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:29,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ce2b43cb08ea23a1f6837f/log.txt.gz 2026-04-02 08:54:29,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:29,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:29,994 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ce2b43cb08ea23a1f6837f/lava-logs.yaml 2026-04-02 08:54:30,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:30,165 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:30,167 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69ce2b43cb08ea23a1f6837f/lava_callback.json.gz 2026-04-02 08:54:30,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:30,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b43cb08ea23a1f6837f HTTP/1.1" 200 None 2026-04-02 08:54:30,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:30,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:54:30,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:30,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b43cb08ea23a1f6837f HTTP/1.1" 200 None 2026-04-02 08:54:30,296 - lava_callback - INFO - Completed processing callback for node 69ce2b43cb08ea23a1f6837f INFO: 172.21.0.1:60660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57270 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:54:56,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:56,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:54:58,013 - lava_callback - INFO - Received callback for node 69ce2b0bcb08ea23a1f682d5 INFO: 172.21.0.1:57274 - "POST /node/69ce2b0bcb08ea23a1f682d5 HTTP/1.0" 202 Accepted 2026-04-02 08:54:58,020 - lava_callback - INFO - Starting async job submit for node 69ce2b0bcb08ea23a1f682d5 2026-04-02 08:54:58,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:58,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0bcb08ea23a1f682d5 HTTP/1.1" 200 None 2026-04-02 08:54:58,091 - lava_callback - DEBUG - Processing node 69ce2b0bcb08ea23a1f682d5: baseline-arm 2026-04-02 08:54:58,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:58,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:58,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0bcb08ea23a1f682d5/log.txt.gz 2026-04-02 08:54:59,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:59,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:59,491 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0bcb08ea23a1f682d5/lava-logs.yaml 2026-04-02 08:54:59,506 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:54:59,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:54:59,758 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2b0bcb08ea23a1f682d5/lava_callback.json.gz DEBUG: Setup failed for 69ce2b0bcb08ea23a1f682d5. Transitting job node result: incomplete -> fail 2026-04-02 08:54:59,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:59,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b0bcb08ea23a1f682d5 HTTP/1.1" 200 None 2026-04-02 08:54:59,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:59,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:54:59,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:54:59,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b0bcb08ea23a1f682d5 HTTP/1.1" 200 None 2026-04-02 08:55:00,092 - lava_callback - INFO - Completed processing callback for node 69ce2b0bcb08ea23a1f682d5 INFO: 172.21.0.1:39002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46064 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:55:22,774 - lava_callback - INFO - Received callback for node 69cb8bec2a64fa9aff9372d1 INFO: 172.21.0.1:33852 - "POST /node/69cb8bec2a64fa9aff9372d1 HTTP/1.0" 202 Accepted 2026-04-02 08:55:22,779 - lava_callback - INFO - Starting async job submit for node 69cb8bec2a64fa9aff9372d1 2026-04-02 08:55:22,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:22,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8bec2a64fa9aff9372d1 HTTP/1.1" 200 None 2026-04-02 08:55:22,800 - lava_callback - DEBUG - Processing node 69cb8bec2a64fa9aff9372d1: baseline-arm-baylibre 2026-04-02 08:55:22,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8bec2a64fa9aff9372d1 2026-04-02 08:55:22,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:22,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8bec2a64fa9aff9372d1 HTTP/1.1" 200 None 2026-04-02 08:55:22,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:22,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:55:22,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:22,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8bec2a64fa9aff9372d1 HTTP/1.1" 200 None 2026-04-02 08:55:22,855 - lava_callback - ERROR - Error processing callback for node 69cb8bec2a64fa9aff9372d1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:55:26,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:26,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44942 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:55:42,548 - lava_callback - INFO - Received callback for node 69cb8c052a64fa9aff937338 INFO: 172.21.0.1:32958 - "POST /node/69cb8c052a64fa9aff937338 HTTP/1.0" 202 Accepted 2026-04-02 08:55:42,554 - lava_callback - INFO - Starting async job submit for node 69cb8c052a64fa9aff937338 2026-04-02 08:55:42,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:42,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c052a64fa9aff937338 HTTP/1.1" 200 None 2026-04-02 08:55:42,570 - lava_callback - DEBUG - Processing node 69cb8c052a64fa9aff937338: baseline-arm64-baylibre 2026-04-02 08:55:42,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c052a64fa9aff937338 2026-04-02 08:55:42,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:42,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c052a64fa9aff937338 HTTP/1.1" 200 None 2026-04-02 08:55:42,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:42,598 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:55:42,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:42,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c052a64fa9aff937338 HTTP/1.1" 200 None 2026-04-02 08:55:42,629 - lava_callback - ERROR - Error processing callback for node 69cb8c052a64fa9aff937338: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:55:43,213 - lava_callback - INFO - Received callback for node 69cb8c072a64fa9aff93733b INFO: 172.21.0.1:32966 - "POST /node/69cb8c072a64fa9aff93733b HTTP/1.0" 202 Accepted 2026-04-02 08:55:43,219 - lava_callback - INFO - Starting async job submit for node 69cb8c072a64fa9aff93733b 2026-04-02 08:55:43,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c072a64fa9aff93733b HTTP/1.1" 200 None 2026-04-02 08:55:43,238 - lava_callback - DEBUG - Processing node 69cb8c072a64fa9aff93733b: baseline-arm64-baylibre 2026-04-02 08:55:43,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c072a64fa9aff93733b 2026-04-02 08:55:43,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c072a64fa9aff93733b HTTP/1.1" 200 None 2026-04-02 08:55:43,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:55:43,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c072a64fa9aff93733b HTTP/1.1" 200 None 2026-04-02 08:55:43,303 - lava_callback - ERROR - Error processing callback for node 69cb8c072a64fa9aff93733b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:55:43,884 - lava_callback - INFO - Received callback for node 69cb8c082a64fa9aff93733e INFO: 172.21.0.1:32976 - "POST /node/69cb8c082a64fa9aff93733e HTTP/1.0" 202 Accepted 2026-04-02 08:55:43,890 - lava_callback - INFO - Starting async job submit for node 69cb8c082a64fa9aff93733e 2026-04-02 08:55:43,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c082a64fa9aff93733e HTTP/1.1" 200 None 2026-04-02 08:55:43,905 - lava_callback - DEBUG - Processing node 69cb8c082a64fa9aff93733e: baseline-arm64-baylibre 2026-04-02 08:55:43,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c082a64fa9aff93733e 2026-04-02 08:55:43,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c082a64fa9aff93733e HTTP/1.1" 200 None 2026-04-02 08:55:43,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:55:43,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:43,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c082a64fa9aff93733e HTTP/1.1" 200 None 2026-04-02 08:55:43,957 - lava_callback - ERROR - Error processing callback for node 69cb8c082a64fa9aff93733e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:55:44,524 - lava_callback - INFO - Received callback for node 69cb8c0b2a64fa9aff93734f INFO: 172.21.0.1:32978 - "POST /node/69cb8c0b2a64fa9aff93734f HTTP/1.0" 202 Accepted 2026-04-02 08:55:44,529 - lava_callback - INFO - Starting async job submit for node 69cb8c0b2a64fa9aff93734f 2026-04-02 08:55:44,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:44,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0b2a64fa9aff93734f HTTP/1.1" 200 None 2026-04-02 08:55:44,544 - lava_callback - DEBUG - Processing node 69cb8c0b2a64fa9aff93734f: baseline-arm64-baylibre 2026-04-02 08:55:44,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c0b2a64fa9aff93734f 2026-04-02 08:55:44,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:44,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0b2a64fa9aff93734f HTTP/1.1" 200 None 2026-04-02 08:55:44,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:44,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:55:44,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:44,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c0b2a64fa9aff93734f HTTP/1.1" 200 None 2026-04-02 08:55:44,602 - lava_callback - ERROR - Error processing callback for node 69cb8c0b2a64fa9aff93734f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:55:45,170 - lava_callback - INFO - Received callback for node 69cb8c0c2a64fa9aff937352 INFO: 172.21.0.1:32984 - "POST /node/69cb8c0c2a64fa9aff937352 HTTP/1.0" 202 Accepted 2026-04-02 08:55:45,175 - lava_callback - INFO - Starting async job submit for node 69cb8c0c2a64fa9aff937352 2026-04-02 08:55:45,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:45,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0c2a64fa9aff937352 HTTP/1.1" 200 None 2026-04-02 08:55:45,198 - lava_callback - DEBUG - Processing node 69cb8c0c2a64fa9aff937352: baseline-arm64-baylibre 2026-04-02 08:55:45,198 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c0c2a64fa9aff937352 2026-04-02 08:55:45,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:45,211 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0c2a64fa9aff937352 HTTP/1.1" 200 None 2026-04-02 08:55:45,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:45,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:55:45,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:55:45,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c0c2a64fa9aff937352 HTTP/1.1" 200 None 2026-04-02 08:55:45,254 - lava_callback - ERROR - Error processing callback for node 69cb8c0c2a64fa9aff937352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:56:02,558 - lava_callback - INFO - Received callback for node 69cb8c0e2a64fa9aff937355 INFO: 172.21.0.1:42742 - "POST /node/69cb8c0e2a64fa9aff937355 HTTP/1.0" 202 Accepted 2026-04-02 08:56:02,563 - lava_callback - INFO - Starting async job submit for node 69cb8c0e2a64fa9aff937355 2026-04-02 08:56:02,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:02,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0e2a64fa9aff937355 HTTP/1.1" 200 None 2026-04-02 08:56:02,579 - lava_callback - DEBUG - Processing node 69cb8c0e2a64fa9aff937355: baseline-arm64-baylibre 2026-04-02 08:56:02,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c0e2a64fa9aff937355 2026-04-02 08:56:02,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:02,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c0e2a64fa9aff937355 HTTP/1.1" 200 None 2026-04-02 08:56:02,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:02,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:02,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:02,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c0e2a64fa9aff937355 HTTP/1.1" 200 None 2026-04-02 08:56:02,646 - lava_callback - ERROR - Error processing callback for node 69cb8c0e2a64fa9aff937355: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:56:11,147 - lava_callback - INFO - Received callback for node 69cb8c1f2a64fa9aff937394 INFO: 172.21.0.1:36288 - "POST /node/69cb8c1f2a64fa9aff937394 HTTP/1.0" 202 Accepted 2026-04-02 08:56:11,153 - lava_callback - INFO - Starting async job submit for node 69cb8c1f2a64fa9aff937394 2026-04-02 08:56:11,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c1f2a64fa9aff937394 HTTP/1.1" 200 None 2026-04-02 08:56:11,169 - lava_callback - DEBUG - Processing node 69cb8c1f2a64fa9aff937394: baseline-arm64-clabbe 2026-04-02 08:56:11,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c1f2a64fa9aff937394 2026-04-02 08:56:11,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c1f2a64fa9aff937394 HTTP/1.1" 200 None 2026-04-02 08:56:11,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:11,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c1f2a64fa9aff937394 HTTP/1.1" 200 None 2026-04-02 08:56:11,250 - lava_callback - ERROR - Error processing callback for node 69cb8c1f2a64fa9aff937394: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:56:11,786 - lava_callback - INFO - Received callback for node 69cb8c202a64fa9aff937397 INFO: 172.21.0.1:36302 - "POST /node/69cb8c202a64fa9aff937397 HTTP/1.0" 202 Accepted 2026-04-02 08:56:11,792 - lava_callback - INFO - Starting async job submit for node 69cb8c202a64fa9aff937397 2026-04-02 08:56:11,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c202a64fa9aff937397 HTTP/1.1" 200 None 2026-04-02 08:56:11,807 - lava_callback - DEBUG - Processing node 69cb8c202a64fa9aff937397: baseline-arm64-clabbe 2026-04-02 08:56:11,808 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c202a64fa9aff937397 2026-04-02 08:56:11,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c202a64fa9aff937397 HTTP/1.1" 200 None 2026-04-02 08:56:11,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:11,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:11,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c202a64fa9aff937397 HTTP/1.1" 200 None 2026-04-02 08:56:11,871 - lava_callback - ERROR - Error processing callback for node 69cb8c202a64fa9aff937397: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:56:12,427 - lava_callback - INFO - Received callback for node 69cb8c212a64fa9aff93739a INFO: 172.21.0.1:36310 - "POST /node/69cb8c212a64fa9aff93739a HTTP/1.0" 202 Accepted 2026-04-02 08:56:12,433 - lava_callback - INFO - Starting async job submit for node 69cb8c212a64fa9aff93739a 2026-04-02 08:56:12,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:12,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c212a64fa9aff93739a HTTP/1.1" 200 None 2026-04-02 08:56:12,449 - lava_callback - DEBUG - Processing node 69cb8c212a64fa9aff93739a: baseline-arm64-clabbe 2026-04-02 08:56:12,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c212a64fa9aff93739a 2026-04-02 08:56:12,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:12,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c212a64fa9aff93739a HTTP/1.1" 200 None 2026-04-02 08:56:12,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:12,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:12,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:12,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c212a64fa9aff93739a HTTP/1.1" 200 None 2026-04-02 08:56:12,503 - lava_callback - ERROR - Error processing callback for node 69cb8c212a64fa9aff93739a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:56:13,097 - lava_callback - INFO - Received callback for node 69cb8c222a64fa9aff93739d INFO: 172.21.0.1:36318 - "POST /node/69cb8c222a64fa9aff93739d HTTP/1.0" 202 Accepted 2026-04-02 08:56:13,102 - lava_callback - INFO - Starting async job submit for node 69cb8c222a64fa9aff93739d 2026-04-02 08:56:13,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c222a64fa9aff93739d HTTP/1.1" 200 None 2026-04-02 08:56:13,118 - lava_callback - DEBUG - Processing node 69cb8c222a64fa9aff93739d: baseline-arm64-clabbe 2026-04-02 08:56:13,118 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c222a64fa9aff93739d 2026-04-02 08:56:13,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c222a64fa9aff93739d HTTP/1.1" 200 None 2026-04-02 08:56:13,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:13,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c222a64fa9aff93739d HTTP/1.1" 200 None 2026-04-02 08:56:13,210 - lava_callback - ERROR - Error processing callback for node 69cb8c222a64fa9aff93739d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:56:13,764 - lava_callback - INFO - Received callback for node 69cb8c252a64fa9aff9373a6 INFO: 172.21.0.1:36324 - "POST /node/69cb8c252a64fa9aff9373a6 HTTP/1.0" 202 Accepted 2026-04-02 08:56:13,769 - lava_callback - INFO - Starting async job submit for node 69cb8c252a64fa9aff9373a6 2026-04-02 08:56:13,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c252a64fa9aff9373a6 HTTP/1.1" 200 None 2026-04-02 08:56:13,786 - lava_callback - DEBUG - Processing node 69cb8c252a64fa9aff9373a6: baseline-arm64-clabbe 2026-04-02 08:56:13,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c252a64fa9aff9373a6 2026-04-02 08:56:13,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c252a64fa9aff9373a6 HTTP/1.1" 200 None 2026-04-02 08:56:13,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:13,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:13,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c252a64fa9aff9373a6 HTTP/1.1" 200 None 2026-04-02 08:56:13,847 - lava_callback - ERROR - Error processing callback for node 69cb8c252a64fa9aff9373a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 08:56:14,414 - lava_callback - INFO - Received callback for node 69cb8c242a64fa9aff9373a3 INFO: 172.21.0.1:36328 - "POST /node/69cb8c242a64fa9aff9373a3 HTTP/1.0" 202 Accepted 2026-04-02 08:56:14,419 - lava_callback - INFO - Starting async job submit for node 69cb8c242a64fa9aff9373a3 2026-04-02 08:56:14,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:14,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c242a64fa9aff9373a3 HTTP/1.1" 200 None 2026-04-02 08:56:14,435 - lava_callback - DEBUG - Processing node 69cb8c242a64fa9aff9373a3: baseline-arm64-clabbe 2026-04-02 08:56:14,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c242a64fa9aff9373a3 2026-04-02 08:56:14,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:14,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c242a64fa9aff9373a3 HTTP/1.1" 200 None 2026-04-02 08:56:14,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:14,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 08:56:14,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:14,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c242a64fa9aff9373a3 HTTP/1.1" 200 None 2026-04-02 08:56:14,492 - lava_callback - ERROR - Error processing callback for node 69cb8c242a64fa9aff9373a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56914 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:56:28,529 - lava_callback - INFO - Received callback for node 69ce2b44cb08ea23a1f68382 INFO: 172.21.0.1:56922 - "POST /node/69ce2b44cb08ea23a1f68382 HTTP/1.0" 202 Accepted 2026-04-02 08:56:28,536 - lava_callback - INFO - Starting async job submit for node 69ce2b44cb08ea23a1f68382 2026-04-02 08:56:28,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:28,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b44cb08ea23a1f68382 HTTP/1.1" 200 None 2026-04-02 08:56:28,577 - lava_callback - DEBUG - Processing node 69ce2b44cb08ea23a1f68382: ltp-containers 2026-04-02 08:56:28,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:56:29,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:56:29,117 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69ce2b44cb08ea23a1f68382/log.txt.gz 2026-04-02 08:56:29,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:56:29,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:56:29,653 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69ce2b44cb08ea23a1f68382/lava-logs.yaml 2026-04-02 08:56:29,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:56:29,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:56:29,928 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69ce2b44cb08ea23a1f68382/lava_callback.json.gz 2026-04-02 08:56:29,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:29,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b44cb08ea23a1f68382 HTTP/1.1" 200 None 2026-04-02 08:56:29,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:29,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:56:29,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:30,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b44cb08ea23a1f68382 HTTP/1.1" 200 None 2026-04-02 08:56:30,015 - lava_callback - INFO - Completed processing callback for node 69ce2b44cb08ea23a1f68382 INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47126 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:56:51,143 - lava_callback - INFO - Received callback for node 69cb8c3c2a64fa9aff9373e5 INFO: 172.21.0.1:39070 - "POST /node/69cb8c3c2a64fa9aff9373e5 HTTP/1.0" 202 Accepted 2026-04-02 08:56:51,148 - lava_callback - INFO - Starting async job submit for node 69cb8c3c2a64fa9aff9373e5 2026-04-02 08:56:51,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:51,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c3c2a64fa9aff9373e5 HTTP/1.1" 200 None 2026-04-02 08:56:51,168 - lava_callback - DEBUG - Processing node 69cb8c3c2a64fa9aff9373e5: baseline-arm-clabbe 2026-04-02 08:56:51,169 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c3c2a64fa9aff9373e5 2026-04-02 08:56:51,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:51,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c3c2a64fa9aff9373e5 HTTP/1.1" 200 None 2026-04-02 08:56:51,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:51,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:56:51,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:51,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c3c2a64fa9aff9373e5 HTTP/1.1" 200 None 2026-04-02 08:56:51,223 - lava_callback - ERROR - Error processing callback for node 69cb8c3c2a64fa9aff9373e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39080 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:56:56,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:56:56,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42356 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:57:45,328 - lava_callback - INFO - Received callback for node 69ce2b46cb08ea23a1f68386 INFO: 172.21.0.1:46084 - "POST /node/69ce2b46cb08ea23a1f68386 HTTP/1.0" 202 Accepted 2026-04-02 08:57:45,335 - lava_callback - INFO - Starting async job submit for node 69ce2b46cb08ea23a1f68386 2026-04-02 08:57:45,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:45,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b46cb08ea23a1f68386 HTTP/1.1" 200 None 2026-04-02 08:57:45,377 - lava_callback - DEBUG - Processing node 69ce2b46cb08ea23a1f68386: ltp-controllers 2026-04-02 08:57:45,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:57:45,995 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:57:45,996 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69ce2b46cb08ea23a1f68386/log.txt.gz 2026-04-02 08:57:46,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:57:46,476 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:57:46,478 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69ce2b46cb08ea23a1f68386/lava-logs.yaml 2026-04-02 08:57:46,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:46100 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:57:46,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:57:46,647 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69ce2b46cb08ea23a1f68386/lava_callback.json.gz 2026-04-02 08:57:46,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:46,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b46cb08ea23a1f68386 HTTP/1.1" 200 None 2026-04-02 08:57:46,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:46,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:57:46,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:46,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b46cb08ea23a1f68386 HTTP/1.1" 200 None 2026-04-02 08:57:46,749 - lava_callback - INFO - Completed processing callback for node 69ce2b46cb08ea23a1f68386 2026-04-02 08:57:51,222 - lava_callback - INFO - Received callback for node 69cb8c892a64fa9aff93749e INFO: 172.21.0.1:57512 - "POST /node/69cb8c892a64fa9aff93749e HTTP/1.0" 202 Accepted 2026-04-02 08:57:51,227 - lava_callback - INFO - Starting async job submit for node 69cb8c892a64fa9aff93749e 2026-04-02 08:57:51,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:51,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c892a64fa9aff93749e HTTP/1.1" 200 None 2026-04-02 08:57:51,273 - lava_callback - DEBUG - Processing node 69cb8c892a64fa9aff93749e: baseline-arm-clabbe 2026-04-02 08:57:51,273 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8c892a64fa9aff93749e 2026-04-02 08:57:51,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:51,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8c892a64fa9aff93749e HTTP/1.1" 200 None 2026-04-02 08:57:51,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:51,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:57:51,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:51,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8c892a64fa9aff93749e HTTP/1.1" 200 None 2026-04-02 08:57:51,333 - lava_callback - ERROR - Error processing callback for node 69cb8c892a64fa9aff93749e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57526 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:57:56,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:57:56,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41190 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:58:08,547 - lava_callback - INFO - Received callback for node 69ce2b48cb08ea23a1f68389 INFO: 172.21.0.1:41192 - "POST /node/69ce2b48cb08ea23a1f68389 HTTP/1.0" 202 Accepted 2026-04-02 08:58:08,553 - lava_callback - INFO - Starting async job submit for node 69ce2b48cb08ea23a1f68389 2026-04-02 08:58:08,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:08,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b48cb08ea23a1f68389 HTTP/1.1" 200 None 2026-04-02 08:58:08,593 - lava_callback - DEBUG - Processing node 69ce2b48cb08ea23a1f68389: ltp-cve 2026-04-02 08:58:08,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:58:09,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:09,096 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69ce2b48cb08ea23a1f68389/log.txt.gz 2026-04-02 08:58:09,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:58:09,556 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:09,558 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69ce2b48cb08ea23a1f68389/lava-logs.yaml 2026-04-02 08:58:09,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:58:09,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:09,743 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69ce2b48cb08ea23a1f68389/lava_callback.json.gz 2026-04-02 08:58:09,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:09,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b48cb08ea23a1f68389 HTTP/1.1" 200 None 2026-04-02 08:58:09,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:09,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:58:09,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:09,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b48cb08ea23a1f68389 HTTP/1.1" 200 None 2026-04-02 08:58:09,845 - lava_callback - INFO - Completed processing callback for node 69ce2b48cb08ea23a1f68389 INFO: 172.21.0.1:38234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:58:26,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:26,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 08:58:29,359 - lava_callback - INFO - Received callback for node 69ce2b4bcb08ea23a1f683a3 INFO: 172.21.0.1:51808 - "POST /node/69ce2b4bcb08ea23a1f683a3 HTTP/1.0" 202 Accepted 2026-04-02 08:58:29,365 - lava_callback - INFO - Starting async job submit for node 69ce2b4bcb08ea23a1f683a3 2026-04-02 08:58:29,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:29,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4bcb08ea23a1f683a3 HTTP/1.1" 200 None 2026-04-02 08:58:29,410 - lava_callback - DEBUG - Processing node 69ce2b4bcb08ea23a1f683a3: ltp-fs_bind 2026-04-02 08:58:29,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:58:29,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:29,915 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ce2b4bcb08ea23a1f683a3/log.txt.gz 2026-04-02 08:58:30,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:58:30,387 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:30,390 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ce2b4bcb08ea23a1f683a3/lava-logs.yaml 2026-04-02 08:58:30,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:51450 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:58:30,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:58:30,561 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69ce2b4bcb08ea23a1f683a3/lava_callback.json.gz 2026-04-02 08:58:30,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:30,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4bcb08ea23a1f683a3 HTTP/1.1" 200 None 2026-04-02 08:58:30,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:30,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:58:30,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:30,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b4bcb08ea23a1f683a3 HTTP/1.1" 200 None 2026-04-02 08:58:30,660 - lava_callback - INFO - Completed processing callback for node 69ce2b4bcb08ea23a1f683a3 INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36964 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:58:56,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:58:56,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:59:08,699 - lava_callback - INFO - Received callback for node 69ce2fcacb08ea23a1f68640 INFO: 172.21.0.1:58954 - "POST /node/69ce2fcacb08ea23a1f68640 HTTP/1.0" 202 Accepted 2026-04-02 08:59:08,705 - lava_callback - INFO - Starting async job submit for node 69ce2fcacb08ea23a1f68640 2026-04-02 08:59:08,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:08,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2fcacb08ea23a1f68640 HTTP/1.1" 200 None 2026-04-02 08:59:08,734 - lava_callback - DEBUG - Processing node 69ce2fcacb08ea23a1f68640: baseline-arm 2026-04-02 08:59:08,739 - lava_callback - WARNING - Failed to upload log 2026-04-02 08:59:08,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:59:08,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:59:08,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2fcacb08ea23a1f68640/lava-logs.yaml 2026-04-02 08:59:08,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 08:59:09,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 08:59:09,011 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce2fcacb08ea23a1f68640/lava_callback.json.gz 2026-04-02 08:59:09,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:09,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2fcacb08ea23a1f68640 HTTP/1.1" 200 None 2026-04-02 08:59:09,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:09,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 08:59:09,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:09,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2fcacb08ea23a1f68640 HTTP/1.1" 200 None 2026-04-02 08:59:09,086 - lava_callback - INFO - Completed processing callback for node 69ce2fcacb08ea23a1f68640 2026-04-02 08:59:11,369 - lava_callback - INFO - Received callback for node 69cb8cd52a64fa9aff9374f5 INFO: 172.21.0.1:48780 - "POST /node/69cb8cd52a64fa9aff9374f5 HTTP/1.0" 202 Accepted 2026-04-02 08:59:11,375 - lava_callback - INFO - Starting async job submit for node 69cb8cd52a64fa9aff9374f5 2026-04-02 08:59:11,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:11,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8cd52a64fa9aff9374f5 HTTP/1.1" 200 None 2026-04-02 08:59:11,392 - lava_callback - DEBUG - Processing node 69cb8cd52a64fa9aff9374f5: baseline-arm-clabbe 2026-04-02 08:59:11,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8cd52a64fa9aff9374f5 2026-04-02 08:59:11,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:11,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8cd52a64fa9aff9374f5 HTTP/1.1" 200 None 2026-04-02 08:59:11,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:11,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:59:11,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:11,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8cd52a64fa9aff9374f5 HTTP/1.1" 200 None 2026-04-02 08:59:11,450 - lava_callback - ERROR - Error processing callback for node 69cb8cd52a64fa9aff9374f5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53626 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:59:26,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:26,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK 2026-04-02 08:59:51,253 - lava_callback - INFO - Received callback for node 69cb8cfb2a64fa9aff937505 INFO: 172.21.0.1:39482 - "POST /node/69cb8cfb2a64fa9aff937505 HTTP/1.0" 202 Accepted 2026-04-02 08:59:51,258 - lava_callback - INFO - Starting async job submit for node 69cb8cfb2a64fa9aff937505 2026-04-02 08:59:51,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:51,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8cfb2a64fa9aff937505 HTTP/1.1" 200 None 2026-04-02 08:59:51,282 - lava_callback - DEBUG - Processing node 69cb8cfb2a64fa9aff937505: baseline-arm-clabbe 2026-04-02 08:59:51,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8cfb2a64fa9aff937505 2026-04-02 08:59:51,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:51,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8cfb2a64fa9aff937505 HTTP/1.1" 200 None 2026-04-02 08:59:51,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:51,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 08:59:51,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 08:59:51,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8cfb2a64fa9aff937505 HTTP/1.1" 200 None 2026-04-02 08:59:51,353 - lava_callback - ERROR - Error processing callback for node 69cb8cfb2a64fa9aff937505: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38220 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:00:31,941 - lava_callback - INFO - Received callback for node 69cb8d222a64fa9aff937521 INFO: 172.21.0.1:38228 - "POST /node/69cb8d222a64fa9aff937521 HTTP/1.0" 202 Accepted 2026-04-02 09:00:31,946 - lava_callback - INFO - Starting async job submit for node 69cb8d222a64fa9aff937521 2026-04-02 09:00:31,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:31,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8d222a64fa9aff937521 HTTP/1.1" 200 None 2026-04-02 09:00:31,996 - lava_callback - DEBUG - Processing node 69cb8d222a64fa9aff937521: baseline-arm-clabbe 2026-04-02 09:00:31,997 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8d222a64fa9aff937521 2026-04-02 09:00:31,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:32,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8d222a64fa9aff937521 HTTP/1.1" 200 None 2026-04-02 09:00:32,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:32,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 09:00:32,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:32,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8d222a64fa9aff937521 HTTP/1.1" 200 None 2026-04-02 09:00:32,063 - lava_callback - ERROR - Error processing callback for node 69cb8d222a64fa9aff937521: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54350 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:00:49,044 - lava_callback - INFO - Received callback for node 69ce2b4ecb08ea23a1f683a7 INFO: 172.21.0.1:54352 - "POST /node/69ce2b4ecb08ea23a1f683a7 HTTP/1.0" 202 Accepted 2026-04-02 09:00:49,051 - lava_callback - INFO - Starting async job submit for node 69ce2b4ecb08ea23a1f683a7 2026-04-02 09:00:49,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:49,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4ecb08ea23a1f683a7 HTTP/1.1" 200 None 2026-04-02 09:00:49,094 - lava_callback - DEBUG - Processing node 69ce2b4ecb08ea23a1f683a7: ltp-fsx 2026-04-02 09:00:49,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:00:49,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:00:49,621 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69ce2b4ecb08ea23a1f683a7/log.txt.gz 2026-04-02 09:00:49,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:00:50,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:00:50,054 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69ce2b4ecb08ea23a1f683a7/lava-logs.yaml 2026-04-02 09:00:50,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:00:50,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:00:50,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69ce2b4ecb08ea23a1f683a7/lava_callback.json.gz 2026-04-02 09:00:50,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:50,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b4ecb08ea23a1f683a7 HTTP/1.1" 200 None 2026-04-02 09:00:50,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:50,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:00:50,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:50,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b4ecb08ea23a1f683a7 HTTP/1.1" 200 None 2026-04-02 09:00:50,325 - lava_callback - INFO - Completed processing callback for node 69ce2b4ecb08ea23a1f683a7 INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:00:56,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:00:57,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58468 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:01:45,531 - lava_callback - INFO - Received callback for node 69ce2b51cb08ea23a1f683ab INFO: 172.21.0.1:33470 - "POST /node/69ce2b51cb08ea23a1f683ab HTTP/1.0" 202 Accepted 2026-04-02 09:01:45,538 - lava_callback - INFO - Starting async job submit for node 69ce2b51cb08ea23a1f683ab 2026-04-02 09:01:45,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:01:45,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b51cb08ea23a1f683ab HTTP/1.1" 200 None 2026-04-02 09:01:45,590 - lava_callback - DEBUG - Processing node 69ce2b51cb08ea23a1f683ab: ltp-input 2026-04-02 09:01:45,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:01:46,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:01:46,099 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69ce2b51cb08ea23a1f683ab/log.txt.gz 2026-04-02 09:01:46,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:01:46,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:01:46,592 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69ce2b51cb08ea23a1f683ab/lava-logs.yaml 2026-04-02 09:01:46,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:01:46,792 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:01:46,794 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69ce2b51cb08ea23a1f683ab/lava_callback.json.gz 2026-04-02 09:01:46,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:01:46,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b51cb08ea23a1f683ab HTTP/1.1" 200 None 2026-04-02 09:01:46,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:01:46,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:01:46,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:01:46,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b51cb08ea23a1f683ab HTTP/1.1" 200 None 2026-04-02 09:01:46,880 - lava_callback - INFO - Completed processing callback for node 69ce2b51cb08ea23a1f683ab INFO: 172.21.0.1:33778 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:01:57,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:01:57,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38078 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:02:08,692 - lava_callback - INFO - Received callback for node 69ce2b54cb08ea23a1f683ae INFO: 172.21.0.1:38094 - "POST /node/69ce2b54cb08ea23a1f683ae HTTP/1.0" 202 Accepted 2026-04-02 09:02:08,700 - lava_callback - INFO - Starting async job submit for node 69ce2b54cb08ea23a1f683ae 2026-04-02 09:02:08,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:08,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b54cb08ea23a1f683ae HTTP/1.1" 200 None 2026-04-02 09:02:08,748 - lava_callback - DEBUG - Processing node 69ce2b54cb08ea23a1f683ae: ltp-ipc 2026-04-02 09:02:09,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:09,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:09,333 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69ce2b54cb08ea23a1f683ae/log.txt.gz 2026-04-02 09:02:09,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:09,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:09,778 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69ce2b54cb08ea23a1f683ae/lava-logs.yaml 2026-04-02 09:02:09,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:09,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:09,991 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69ce2b54cb08ea23a1f683ae/lava_callback.json.gz 2026-04-02 09:02:10,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:10,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b54cb08ea23a1f683ae HTTP/1.1" 200 None 2026-04-02 09:02:10,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:10,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:02:10,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:10,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b54cb08ea23a1f683ae HTTP/1.1" 200 None 2026-04-02 09:02:10,109 - lava_callback - INFO - Completed processing callback for node 69ce2b54cb08ea23a1f683ae INFO: 172.21.0.1:48638 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48650 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:02:22,986 - lava_callback - INFO - Received callback for node 69cb8d972a64fa9aff937546 INFO: 172.21.0.1:42810 - "POST /node/69cb8d972a64fa9aff937546 HTTP/1.0" 202 Accepted 2026-04-02 09:02:22,992 - lava_callback - INFO - Starting async job submit for node 69cb8d972a64fa9aff937546 2026-04-02 09:02:22,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:23,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8d972a64fa9aff937546 HTTP/1.1" 200 None 2026-04-02 09:02:23,013 - lava_callback - DEBUG - Processing node 69cb8d972a64fa9aff937546: baseline-arm64-baylibre 2026-04-02 09:02:23,013 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8d972a64fa9aff937546 2026-04-02 09:02:23,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:23,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8d972a64fa9aff937546 HTTP/1.1" 200 None 2026-04-02 09:02:23,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:23,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:02:23,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:23,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8d972a64fa9aff937546 HTTP/1.1" 200 None 2026-04-02 09:02:23,080 - lava_callback - ERROR - Error processing callback for node 69cb8d972a64fa9aff937546: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42812 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:02:27,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:27,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:02:28,980 - lava_callback - INFO - Received callback for node 69ce2b55cb08ea23a1f683b1 INFO: 172.21.0.1:42820 - "POST /node/69ce2b55cb08ea23a1f683b1 HTTP/1.0" 202 Accepted 2026-04-02 09:02:28,986 - lava_callback - INFO - Starting async job submit for node 69ce2b55cb08ea23a1f683b1 2026-04-02 09:02:29,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:29,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b55cb08ea23a1f683b1 HTTP/1.1" 200 None 2026-04-02 09:02:29,027 - lava_callback - DEBUG - Processing node 69ce2b55cb08ea23a1f683b1: ltp-pty 2026-04-02 09:02:29,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:29,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:29,498 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69ce2b55cb08ea23a1f683b1/log.txt.gz 2026-04-02 09:02:29,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:30,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:30,012 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69ce2b55cb08ea23a1f683b1/lava-logs.yaml 2026-04-02 09:02:30,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:02:30,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:02:30,223 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69ce2b55cb08ea23a1f683b1/lava_callback.json.gz 2026-04-02 09:02:30,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:30,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b55cb08ea23a1f683b1 HTTP/1.1" 200 None 2026-04-02 09:02:30,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:30,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:02:30,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:30,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b55cb08ea23a1f683b1 HTTP/1.1" 200 None 2026-04-02 09:02:30,341 - lava_callback - INFO - Completed processing callback for node 69ce2b55cb08ea23a1f683b1 INFO: 172.21.0.1:49772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56030 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:02:57,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:02:57,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:03:43,029 - lava_callback - INFO - Received callback for node 69cb8de62a64fa9aff93755a INFO: 172.21.0.1:33472 - "POST /node/69cb8de62a64fa9aff93755a HTTP/1.0" 202 Accepted 2026-04-02 09:03:43,035 - lava_callback - INFO - Starting async job submit for node 69cb8de62a64fa9aff93755a 2026-04-02 09:03:43,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:03:43,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8de62a64fa9aff93755a HTTP/1.1" 200 None 2026-04-02 09:03:43,051 - lava_callback - DEBUG - Processing node 69cb8de62a64fa9aff93755a: baseline-arm64-baylibre 2026-04-02 09:03:43,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8de62a64fa9aff93755a 2026-04-02 09:03:43,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:03:43,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8de62a64fa9aff93755a HTTP/1.1" 200 None 2026-04-02 09:03:43,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:03:43,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:03:43,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:03:43,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8de62a64fa9aff93755a HTTP/1.1" 200 None 2026-04-02 09:03:43,123 - lava_callback - ERROR - Error processing callback for node 69cb8de62a64fa9aff93755a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:03,253 - lava_callback - INFO - Received callback for node 69cb8e332a64fa9aff93756b INFO: 172.21.0.1:50486 - "POST /node/69cb8e332a64fa9aff93756b HTTP/1.0" 202 Accepted 2026-04-02 09:05:03,258 - lava_callback - INFO - Starting async job submit for node 69cb8e332a64fa9aff93756b 2026-04-02 09:05:03,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:03,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8e332a64fa9aff93756b HTTP/1.1" 200 None 2026-04-02 09:05:03,275 - lava_callback - DEBUG - Processing node 69cb8e332a64fa9aff93756b: baseline-arm64-baylibre 2026-04-02 09:05:03,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8e332a64fa9aff93756b 2026-04-02 09:05:03,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:03,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8e332a64fa9aff93756b HTTP/1.1" 200 None 2026-04-02 09:05:03,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:03,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:05:03,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:03,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8e332a64fa9aff93756b HTTP/1.1" 200 None 2026-04-02 09:05:03,349 - lava_callback - ERROR - Error processing callback for node 69cb8e332a64fa9aff93756b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50498 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:08,890 - lava_callback - INFO - Received callback for node 69ce2b57cb08ea23a1f683b4 INFO: 172.21.0.1:50512 - "POST /node/69ce2b57cb08ea23a1f683b4 HTTP/1.0" 202 Accepted 2026-04-02 09:05:08,897 - lava_callback - INFO - Starting async job submit for node 69ce2b57cb08ea23a1f683b4 2026-04-02 09:05:08,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:08,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b57cb08ea23a1f683b4 HTTP/1.1" 200 None 2026-04-02 09:05:08,941 - lava_callback - DEBUG - Processing node 69ce2b57cb08ea23a1f683b4: ltp-sched 2026-04-02 09:05:09,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:05:09,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:09,485 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69ce2b57cb08ea23a1f683b4/log.txt.gz 2026-04-02 09:05:09,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:05:09,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:09,948 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69ce2b57cb08ea23a1f683b4/lava-logs.yaml 2026-04-02 09:05:09,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:05:10,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:10,169 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69ce2b57cb08ea23a1f683b4/lava_callback.json.gz 2026-04-02 09:05:10,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:10,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b57cb08ea23a1f683b4 HTTP/1.1" 200 None 2026-04-02 09:05:10,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:10,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:05:10,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:10,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b57cb08ea23a1f683b4 HTTP/1.1" 200 None 2026-04-02 09:05:10,262 - lava_callback - INFO - Completed processing callback for node 69ce2b57cb08ea23a1f683b4 INFO: 172.21.0.1:34892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60382 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:27,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:27,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38446 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:46,064 - lava_callback - INFO - Received callback for node 69ce2b59cb08ea23a1f683b7 INFO: 172.21.0.1:33132 - "POST /node/69ce2b59cb08ea23a1f683b7 HTTP/1.0" 202 Accepted 2026-04-02 09:05:46,071 - lava_callback - INFO - Starting async job submit for node 69ce2b59cb08ea23a1f683b7 2026-04-02 09:05:46,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:46,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b59cb08ea23a1f683b7 HTTP/1.1" 200 None 2026-04-02 09:05:46,119 - lava_callback - DEBUG - Processing node 69ce2b59cb08ea23a1f683b7: ltp-smoke 2026-04-02 09:05:46,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:46,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:46,785 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2b59cb08ea23a1f683b7/log.txt.gz 2026-04-02 09:05:46,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:05:47,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:47,202 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2b59cb08ea23a1f683b7/lava-logs.yaml 2026-04-02 09:05:47,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:05:47,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:05:47,372 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce2b59cb08ea23a1f683b7/lava_callback.json.gz 2026-04-02 09:05:47,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:47,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b59cb08ea23a1f683b7 HTTP/1.1" 200 None 2026-04-02 09:05:47,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:47,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:05:47,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:47,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b59cb08ea23a1f683b7 HTTP/1.1" 200 None 2026-04-02 09:05:47,461 - lava_callback - INFO - Completed processing callback for node 69ce2b59cb08ea23a1f683b7 INFO: 172.21.0.1:59626 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:05:57,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:05:57,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40496 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:06:08,816 - lava_callback - INFO - Received callback for node 69ce2b5dcb08ea23a1f683c0 INFO: 172.21.0.1:40498 - "POST /node/69ce2b5dcb08ea23a1f683c0 HTTP/1.0" 202 Accepted 2026-04-02 09:06:08,823 - lava_callback - INFO - Starting async job submit for node 69ce2b5dcb08ea23a1f683c0 2026-04-02 09:06:08,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:08,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5dcb08ea23a1f683c0 HTTP/1.1" 200 None 2026-04-02 09:06:08,865 - lava_callback - DEBUG - Processing node 69ce2b5dcb08ea23a1f683c0: ltp-syscalls-ipc 2026-04-02 09:06:09,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:09,391 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:09,393 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ce2b5dcb08ea23a1f683c0/log.txt.gz 2026-04-02 09:06:09,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:09,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:09,849 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ce2b5dcb08ea23a1f683c0/lava-logs.yaml 2026-04-02 09:06:09,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:10,038 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:10,040 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69ce2b5dcb08ea23a1f683c0/lava_callback.json.gz 2026-04-02 09:06:10,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:10,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5dcb08ea23a1f683c0 HTTP/1.1" 200 None 2026-04-02 09:06:10,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:10,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:06:10,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:10,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b5dcb08ea23a1f683c0 HTTP/1.1" 200 None 2026-04-02 09:06:10,133 - lava_callback - INFO - Completed processing callback for node 69ce2b5dcb08ea23a1f683c0 INFO: 172.21.0.1:49466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49472 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:06:23,229 - lava_callback - INFO - Received callback for node 69cb8e812a64fa9aff937572 INFO: 172.21.0.1:37834 - "POST /node/69cb8e812a64fa9aff937572 HTTP/1.0" 202 Accepted 2026-04-02 09:06:23,235 - lava_callback - INFO - Starting async job submit for node 69cb8e812a64fa9aff937572 2026-04-02 09:06:23,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:23,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8e812a64fa9aff937572 HTTP/1.1" 200 None 2026-04-02 09:06:23,251 - lava_callback - DEBUG - Processing node 69cb8e812a64fa9aff937572: baseline-arm64-baylibre 2026-04-02 09:06:23,251 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8e812a64fa9aff937572 2026-04-02 09:06:23,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:23,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8e812a64fa9aff937572 HTTP/1.1" 200 None 2026-04-02 09:06:23,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:23,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:06:23,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:23,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8e812a64fa9aff937572 HTTP/1.1" 200 None 2026-04-02 09:06:23,304 - lava_callback - ERROR - Error processing callback for node 69cb8e812a64fa9aff937572: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:06:27,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:27,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:06:28,864 - lava_callback - INFO - Received callback for node 69ce2b5fcb08ea23a1f683c3 INFO: 172.21.0.1:37852 - "POST /node/69ce2b5fcb08ea23a1f683c3 HTTP/1.0" 202 Accepted 2026-04-02 09:06:28,870 - lava_callback - INFO - Starting async job submit for node 69ce2b5fcb08ea23a1f683c3 2026-04-02 09:06:28,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:28,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5fcb08ea23a1f683c3 HTTP/1.1" 200 None 2026-04-02 09:06:28,910 - lava_callback - DEBUG - Processing node 69ce2b5fcb08ea23a1f683c3: ltp-timers 2026-04-02 09:06:29,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:29,459 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:29,461 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69ce2b5fcb08ea23a1f683c3/log.txt.gz 2026-04-02 09:06:29,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:29,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:29,895 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69ce2b5fcb08ea23a1f683c3/lava-logs.yaml 2026-04-02 09:06:29,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:06:30,073 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:06:30,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69ce2b5fcb08ea23a1f683c3/lava_callback.json.gz 2026-04-02 09:06:30,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:30,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b5fcb08ea23a1f683c3 HTTP/1.1" 200 None 2026-04-02 09:06:30,138 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:30,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:06:30,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:30,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b5fcb08ea23a1f683c3 HTTP/1.1" 200 None 2026-04-02 09:06:30,178 - lava_callback - INFO - Completed processing callback for node 69ce2b5fcb08ea23a1f683c3 INFO: 172.21.0.1:55462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54426 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:06:57,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:06:57,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:07:43,470 - lava_callback - INFO - Received callback for node 69cb8ecf2a64fa9aff937581 INFO: 172.21.0.1:42720 - "POST /node/69cb8ecf2a64fa9aff937581 HTTP/1.0" 202 Accepted 2026-04-02 09:07:43,475 - lava_callback - INFO - Starting async job submit for node 69cb8ecf2a64fa9aff937581 2026-04-02 09:07:43,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:07:43,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8ecf2a64fa9aff937581 HTTP/1.1" 200 None 2026-04-02 09:07:43,491 - lava_callback - DEBUG - Processing node 69cb8ecf2a64fa9aff937581: baseline-arm64-baylibre 2026-04-02 09:07:43,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8ecf2a64fa9aff937581 2026-04-02 09:07:43,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:07:43,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8ecf2a64fa9aff937581 HTTP/1.1" 200 None 2026-04-02 09:07:43,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:07:43,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:07:43,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:07:43,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8ecf2a64fa9aff937581 HTTP/1.1" 200 None 2026-04-02 09:07:43,580 - lava_callback - ERROR - Error processing callback for node 69cb8ecf2a64fa9aff937581: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39586 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:09:03,336 - lava_callback - INFO - Received callback for node 69cb8f1d2a64fa9aff93758a INFO: 172.21.0.1:50360 - "POST /node/69cb8f1d2a64fa9aff93758a HTTP/1.0" 202 Accepted 2026-04-02 09:09:03,342 - lava_callback - INFO - Starting async job submit for node 69cb8f1d2a64fa9aff93758a 2026-04-02 09:09:03,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:03,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8f1d2a64fa9aff93758a HTTP/1.1" 200 None 2026-04-02 09:09:03,360 - lava_callback - DEBUG - Processing node 69cb8f1d2a64fa9aff93758a: baseline-arm64-baylibre 2026-04-02 09:09:03,361 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8f1d2a64fa9aff93758a 2026-04-02 09:09:03,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:03,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8f1d2a64fa9aff93758a HTTP/1.1" 200 None 2026-04-02 09:09:03,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:03,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:09:03,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:03,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8f1d2a64fa9aff93758a HTTP/1.1" 200 None 2026-04-02 09:09:03,418 - lava_callback - ERROR - Error processing callback for node 69cb8f1d2a64fa9aff93758a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50086 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:09:29,172 - lava_callback - INFO - Received callback for node 69ce2b60cb08ea23a1f683c6 INFO: 172.21.0.1:50100 - "POST /node/69ce2b60cb08ea23a1f683c6 HTTP/1.0" 202 Accepted 2026-04-02 09:09:29,179 - lava_callback - INFO - Starting async job submit for node 69ce2b60cb08ea23a1f683c6 2026-04-02 09:09:29,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:29,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b60cb08ea23a1f683c6 HTTP/1.1" 200 None 2026-04-02 09:09:29,227 - lava_callback - DEBUG - Processing node 69ce2b60cb08ea23a1f683c6: ltp-watchqueue 2026-04-02 09:09:29,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:09:29,731 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:09:29,733 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ce2b60cb08ea23a1f683c6/log.txt.gz 2026-04-02 09:09:29,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:09:30,304 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:09:30,306 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ce2b60cb08ea23a1f683c6/lava-logs.yaml 2026-04-02 09:09:30,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:09:30,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:09:30,484 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69ce2b60cb08ea23a1f683c6/lava_callback.json.gz 2026-04-02 09:09:30,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:30,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b60cb08ea23a1f683c6 HTTP/1.1" 200 None 2026-04-02 09:09:30,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:30,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:09:30,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:30,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b60cb08ea23a1f683c6 HTTP/1.1" 200 None 2026-04-02 09:09:30,590 - lava_callback - INFO - Completed processing callback for node 69ce2b60cb08ea23a1f683c6 INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58670 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:09:57,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:09:57,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35388 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:10:32,042 - lava_callback - INFO - Received callback for node 69cb8f712a64fa9aff937598 INFO: 172.21.0.1:35392 - "POST /node/69cb8f712a64fa9aff937598 HTTP/1.0" 202 Accepted 2026-04-02 09:10:32,048 - lava_callback - INFO - Starting async job submit for node 69cb8f712a64fa9aff937598 2026-04-02 09:10:32,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:10:32,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8f712a64fa9aff937598 HTTP/1.1" 200 None 2026-04-02 09:10:32,069 - lava_callback - DEBUG - Processing node 69cb8f712a64fa9aff937598: baseline-arm64-clabbe 2026-04-02 09:10:32,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8f712a64fa9aff937598 2026-04-02 09:10:32,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:10:32,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8f712a64fa9aff937598 HTTP/1.1" 200 None 2026-04-02 09:10:32,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:10:32,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:10:32,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:10:32,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8f712a64fa9aff937598 HTTP/1.1" 200 None 2026-04-02 09:10:32,141 - lava_callback - ERROR - Error processing callback for node 69cb8f712a64fa9aff937598: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57288 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:11:31,819 - lava_callback - INFO - Received callback for node 69cb8fbf2a64fa9aff9375a5 INFO: 172.21.0.1:57292 - "POST /node/69cb8fbf2a64fa9aff9375a5 HTTP/1.0" 202 Accepted 2026-04-02 09:11:31,824 - lava_callback - INFO - Starting async job submit for node 69cb8fbf2a64fa9aff9375a5 2026-04-02 09:11:31,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:11:31,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8fbf2a64fa9aff9375a5 HTTP/1.1" 200 None 2026-04-02 09:11:31,841 - lava_callback - DEBUG - Processing node 69cb8fbf2a64fa9aff9375a5: baseline-arm64-clabbe 2026-04-02 09:11:31,842 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb8fbf2a64fa9aff9375a5 2026-04-02 09:11:31,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:11:31,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb8fbf2a64fa9aff9375a5 HTTP/1.1" 200 None 2026-04-02 09:11:31,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:11:31,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:11:31,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:11:31,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb8fbf2a64fa9aff9375a5 HTTP/1.1" 200 None 2026-04-02 09:11:31,904 - lava_callback - ERROR - Error processing callback for node 69cb8fbf2a64fa9aff9375a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:12:51,856 - lava_callback - INFO - Received callback for node 69cb900c2a64fa9aff9375ae INFO: 172.21.0.1:52086 - "POST /node/69cb900c2a64fa9aff9375ae HTTP/1.0" 202 Accepted 2026-04-02 09:12:51,861 - lava_callback - INFO - Starting async job submit for node 69cb900c2a64fa9aff9375ae 2026-04-02 09:12:51,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:12:51,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb900c2a64fa9aff9375ae HTTP/1.1" 200 None 2026-04-02 09:12:51,877 - lava_callback - DEBUG - Processing node 69cb900c2a64fa9aff9375ae: baseline-arm64-clabbe 2026-04-02 09:12:51,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb900c2a64fa9aff9375ae 2026-04-02 09:12:51,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:12:51,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb900c2a64fa9aff9375ae HTTP/1.1" 200 None 2026-04-02 09:12:51,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:12:51,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:12:51,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:12:51,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb900c2a64fa9aff9375ae HTTP/1.1" 200 None 2026-04-02 09:12:51,940 - lava_callback - ERROR - Error processing callback for node 69cb900c2a64fa9aff9375ae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:14:11,938 - lava_callback - INFO - Received callback for node 69cb905a2a64fa9aff9375b9 INFO: 172.21.0.1:41052 - "POST /node/69cb905a2a64fa9aff9375b9 HTTP/1.0" 202 Accepted 2026-04-02 09:14:11,944 - lava_callback - INFO - Starting async job submit for node 69cb905a2a64fa9aff9375b9 2026-04-02 09:14:11,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:14:11,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb905a2a64fa9aff9375b9 HTTP/1.1" 200 None 2026-04-02 09:14:11,959 - lava_callback - DEBUG - Processing node 69cb905a2a64fa9aff9375b9: baseline-arm64-clabbe 2026-04-02 09:14:11,959 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb905a2a64fa9aff9375b9 2026-04-02 09:14:11,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:14:11,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb905a2a64fa9aff9375b9 HTTP/1.1" 200 None 2026-04-02 09:14:11,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:14:11,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:14:11,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:14:12,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb905a2a64fa9aff9375b9 HTTP/1.1" 200 None 2026-04-02 09:14:12,018 - lava_callback - ERROR - Error processing callback for node 69cb905a2a64fa9aff9375b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47908 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:15:31,950 - lava_callback - INFO - Received callback for node 69cb90a82a64fa9aff9375c5 INFO: 172.21.0.1:47920 - "POST /node/69cb90a82a64fa9aff9375c5 HTTP/1.0" 202 Accepted 2026-04-02 09:15:31,957 - lava_callback - INFO - Starting async job submit for node 69cb90a82a64fa9aff9375c5 2026-04-02 09:15:31,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:15:31,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb90a82a64fa9aff9375c5 HTTP/1.1" 200 None 2026-04-02 09:15:31,973 - lava_callback - DEBUG - Processing node 69cb90a82a64fa9aff9375c5: baseline-arm64-clabbe 2026-04-02 09:15:31,974 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb90a82a64fa9aff9375c5 2026-04-02 09:15:31,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:15:31,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb90a82a64fa9aff9375c5 HTTP/1.1" 200 None 2026-04-02 09:15:31,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:15:32,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:15:32,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:15:32,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb90a82a64fa9aff9375c5 HTTP/1.1" 200 None 2026-04-02 09:15:32,042 - lava_callback - ERROR - Error processing callback for node 69cb90a82a64fa9aff9375c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36758 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:16:52,048 - lava_callback - INFO - Received callback for node 69cb90f52a64fa9aff9375d2 INFO: 172.21.0.1:43322 - "POST /node/69cb90f52a64fa9aff9375d2 HTTP/1.0" 202 Accepted 2026-04-02 09:16:52,054 - lava_callback - INFO - Starting async job submit for node 69cb90f52a64fa9aff9375d2 2026-04-02 09:16:52,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:16:52,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb90f52a64fa9aff9375d2 HTTP/1.1" 200 None 2026-04-02 09:16:52,090 - lava_callback - DEBUG - Processing node 69cb90f52a64fa9aff9375d2: baseline-arm64-clabbe 2026-04-02 09:16:52,091 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb90f52a64fa9aff9375d2 2026-04-02 09:16:52,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:16:52,105 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb90f52a64fa9aff9375d2 HTTP/1.1" 200 None 2026-04-02 09:16:52,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:16:52,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 09:16:52,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:16:52,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb90f52a64fa9aff9375d2 HTTP/1.1" 200 None 2026-04-02 09:16:52,153 - lava_callback - ERROR - Error processing callback for node 69cb90f52a64fa9aff9375d2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:17:23,883 - lava_callback - INFO - Received callback for node 69ce2b2ecb08ea23a1f6836c INFO: 172.21.0.1:60568 - "POST /node/69ce2b2ecb08ea23a1f6836c HTTP/1.0" 202 Accepted 2026-04-02 09:17:23,929 - lava_callback - INFO - Starting async job submit for node 69ce2b2ecb08ea23a1f6836c 2026-04-02 09:17:23,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:17:23,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2ecb08ea23a1f6836c HTTP/1.1" 200 None 2026-04-02 09:17:23,969 - lava_callback - DEBUG - Processing node 69ce2b2ecb08ea23a1f6836c: baseline-arm-pengutronix 2026-04-02 09:17:24,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:17:24,204 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:17:24,205 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ecb08ea23a1f6836c/log.txt.gz 2026-04-02 09:17:24,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:17:24,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:17:24,485 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ecb08ea23a1f6836c/lava-logs.yaml 2026-04-02 09:17:24,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:17:24,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:17:24,624 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce2b2ecb08ea23a1f6836c/lava_callback.json.gz DEBUG: Setup failed for 69ce2b2ecb08ea23a1f6836c. Transitting job node result: incomplete -> fail 2026-04-02 09:17:24,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:17:24,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2b2ecb08ea23a1f6836c HTTP/1.1" 200 None 2026-04-02 09:17:24,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:17:24,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:17:24,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:17:24,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2b2ecb08ea23a1f6836c HTTP/1.1" 200 None 2026-04-02 09:17:24,791 - lava_callback - INFO - Completed processing callback for node 69ce2b2ecb08ea23a1f6836c INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:17:27,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:17:27,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42020 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:20:24,715 - lava_callback - INFO - Received callback for node 69ce34bbcb08ea23a1f687a0 INFO: 172.21.0.1:43828 - "POST /node/69ce34bbcb08ea23a1f687a0 HTTP/1.0" 202 Accepted 2026-04-02 09:20:24,728 - lava_callback - INFO - Starting async job submit for node 69ce34bbcb08ea23a1f687a0 2026-04-02 09:20:24,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:24,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bbcb08ea23a1f687a0 HTTP/1.1" 200 None 2026-04-02 09:20:24,802 - lava_callback - DEBUG - Processing node 69ce34bbcb08ea23a1f687a0: baseline-arm64 2026-04-02 09:20:24,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:25,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:25,076 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bbcb08ea23a1f687a0/log.txt.gz 2026-04-02 09:20:25,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:25,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:25,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bbcb08ea23a1f687a0/lava-logs.yaml 2026-04-02 09:20:25,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:25,575 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:25,577 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bbcb08ea23a1f687a0/lava_callback.json.gz 2026-04-02 09:20:25,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:25,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bbcb08ea23a1f687a0 HTTP/1.1" 200 None 2026-04-02 09:20:25,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:25,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:20:25,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:25,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34bbcb08ea23a1f687a0 HTTP/1.1" 200 None 2026-04-02 09:20:25,657 - lava_callback - INFO - Completed processing callback for node 69ce34bbcb08ea23a1f687a0 INFO: 172.21.0.1:43844 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:20:27,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:27,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:32822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:20:41,711 - lava_callback - INFO - Received callback for node 69ce34c9cb08ea23a1f687d5 INFO: 172.21.0.1:57036 - "POST /node/69ce34c9cb08ea23a1f687d5 HTTP/1.0" 202 Accepted 2026-04-02 09:20:41,718 - lava_callback - INFO - Starting async job submit for node 69ce34c9cb08ea23a1f687d5 2026-04-02 09:20:41,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:41,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c9cb08ea23a1f687d5 HTTP/1.1" 200 None 2026-04-02 09:20:41,778 - lava_callback - DEBUG - Processing node 69ce34c9cb08ea23a1f687d5: baseline-arm64 2026-04-02 09:20:41,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:42,121 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:42,123 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c9cb08ea23a1f687d5/log.txt.gz 2026-04-02 09:20:42,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:42,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:42,496 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c9cb08ea23a1f687d5/lava-logs.yaml 2026-04-02 09:20:42,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:42,647 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:42,649 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c9cb08ea23a1f687d5/lava_callback.json.gz 2026-04-02 09:20:42,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:42,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c9cb08ea23a1f687d5 HTTP/1.1" 200 None 2026-04-02 09:20:42,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:42,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:20:42,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:42,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c9cb08ea23a1f687d5 HTTP/1.1" 200 None 2026-04-02 09:20:42,743 - lava_callback - INFO - Completed processing callback for node 69ce34c9cb08ea23a1f687d5 2026-04-02 09:20:43,681 - lava_callback - INFO - Received callback for node 69ce34dacb08ea23a1f68802 INFO: 172.21.0.1:57048 - "POST /node/69ce34dacb08ea23a1f68802 HTTP/1.0" 202 Accepted 2026-04-02 09:20:43,687 - lava_callback - INFO - Starting async job submit for node 69ce34dacb08ea23a1f68802 2026-04-02 09:20:43,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:43,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dacb08ea23a1f68802 HTTP/1.1" 200 None 2026-04-02 09:20:43,728 - lava_callback - DEBUG - Processing node 69ce34dacb08ea23a1f68802: baseline-nfs-arm64 2026-04-02 09:20:43,730 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:20:43,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:43,887 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:43,888 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dacb08ea23a1f68802/lava-logs.yaml 2026-04-02 09:20:43,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:20:44,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:20:44,016 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dacb08ea23a1f68802/lava_callback.json.gz 2026-04-02 09:20:44,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:44,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dacb08ea23a1f68802 HTTP/1.1" 200 None 2026-04-02 09:20:44,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:44,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:20:44,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:44,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34dacb08ea23a1f68802 HTTP/1.1" 200 None 2026-04-02 09:20:44,080 - lava_callback - INFO - Completed processing callback for node 69ce34dacb08ea23a1f68802 INFO: 172.21.0.1:57056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:20:57,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:20:57,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:21:03,808 - lava_callback - INFO - Received callback for node 69ce34bdcb08ea23a1f687a6 INFO: 172.21.0.1:56792 - "POST /node/69ce34bdcb08ea23a1f687a6 HTTP/1.0" 202 Accepted 2026-04-02 09:21:03,824 - lava_callback - INFO - Starting async job submit for node 69ce34bdcb08ea23a1f687a6 2026-04-02 09:21:03,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:03,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bdcb08ea23a1f687a6 HTTP/1.1" 200 None 2026-04-02 09:21:03,916 - lava_callback - DEBUG - Processing node 69ce34bdcb08ea23a1f687a6: baseline-arm64 2026-04-02 09:21:04,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:04,395 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:04,397 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bdcb08ea23a1f687a6/log.txt.gz 2026-04-02 09:21:04,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:04,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:04,946 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bdcb08ea23a1f687a6/lava-logs.yaml 2026-04-02 09:21:04,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:05,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:05,253 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bdcb08ea23a1f687a6/lava_callback.json.gz 2026-04-02 09:21:05,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:05,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bdcb08ea23a1f687a6 HTTP/1.1" 200 None 2026-04-02 09:21:05,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:05,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:21:05,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:05,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34bdcb08ea23a1f687a6 HTTP/1.1" 200 None 2026-04-02 09:21:05,358 - lava_callback - INFO - Completed processing callback for node 69ce34bdcb08ea23a1f687a6 INFO: 172.21.0.1:56806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44026 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:21:27,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:27,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52680 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:21:39,188 - lava_callback - INFO - Received callback for node 69ce34bccb08ea23a1f687a3 INFO: 172.21.0.1:52682 - "POST /node/69ce34bccb08ea23a1f687a3 HTTP/1.0" 202 Accepted 2026-04-02 09:21:39,194 - lava_callback - INFO - Starting async job submit for node 69ce34bccb08ea23a1f687a3 2026-04-02 09:21:39,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:39,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bccb08ea23a1f687a3 HTTP/1.1" 200 None 2026-04-02 09:21:39,232 - lava_callback - DEBUG - Processing node 69ce34bccb08ea23a1f687a3: baseline-arm64 2026-04-02 09:21:39,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:39,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:39,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bccb08ea23a1f687a3/log.txt.gz 2026-04-02 09:21:39,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:40,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:40,086 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bccb08ea23a1f687a3/lava-logs.yaml 2026-04-02 09:21:40,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:21:40,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:21:40,271 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34bccb08ea23a1f687a3/lava_callback.json.gz 2026-04-02 09:21:40,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:40,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34bccb08ea23a1f687a3 HTTP/1.1" 200 None 2026-04-02 09:21:40,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:40,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:21:40,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:40,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34bccb08ea23a1f687a3 HTTP/1.1" 200 None 2026-04-02 09:21:40,372 - lava_callback - INFO - Completed processing callback for node 69ce34bccb08ea23a1f687a3 INFO: 172.21.0.1:53784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35004 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:21:57,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:21:57,296 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:22:06,079 - lava_callback - INFO - Received callback for node 69ce34eccb08ea23a1f6884f INFO: 172.21.0.1:60834 - "POST /node/69ce34eccb08ea23a1f6884f HTTP/1.0" 202 Accepted 2026-04-02 09:22:06,085 - lava_callback - INFO - Starting async job submit for node 69ce34eccb08ea23a1f6884f 2026-04-02 09:22:06,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:06,144 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34eccb08ea23a1f6884f HTTP/1.1" 200 None 2026-04-02 09:22:06,145 - lava_callback - DEBUG - Processing node 69ce34eccb08ea23a1f6884f: baseline-arm64-broonie 2026-04-02 09:22:06,417 - lava_callback - INFO - Received callback for node 69ce3505cb08ea23a1f688a3 INFO: 172.21.0.1:60844 - "POST /node/69ce3505cb08ea23a1f688a3 HTTP/1.0" 202 Accepted 2026-04-02 09:22:06,434 - lava_callback - INFO - Starting async job submit for node 69ce3505cb08ea23a1f688a3 2026-04-02 09:22:06,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:06,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:06,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3505cb08ea23a1f688a3 HTTP/1.1" 200 None 2026-04-02 09:22:06,517 - lava_callback - DEBUG - Processing node 69ce3505cb08ea23a1f688a3: baseline-arm64-foundriesio INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:06,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:06,767 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eccb08ea23a1f6884f/log.txt.gz 2026-04-02 09:22:06,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:07,047 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:07,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:07,234 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3505cb08ea23a1f688a3/log.txt.gz 2026-04-02 09:22:07,319 - lava_callback - INFO - Received callback for node 69ce3506cb08ea23a1f688a6 2026-04-02 09:22:07,333 - lava_callback - INFO - Starting async job submit for node 69ce3506cb08ea23a1f688a6 INFO: 172.21.0.1:60860 - "POST /node/69ce3506cb08ea23a1f688a6 HTTP/1.0" 202 Accepted 2026-04-02 09:22:07,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:07,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eccb08ea23a1f6884f/lava-logs.yaml 2026-04-02 09:22:07,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:07,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:07,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:07,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3506cb08ea23a1f688a6 HTTP/1.1" 200 None 2026-04-02 09:22:07,494 - lava_callback - DEBUG - Processing node 69ce3506cb08ea23a1f688a6: baseline-arm64-foundriesio 2026-04-02 09:22:07,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:07,809 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3505cb08ea23a1f688a3/lava-logs.yaml 2026-04-02 09:22:07,883 - lava_callback - INFO - Received callback for node 69ce34f4cb08ea23a1f6885e 2026-04-02 09:22:07,909 - lava_callback - INFO - Starting async job submit for node 69ce34f4cb08ea23a1f6885e 2026-04-02 09:22:07,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:60862 - "POST /node/69ce34f4cb08ea23a1f6885e HTTP/1.0" 202 Accepted 2026-04-02 09:22:07,946 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:07,974 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eccb08ea23a1f6884f/lava_callback.json.gz 2026-04-02 09:22:08,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:08,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f4cb08ea23a1f6885e HTTP/1.1" 200 None 2026-04-02 09:22:08,150 - lava_callback - DEBUG - Processing node 69ce34f4cb08ea23a1f6885e: baseline-arm64-broonie 2026-04-02 09:22:08,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34eccb08ea23a1f6884f HTTP/1.1" 200 None 2026-04-02 09:22:08,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:08,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:08,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3505cb08ea23a1f688a3/lava_callback.json.gz 2026-04-02 09:22:08,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34eccb08ea23a1f6884f HTTP/1.1" 200 None 2026-04-02 09:22:08,387 - lava_callback - INFO - Completed processing callback for node 69ce34eccb08ea23a1f6884f 2026-04-02 09:22:08,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:08,501 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3506cb08ea23a1f688a6/log.txt.gz 2026-04-02 09:22:08,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3505cb08ea23a1f688a3 HTTP/1.1" 200 None 2026-04-02 09:22:08,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:08,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:08,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:08,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:08,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3505cb08ea23a1f688a3 HTTP/1.1" 200 None 2026-04-02 09:22:08,954 - lava_callback - INFO - Completed processing callback for node 69ce3505cb08ea23a1f688a3 2026-04-02 09:22:09,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:09,085 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f4cb08ea23a1f6885e/log.txt.gz 2026-04-02 09:22:09,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:09,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3506cb08ea23a1f688a6/lava-logs.yaml 2026-04-02 09:22:09,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:09,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:09,460 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:09,462 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f4cb08ea23a1f6885e/lava-logs.yaml 2026-04-02 09:22:09,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:09,554 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:09,556 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69ce3506cb08ea23a1f688a6/lava_callback.json.gz 2026-04-02 09:22:09,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3506cb08ea23a1f688a6 HTTP/1.1" 200 None 2026-04-02 09:22:09,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,618 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:09,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f4cb08ea23a1f6885e/lava_callback.json.gz 2026-04-02 09:22:09,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:09,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f4cb08ea23a1f6885e HTTP/1.1" 200 None 2026-04-02 09:22:09,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:09,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:09,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3506cb08ea23a1f688a6 HTTP/1.1" 200 None 2026-04-02 09:22:09,698 - lava_callback - INFO - Completed processing callback for node 69ce3506cb08ea23a1f688a6 2026-04-02 09:22:09,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f4cb08ea23a1f6885e HTTP/1.1" 200 None 2026-04-02 09:22:09,775 - lava_callback - INFO - Completed processing callback for node 69ce34f4cb08ea23a1f6885e 2026-04-02 09:22:13,560 - lava_callback - INFO - Received callback for node 69ce34c5cb08ea23a1f687b8 INFO: 172.21.0.1:60396 - "POST /node/69ce34c5cb08ea23a1f687b8 HTTP/1.0" 202 Accepted 2026-04-02 09:22:13,567 - lava_callback - INFO - Starting async job submit for node 69ce34c5cb08ea23a1f687b8 2026-04-02 09:22:13,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:13,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c5cb08ea23a1f687b8 HTTP/1.1" 200 None 2026-04-02 09:22:13,604 - lava_callback - DEBUG - Processing node 69ce34c5cb08ea23a1f687b8: baseline-arm64 2026-04-02 09:22:13,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:14,100 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:14,102 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c5cb08ea23a1f687b8/log.txt.gz 2026-04-02 09:22:14,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:14,517 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:14,519 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c5cb08ea23a1f687b8/lava-logs.yaml 2026-04-02 09:22:14,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:14,668 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:14,669 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c5cb08ea23a1f687b8/lava_callback.json.gz 2026-04-02 09:22:14,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:14,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c5cb08ea23a1f687b8 HTTP/1.1" 200 None 2026-04-02 09:22:14,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:14,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:14,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:14,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c5cb08ea23a1f687b8 HTTP/1.1" 200 None 2026-04-02 09:22:14,754 - lava_callback - INFO - Completed processing callback for node 69ce34c5cb08ea23a1f687b8 INFO: 172.21.0.1:60402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:23,901 - lava_callback - INFO - Received callback for node 69ce3503cb08ea23a1f68887 INFO: 172.21.0.1:40450 - "POST /node/69ce3503cb08ea23a1f68887 HTTP/1.0" 202 Accepted 2026-04-02 09:22:23,907 - lava_callback - INFO - Starting async job submit for node 69ce3503cb08ea23a1f68887 2026-04-02 09:22:23,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:23,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3503cb08ea23a1f68887 HTTP/1.1" 200 None 2026-04-02 09:22:23,949 - lava_callback - DEBUG - Processing node 69ce3503cb08ea23a1f68887: baseline-arm64-pengutronix 2026-04-02 09:22:24,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:24,253 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:24,255 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3503cb08ea23a1f68887/log.txt.gz 2026-04-02 09:22:24,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:24,539 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:24,540 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3503cb08ea23a1f68887/lava-logs.yaml 2026-04-02 09:22:24,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:24,691 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:24,693 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3503cb08ea23a1f68887/lava_callback.json.gz 2026-04-02 09:22:24,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:24,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3503cb08ea23a1f68887 HTTP/1.1" 200 None 2026-04-02 09:22:24,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:24,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:24,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:24,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3503cb08ea23a1f68887 HTTP/1.1" 200 None 2026-04-02 09:22:24,786 - lava_callback - INFO - Completed processing callback for node 69ce3503cb08ea23a1f68887 INFO: 172.21.0.1:40460 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:27,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:27,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:52254 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:31,486 - lava_callback - INFO - Received callback for node 69ce34c1cb08ea23a1f687af INFO: 172.21.0.1:52256 - "POST /node/69ce34c1cb08ea23a1f687af HTTP/1.0" 202 Accepted 2026-04-02 09:22:31,494 - lava_callback - INFO - Starting async job submit for node 69ce34c1cb08ea23a1f687af 2026-04-02 09:22:31,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:31,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c1cb08ea23a1f687af HTTP/1.1" 200 None 2026-04-02 09:22:31,564 - lava_callback - DEBUG - Processing node 69ce34c1cb08ea23a1f687af: baseline-arm64 2026-04-02 09:22:31,838 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:22:31,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:32,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:32,181 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c1cb08ea23a1f687af/lava-logs.yaml 2026-04-02 09:22:32,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:32,313 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:32,315 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c1cb08ea23a1f687af/lava_callback.json.gz 2026-04-02 09:22:32,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:32,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c1cb08ea23a1f687af HTTP/1.1" 200 None 2026-04-02 09:22:32,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:32,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:32,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:32,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c1cb08ea23a1f687af HTTP/1.1" 200 None 2026-04-02 09:22:32,469 - lava_callback - INFO - Completed processing callback for node 69ce34c1cb08ea23a1f687af 2026-04-02 09:22:32,763 - lava_callback - INFO - Received callback for node 69ce34c8cb08ea23a1f687be INFO: 172.21.0.1:52260 - "POST /node/69ce34c8cb08ea23a1f687be HTTP/1.0" 202 Accepted 2026-04-02 09:22:32,770 - lava_callback - INFO - Starting async job submit for node 69ce34c8cb08ea23a1f687be 2026-04-02 09:22:32,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:32,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c8cb08ea23a1f687be HTTP/1.1" 200 None 2026-04-02 09:22:32,808 - lava_callback - DEBUG - Processing node 69ce34c8cb08ea23a1f687be: baseline-arm64 2026-04-02 09:22:33,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:33,222 - lava_callback - INFO - Received callback for node 69ce34d7cb08ea23a1f687f8 INFO: 172.21.0.1:52272 - "POST /node/69ce34d7cb08ea23a1f687f8 HTTP/1.0" 202 Accepted 2026-04-02 09:22:33,229 - lava_callback - INFO - Starting async job submit for node 69ce34d7cb08ea23a1f687f8 2026-04-02 09:22:33,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:33,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d7cb08ea23a1f687f8 HTTP/1.1" 200 None 2026-04-02 09:22:33,284 - lava_callback - DEBUG - Processing node 69ce34d7cb08ea23a1f687f8: baseline-nfs-arm64 2026-04-02 09:22:33,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:33,477 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c8cb08ea23a1f687be/log.txt.gz 2026-04-02 09:22:33,706 - lava_callback - INFO - Received callback for node 69ce3504cb08ea23a1f6888a INFO: 172.21.0.1:52288 - "POST /node/69ce3504cb08ea23a1f6888a HTTP/1.0" 202 Accepted 2026-04-02 09:22:33,747 - lava_callback - INFO - Starting async job submit for node 69ce3504cb08ea23a1f6888a 2026-04-02 09:22:33,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:34,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3504cb08ea23a1f6888a HTTP/1.1" 200 None 2026-04-02 09:22:34,087 - lava_callback - DEBUG - Processing node 69ce3504cb08ea23a1f6888a: baseline-arm64-pengutronix 2026-04-02 09:22:34,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:34,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:34,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:34,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:34,474 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d7cb08ea23a1f687f8/log.txt.gz 2026-04-02 09:22:34,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:34,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:34,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c8cb08ea23a1f687be/lava-logs.yaml 2026-04-02 09:22:34,622 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3504cb08ea23a1f6888a/log.txt.gz 2026-04-02 09:22:34,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:34,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:34,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:35,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:35,077 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c8cb08ea23a1f687be/lava_callback.json.gz 2026-04-02 09:22:35,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,118 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c8cb08ea23a1f687be HTTP/1.1" 200 None 2026-04-02 09:22:35,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:35,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,146 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:35,148 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d7cb08ea23a1f687f8/lava-logs.yaml 2026-04-02 09:22:35,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:35,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c8cb08ea23a1f687be HTTP/1.1" 200 None 2026-04-02 09:22:35,175 - lava_callback - INFO - Completed processing callback for node 69ce34c8cb08ea23a1f687be 2026-04-02 09:22:35,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:35,194 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3504cb08ea23a1f6888a/lava-logs.yaml 2026-04-02 09:22:35,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:35,392 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:35,394 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69ce3504cb08ea23a1f6888a/lava_callback.json.gz 2026-04-02 09:22:35,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:35,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,424 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d7cb08ea23a1f687f8/lava_callback.json.gz 2026-04-02 09:22:35,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3504cb08ea23a1f6888a HTTP/1.1" 200 None 2026-04-02 09:22:35,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d7cb08ea23a1f687f8 HTTP/1.1" 200 None 2026-04-02 09:22:35,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:35,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:35,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:35,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3504cb08ea23a1f6888a HTTP/1.1" 200 None 2026-04-02 09:22:35,518 - lava_callback - INFO - Completed processing callback for node 69ce3504cb08ea23a1f6888a 2026-04-02 09:22:35,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d7cb08ea23a1f687f8 HTTP/1.1" 200 None 2026-04-02 09:22:35,530 - lava_callback - INFO - Completed processing callback for node 69ce34d7cb08ea23a1f687f8 INFO: 172.21.0.1:52298 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:45,597 - lava_callback - INFO - Received callback for node 69ce34cdcb08ea23a1f687df INFO: 172.21.0.1:39398 - "POST /node/69ce34cdcb08ea23a1f687df HTTP/1.0" 202 Accepted 2026-04-02 09:22:45,603 - lava_callback - INFO - Starting async job submit for node 69ce34cdcb08ea23a1f687df 2026-04-02 09:22:45,626 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:45,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cdcb08ea23a1f687df HTTP/1.1" 200 None 2026-04-02 09:22:45,644 - lava_callback - DEBUG - Processing node 69ce34cdcb08ea23a1f687df: baseline-arm64 2026-04-02 09:22:45,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:46,037 - lava_callback - INFO - Received callback for node 69ce34f9cb08ea23a1f6886b INFO: 172.21.0.1:39408 - "POST /node/69ce34f9cb08ea23a1f6886b HTTP/1.0" 202 Accepted 2026-04-02 09:22:46,045 - lava_callback - INFO - Starting async job submit for node 69ce34f9cb08ea23a1f6886b 2026-04-02 09:22:46,055 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:46,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:46,070 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cdcb08ea23a1f687df/log.txt.gz 2026-04-02 09:22:46,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f9cb08ea23a1f6886b HTTP/1.1" 200 None 2026-04-02 09:22:46,149 - lava_callback - DEBUG - Processing node 69ce34f9cb08ea23a1f6886b: baseline-arm64-broonie 2026-04-02 09:22:46,361 - lava_callback - INFO - Received callback for node 69ce34c0cb08ea23a1f687ac INFO: 172.21.0.1:39420 - "POST /node/69ce34c0cb08ea23a1f687ac HTTP/1.0" 202 Accepted 2026-04-02 09:22:46,383 - lava_callback - INFO - Starting async job submit for node 69ce34c0cb08ea23a1f687ac 2026-04-02 09:22:46,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:46,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:46,551 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c0cb08ea23a1f687ac HTTP/1.1" 200 None 2026-04-02 09:22:46,557 - lava_callback - DEBUG - Processing node 69ce34c0cb08ea23a1f687ac: baseline-arm64 2026-04-02 09:22:46,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:46,775 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:22:46,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:46,838 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cdcb08ea23a1f687df/lava-logs.yaml 2026-04-02 09:22:46,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:46,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:46,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:46,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f9cb08ea23a1f6886b/log.txt.gz 2026-04-02 09:22:47,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:47,135 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:47,137 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cdcb08ea23a1f687df/lava_callback.json.gz 2026-04-02 09:22:47,150 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:47,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,165 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c0cb08ea23a1f687ac/lava-logs.yaml 2026-04-02 09:22:47,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:47,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cdcb08ea23a1f687df HTTP/1.1" 200 None 2026-04-02 09:22:47,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:47,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34cdcb08ea23a1f687df HTTP/1.1" 200 None 2026-04-02 09:22:47,267 - lava_callback - INFO - Completed processing callback for node 69ce34cdcb08ea23a1f687df 2026-04-02 09:22:47,348 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:47,350 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f9cb08ea23a1f6886b/lava-logs.yaml 2026-04-02 09:22:47,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:47,370 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:47,372 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c0cb08ea23a1f687ac/lava_callback.json.gz 2026-04-02 09:22:47,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,456 - lava_callback - INFO - Received callback for node 69ce34fecb08ea23a1f6887a INFO: 172.21.0.1:39430 - "POST /node/69ce34fecb08ea23a1f6887a HTTP/1.0" 202 Accepted 2026-04-02 09:22:47,466 - lava_callback - INFO - Starting async job submit for node 69ce34fecb08ea23a1f6887a 2026-04-02 09:22:47,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c0cb08ea23a1f687ac HTTP/1.1" 200 None 2026-04-02 09:22:47,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34fecb08ea23a1f6887a HTTP/1.1" 200 None 2026-04-02 09:22:47,530 - lava_callback - DEBUG - Processing node 69ce34fecb08ea23a1f6887a: baseline-arm64-clabbe 2026-04-02 09:22:47,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:47,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,590 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:47,649 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f9cb08ea23a1f6886b/lava_callback.json.gz 2026-04-02 09:22:47,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c0cb08ea23a1f687ac HTTP/1.1" 200 None 2026-04-02 09:22:47,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,836 - lava_callback - INFO - Completed processing callback for node 69ce34c0cb08ea23a1f687ac 2026-04-02 09:22:47,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f9cb08ea23a1f6886b HTTP/1.1" 200 None 2026-04-02 09:22:47,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:47,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:48,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:48,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:48,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f9cb08ea23a1f6886b HTTP/1.1" 200 None 2026-04-02 09:22:48,078 - lava_callback - INFO - Completed processing callback for node 69ce34f9cb08ea23a1f6886b 2026-04-02 09:22:48,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:48,245 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ce34fecb08ea23a1f6887a/log.txt.gz 2026-04-02 09:22:48,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:48,855 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:48,857 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ce34fecb08ea23a1f6887a/lava-logs.yaml 2026-04-02 09:22:48,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:49,018 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:49,020 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69ce34fecb08ea23a1f6887a/lava_callback.json.gz 2026-04-02 09:22:49,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:49,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34fecb08ea23a1f6887a HTTP/1.1" 200 None 2026-04-02 09:22:49,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:49,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:49,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:49,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34fecb08ea23a1f6887a HTTP/1.1" 200 None 2026-04-02 09:22:49,106 - lava_callback - INFO - Completed processing callback for node 69ce34fecb08ea23a1f6887a 2026-04-02 09:22:49,481 - lava_callback - INFO - Received callback for node 69ce34f0cb08ea23a1f68855 INFO: 172.21.0.1:39444 - "POST /node/69ce34f0cb08ea23a1f68855 HTTP/1.0" 202 Accepted 2026-04-02 09:22:49,487 - lava_callback - INFO - Starting async job submit for node 69ce34f0cb08ea23a1f68855 2026-04-02 09:22:49,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:49,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f0cb08ea23a1f68855 HTTP/1.1" 200 None 2026-04-02 09:22:49,528 - lava_callback - DEBUG - Processing node 69ce34f0cb08ea23a1f68855: baseline-arm64-broonie 2026-04-02 09:22:49,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:49,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:49,913 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f0cb08ea23a1f68855/log.txt.gz 2026-04-02 09:22:50,061 - lava_callback - INFO - Received callback for node 69ce34becb08ea23a1f687a9 INFO: 172.21.0.1:57038 - "POST /node/69ce34becb08ea23a1f687a9 HTTP/1.0" 202 Accepted 2026-04-02 09:22:50,085 - lava_callback - INFO - Starting async job submit for node 69ce34becb08ea23a1f687a9 2026-04-02 09:22:50,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:50,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:50,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34becb08ea23a1f687a9 HTTP/1.1" 200 None 2026-04-02 09:22:50,194 - lava_callback - DEBUG - Processing node 69ce34becb08ea23a1f687a9: baseline-arm64 2026-04-02 09:22:50,524 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:50,562 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f0cb08ea23a1f68855/lava-logs.yaml 2026-04-02 09:22:50,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:50,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:50,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:50,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34becb08ea23a1f687a9/log.txt.gz 2026-04-02 09:22:50,772 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:50,804 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f0cb08ea23a1f68855/lava_callback.json.gz 2026-04-02 09:22:50,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:50,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:50,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f0cb08ea23a1f68855 HTTP/1.1" 200 None 2026-04-02 09:22:50,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:50,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:50,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:50,984 - lava_callback - INFO - Received callback for node 69ce34f1cb08ea23a1f68858 2026-04-02 09:22:50,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f0cb08ea23a1f68855 HTTP/1.1" 200 None INFO: 172.21.0.1:57052 - "POST /node/69ce34f1cb08ea23a1f68858 HTTP/1.0" 202 Accepted 2026-04-02 09:22:51,010 - lava_callback - INFO - Starting async job submit for node 69ce34f1cb08ea23a1f68858 2026-04-02 09:22:51,017 - lava_callback - INFO - Completed processing callback for node 69ce34f0cb08ea23a1f68855 2026-04-02 09:22:51,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:51,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f1cb08ea23a1f68858 HTTP/1.1" 200 None 2026-04-02 09:22:51,112 - lava_callback - DEBUG - Processing node 69ce34f1cb08ea23a1f68858: baseline-arm64-broonie 2026-04-02 09:22:51,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:51,283 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34becb08ea23a1f687a9/lava-logs.yaml 2026-04-02 09:22:51,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:51,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:51,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:51,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34becb08ea23a1f687a9/lava_callback.json.gz 2026-04-02 09:22:51,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:51,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:51,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f1cb08ea23a1f68858/log.txt.gz 2026-04-02 09:22:51,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34becb08ea23a1f687a9 HTTP/1.1" 200 None 2026-04-02 09:22:51,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:51,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:51,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:51,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:51,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34becb08ea23a1f687a9 HTTP/1.1" 200 None 2026-04-02 09:22:51,871 - lava_callback - INFO - Completed processing callback for node 69ce34becb08ea23a1f687a9 2026-04-02 09:22:52,074 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:52,076 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f1cb08ea23a1f68858/lava-logs.yaml 2026-04-02 09:22:52,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:52,220 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:52,222 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f1cb08ea23a1f68858/lava_callback.json.gz 2026-04-02 09:22:52,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:52,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f1cb08ea23a1f68858 HTTP/1.1" 200 None 2026-04-02 09:22:52,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:52,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:52,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:52,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f1cb08ea23a1f68858 HTTP/1.1" 200 None 2026-04-02 09:22:52,314 - lava_callback - INFO - Completed processing callback for node 69ce34f1cb08ea23a1f68858 2026-04-02 09:22:52,393 - lava_callback - INFO - Received callback for node 69ce34f5cb08ea23a1f68861 INFO: 172.21.0.1:57068 - "POST /node/69ce34f5cb08ea23a1f68861 HTTP/1.0" 202 Accepted 2026-04-02 09:22:52,399 - lava_callback - INFO - Starting async job submit for node 69ce34f5cb08ea23a1f68861 2026-04-02 09:22:52,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:52,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f5cb08ea23a1f68861 HTTP/1.1" 200 None 2026-04-02 09:22:52,440 - lava_callback - DEBUG - Processing node 69ce34f5cb08ea23a1f68861: baseline-arm64-broonie 2026-04-02 09:22:52,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:52,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:52,837 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f5cb08ea23a1f68861/log.txt.gz 2026-04-02 09:22:53,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:53,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:53,198 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f5cb08ea23a1f68861/lava-logs.yaml 2026-04-02 09:22:53,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:53,352 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:53,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f5cb08ea23a1f68861/lava_callback.json.gz 2026-04-02 09:22:53,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:53,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f5cb08ea23a1f68861 HTTP/1.1" 200 None 2026-04-02 09:22:53,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:53,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:53,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:53,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f5cb08ea23a1f68861 HTTP/1.1" 200 None 2026-04-02 09:22:53,451 - lava_callback - INFO - Completed processing callback for node 69ce34f5cb08ea23a1f68861 2026-04-02 09:22:53,833 - lava_callback - INFO - Received callback for node 69ce34f7cb08ea23a1f68864 INFO: 172.21.0.1:57076 - "POST /node/69ce34f7cb08ea23a1f68864 HTTP/1.0" 202 Accepted 2026-04-02 09:22:53,839 - lava_callback - INFO - Starting async job submit for node 69ce34f7cb08ea23a1f68864 2026-04-02 09:22:53,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:53,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f7cb08ea23a1f68864 HTTP/1.1" 200 None 2026-04-02 09:22:53,894 - lava_callback - DEBUG - Processing node 69ce34f7cb08ea23a1f68864: baseline-arm64-broonie 2026-04-02 09:22:54,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:54,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:54,318 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f7cb08ea23a1f68864/log.txt.gz 2026-04-02 09:22:54,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:54,673 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:54,675 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f7cb08ea23a1f68864/lava-logs.yaml 2026-04-02 09:22:54,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:54,807 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:54,809 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f7cb08ea23a1f68864/lava_callback.json.gz 2026-04-02 09:22:54,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:54,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f7cb08ea23a1f68864 HTTP/1.1" 200 None 2026-04-02 09:22:54,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:54,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:22:54,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:54,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f7cb08ea23a1f68864 HTTP/1.1" 200 None 2026-04-02 09:22:54,901 - lava_callback - INFO - Completed processing callback for node 69ce34f7cb08ea23a1f68864 2026-04-02 09:22:55,851 - lava_callback - INFO - Received callback for node 69ce3198cb08ea23a1f686ff INFO: 172.21.0.1:57090 - "POST /node/69ce3198cb08ea23a1f686ff HTTP/1.0" 202 Accepted 2026-04-02 09:22:55,858 - lava_callback - INFO - Starting async job submit for node 69ce3198cb08ea23a1f686ff 2026-04-02 09:22:55,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:55,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3198cb08ea23a1f686ff HTTP/1.1" 200 None 2026-04-02 09:22:55,951 - lava_callback - DEBUG - Processing node 69ce3198cb08ea23a1f686ff: baseline-arm INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:22:56,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:56,781 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:56,784 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3198cb08ea23a1f686ff/log.txt.gz 2026-04-02 09:22:57,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:57,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:57,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-02 09:22:57,426 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:57,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3198cb08ea23a1f686ff/lava-logs.yaml 2026-04-02 09:22:57,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:22:57,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:22:57,619 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3198cb08ea23a1f686ff/lava_callback.json.gz DEBUG: Setup failed for 69ce3198cb08ea23a1f686ff. Transitting job node result: incomplete -> fail 2026-04-02 09:22:57,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:57,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3198cb08ea23a1f686ff HTTP/1.1" 200 None 2026-04-02 09:22:57,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:57,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:22:57,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:22:57,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3198cb08ea23a1f686ff HTTP/1.1" 200 None 2026-04-02 09:22:57,897 - lava_callback - INFO - Completed processing callback for node 69ce3198cb08ea23a1f686ff 2026-04-02 09:23:03,878 - lava_callback - INFO - Received callback for node 69ce34e0cb08ea23a1f68815 INFO: 172.21.0.1:32768 - "POST /node/69ce34e0cb08ea23a1f68815 HTTP/1.0" 202 Accepted 2026-04-02 09:23:03,885 - lava_callback - INFO - Starting async job submit for node 69ce34e0cb08ea23a1f68815 2026-04-02 09:23:03,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:03,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e0cb08ea23a1f68815 HTTP/1.1" 200 None 2026-04-02 09:23:03,928 - lava_callback - DEBUG - Processing node 69ce34e0cb08ea23a1f68815: baseline-nfs-arm64 2026-04-02 09:23:04,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:04,561 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:04,563 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34e0cb08ea23a1f68815/log.txt.gz 2026-04-02 09:23:04,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:05,115 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:05,118 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34e0cb08ea23a1f68815/lava-logs.yaml 2026-04-02 09:23:05,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:05,314 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:05,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34e0cb08ea23a1f68815/lava_callback.json.gz 2026-04-02 09:23:05,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:05,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34e0cb08ea23a1f68815 HTTP/1.1" 200 None 2026-04-02 09:23:05,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:05,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:05,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:05,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34e0cb08ea23a1f68815 HTTP/1.1" 200 None 2026-04-02 09:23:05,411 - lava_callback - INFO - Completed processing callback for node 69ce34e0cb08ea23a1f68815 2026-04-02 09:23:06,245 - lava_callback - INFO - Received callback for node 69ce3153cb08ea23a1f686df INFO: 172.21.0.1:32778 - "POST /node/69ce3153cb08ea23a1f686df HTTP/1.0" 202 Accepted 2026-04-02 09:23:06,251 - lava_callback - INFO - Starting async job submit for node 69ce3153cb08ea23a1f686df 2026-04-02 09:23:06,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:06,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3153cb08ea23a1f686df HTTP/1.1" 200 None 2026-04-02 09:23:06,329 - lava_callback - DEBUG - Processing node 69ce3153cb08ea23a1f686df: ltp-smoke INFO: 172.21.0.1:32784 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:23:06,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:06,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:06,925 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3153cb08ea23a1f686df/log.txt.gz 2026-04-02 09:23:07,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:07,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:07,525 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3153cb08ea23a1f686df/lava-logs.yaml 2026-04-02 09:23:07,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:07,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:07,713 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3153cb08ea23a1f686df/lava_callback.json.gz 2026-04-02 09:23:07,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:07,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3153cb08ea23a1f686df HTTP/1.1" 200 None 2026-04-02 09:23:07,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:07,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce266ecb08ea23a1f68074 HTTP/1.1" 200 None 2026-04-02 09:23:07,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:07,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3153cb08ea23a1f686df HTTP/1.1" 200 None 2026-04-02 09:23:08,012 - lava_callback - INFO - Received callback for node 69ce34d5cb08ea23a1f687f2 INFO: 172.21.0.1:32786 - "POST /node/69ce34d5cb08ea23a1f687f2 HTTP/1.0" 202 Accepted 2026-04-02 09:23:08,031 - lava_callback - INFO - Starting async job submit for node 69ce34d5cb08ea23a1f687f2 2026-04-02 09:23:08,063 - lava_callback - INFO - Completed processing callback for node 69ce3153cb08ea23a1f686df 2026-04-02 09:23:08,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:08,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d5cb08ea23a1f687f2 HTTP/1.1" 200 None 2026-04-02 09:23:08,111 - lava_callback - DEBUG - Processing node 69ce34d5cb08ea23a1f687f2: baseline-nfs-arm64 2026-04-02 09:23:08,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:08,659 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:08,660 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d5cb08ea23a1f687f2/log.txt.gz 2026-04-02 09:23:08,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:09,080 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:09,082 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d5cb08ea23a1f687f2/lava-logs.yaml 2026-04-02 09:23:09,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:09,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:09,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d5cb08ea23a1f687f2/lava_callback.json.gz 2026-04-02 09:23:09,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:09,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d5cb08ea23a1f687f2 HTTP/1.1" 200 None 2026-04-02 09:23:09,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:09,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:09,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:09,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d5cb08ea23a1f687f2 HTTP/1.1" 200 None 2026-04-02 09:23:09,312 - lava_callback - INFO - Completed processing callback for node 69ce34d5cb08ea23a1f687f2 INFO: 172.21.0.1:49392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:23:22,356 - lava_callback - INFO - Received callback for node 69ce34cbcb08ea23a1f687d8 INFO: 172.21.0.1:53498 - "POST /node/69ce34cbcb08ea23a1f687d8 HTTP/1.0" 202 Accepted 2026-04-02 09:23:22,365 - lava_callback - INFO - Starting async job submit for node 69ce34cbcb08ea23a1f687d8 2026-04-02 09:23:22,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:22,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cbcb08ea23a1f687d8 HTTP/1.1" 200 None 2026-04-02 09:23:22,402 - lava_callback - DEBUG - Processing node 69ce34cbcb08ea23a1f687d8: baseline-arm64 2026-04-02 09:23:22,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:22,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:22,756 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cbcb08ea23a1f687d8/log.txt.gz 2026-04-02 09:23:22,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:23,048 - lava_callback - INFO - Received callback for node 69ce34c4cb08ea23a1f687b5 INFO: 172.21.0.1:53506 - "POST /node/69ce34c4cb08ea23a1f687b5 HTTP/1.0" 202 Accepted 2026-04-02 09:23:23,056 - lava_callback - INFO - Starting async job submit for node 69ce34c4cb08ea23a1f687b5 2026-04-02 09:23:23,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:23,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c4cb08ea23a1f687b5 HTTP/1.1" 200 None 2026-04-02 09:23:23,105 - lava_callback - DEBUG - Processing node 69ce34c4cb08ea23a1f687b5: baseline-arm64 2026-04-02 09:23:23,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:23,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cbcb08ea23a1f687d8/lava-logs.yaml 2026-04-02 09:23:23,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:23,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:23,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:23,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cbcb08ea23a1f687d8/lava_callback.json.gz 2026-04-02 09:23:23,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:23,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cbcb08ea23a1f687d8 HTTP/1.1" 200 None 2026-04-02 09:23:23,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:23,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:23,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:23,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34cbcb08ea23a1f687d8 HTTP/1.1" 200 None 2026-04-02 09:23:23,715 - lava_callback - INFO - Completed processing callback for node 69ce34cbcb08ea23a1f687d8 2026-04-02 09:23:23,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:23,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c4cb08ea23a1f687b5/log.txt.gz 2026-04-02 09:23:23,989 - lava_callback - INFO - Received callback for node 69ce34c7cb08ea23a1f687bb INFO: 172.21.0.1:53510 - "POST /node/69ce34c7cb08ea23a1f687bb HTTP/1.0" 202 Accepted 2026-04-02 09:23:24,001 - lava_callback - INFO - Starting async job submit for node 69ce34c7cb08ea23a1f687bb 2026-04-02 09:23:24,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:24,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:24,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c7cb08ea23a1f687bb HTTP/1.1" 200 None 2026-04-02 09:23:24,064 - lava_callback - DEBUG - Processing node 69ce34c7cb08ea23a1f687bb: baseline-arm64 2026-04-02 09:23:24,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:24,295 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c4cb08ea23a1f687b5/lava-logs.yaml 2026-04-02 09:23:24,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:24,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:24,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:24,612 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c4cb08ea23a1f687b5/lava_callback.json.gz 2026-04-02 09:23:24,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:24,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:24,639 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c7cb08ea23a1f687bb/log.txt.gz 2026-04-02 09:23:24,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c4cb08ea23a1f687b5 HTTP/1.1" 200 None 2026-04-02 09:23:24,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:24,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:24,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:24,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:24,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c4cb08ea23a1f687b5 HTTP/1.1" 200 None 2026-04-02 09:23:24,891 - lava_callback - INFO - Completed processing callback for node 69ce34c4cb08ea23a1f687b5 2026-04-02 09:23:25,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:25,118 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c7cb08ea23a1f687bb/lava-logs.yaml 2026-04-02 09:23:25,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:25,266 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:25,268 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c7cb08ea23a1f687bb/lava_callback.json.gz 2026-04-02 09:23:25,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:25,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c7cb08ea23a1f687bb HTTP/1.1" 200 None 2026-04-02 09:23:25,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:25,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:25,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:25,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c7cb08ea23a1f687bb HTTP/1.1" 200 None 2026-04-02 09:23:25,428 - lava_callback - INFO - Completed processing callback for node 69ce34c7cb08ea23a1f687bb 2026-04-02 09:23:26,042 - lava_callback - INFO - Received callback for node 69ce34eecb08ea23a1f68852 INFO: 172.21.0.1:53516 - "POST /node/69ce34eecb08ea23a1f68852 HTTP/1.0" 202 Accepted 2026-04-02 09:23:26,048 - lava_callback - INFO - Starting async job submit for node 69ce34eecb08ea23a1f68852 2026-04-02 09:23:26,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:26,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34eecb08ea23a1f68852 HTTP/1.1" 200 None 2026-04-02 09:23:26,108 - lava_callback - DEBUG - Processing node 69ce34eecb08ea23a1f68852: baseline-arm64-broonie 2026-04-02 09:23:26,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:53526 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:23:26,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:26,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eecb08ea23a1f68852/log.txt.gz 2026-04-02 09:23:26,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:27,151 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:27,153 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eecb08ea23a1f68852/lava-logs.yaml 2026-04-02 09:23:27,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:27,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:27,333 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34eecb08ea23a1f68852/lava_callback.json.gz 2026-04-02 09:23:27,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:27,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:27,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34eecb08ea23a1f68852 HTTP/1.1" 200 None 2026-04-02 09:23:27,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:27,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-04-02 09:23:27,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:27,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:27,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34eecb08ea23a1f68852 HTTP/1.1" 200 None 2026-04-02 09:23:27,423 - lava_callback - INFO - Completed processing callback for node 69ce34eecb08ea23a1f68852 INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54646 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:23:39,301 - lava_callback - INFO - Received callback for node 69ce34cfcb08ea23a1f687e6 INFO: 172.21.0.1:54648 - "POST /node/69ce34cfcb08ea23a1f687e6 HTTP/1.0" 202 Accepted 2026-04-02 09:23:39,308 - lava_callback - INFO - Starting async job submit for node 69ce34cfcb08ea23a1f687e6 2026-04-02 09:23:39,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:39,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cfcb08ea23a1f687e6 HTTP/1.1" 200 None 2026-04-02 09:23:39,347 - lava_callback - DEBUG - Processing node 69ce34cfcb08ea23a1f687e6: baseline-arm64 2026-04-02 09:23:39,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:39,890 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:39,892 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cfcb08ea23a1f687e6/log.txt.gz 2026-04-02 09:23:40,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:40,359 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:40,361 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cfcb08ea23a1f687e6/lava-logs.yaml 2026-04-02 09:23:40,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:23:40,512 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:23:40,513 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cfcb08ea23a1f687e6/lava_callback.json.gz 2026-04-02 09:23:40,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:40,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cfcb08ea23a1f687e6 HTTP/1.1" 200 None 2026-04-02 09:23:40,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:40,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:23:40,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:40,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34cfcb08ea23a1f687e6 HTTP/1.1" 200 None 2026-04-02 09:23:40,608 - lava_callback - INFO - Completed processing callback for node 69ce34cfcb08ea23a1f687e6 INFO: 172.21.0.1:45090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46058 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:23:57,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:23:57,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58368 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:24:08,369 - lava_callback - INFO - Received callback for node 69ce34decb08ea23a1f6880e INFO: 172.21.0.1:58382 - "POST /node/69ce34decb08ea23a1f6880e HTTP/1.0" 202 Accepted 2026-04-02 09:24:08,376 - lava_callback - INFO - Starting async job submit for node 69ce34decb08ea23a1f6880e 2026-04-02 09:24:08,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:08,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34decb08ea23a1f6880e HTTP/1.1" 200 None 2026-04-02 09:24:08,413 - lava_callback - DEBUG - Processing node 69ce34decb08ea23a1f6880e: baseline-nfs-arm64 2026-04-02 09:24:08,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:08,908 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:08,910 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34decb08ea23a1f6880e/log.txt.gz 2026-04-02 09:24:09,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:09,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:09,358 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34decb08ea23a1f6880e/lava-logs.yaml 2026-04-02 09:24:09,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:09,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:09,563 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34decb08ea23a1f6880e/lava_callback.json.gz 2026-04-02 09:24:09,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:09,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34decb08ea23a1f6880e HTTP/1.1" 200 None 2026-04-02 09:24:09,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:09,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:24:09,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:09,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34decb08ea23a1f6880e HTTP/1.1" 200 None 2026-04-02 09:24:09,678 - lava_callback - INFO - Completed processing callback for node 69ce34decb08ea23a1f6880e INFO: 172.21.0.1:44660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44670 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:24:17,359 - lava_callback - INFO - Received callback for node 69ce34dbcb08ea23a1f68808 INFO: 172.21.0.1:44674 - "POST /node/69ce34dbcb08ea23a1f68808 HTTP/1.0" 202 Accepted 2026-04-02 09:24:17,366 - lava_callback - INFO - Starting async job submit for node 69ce34dbcb08ea23a1f68808 2026-04-02 09:24:17,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:17,422 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dbcb08ea23a1f68808 HTTP/1.1" 200 None 2026-04-02 09:24:17,423 - lava_callback - DEBUG - Processing node 69ce34dbcb08ea23a1f68808: baseline-nfs-arm64 2026-04-02 09:24:17,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:17,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:17,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dbcb08ea23a1f68808/log.txt.gz 2026-04-02 09:24:18,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:18,417 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:18,420 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dbcb08ea23a1f68808/lava-logs.yaml 2026-04-02 09:24:18,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:18,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:18,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dbcb08ea23a1f68808/lava_callback.json.gz 2026-04-02 09:24:18,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:18,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dbcb08ea23a1f68808 HTTP/1.1" 200 None 2026-04-02 09:24:18,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:18,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:24:18,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:18,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34dbcb08ea23a1f68808 HTTP/1.1" 200 None 2026-04-02 09:24:18,664 - lava_callback - INFO - Completed processing callback for node 69ce34dbcb08ea23a1f68808 2026-04-02 09:24:23,376 - lava_callback - INFO - Received callback for node 69ce34d2cb08ea23a1f687ec INFO: 172.21.0.1:42582 - "POST /node/69ce34d2cb08ea23a1f687ec HTTP/1.0" 202 Accepted 2026-04-02 09:24:23,383 - lava_callback - INFO - Starting async job submit for node 69ce34d2cb08ea23a1f687ec 2026-04-02 09:24:23,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:23,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d2cb08ea23a1f687ec HTTP/1.1" 200 None 2026-04-02 09:24:23,426 - lava_callback - DEBUG - Processing node 69ce34d2cb08ea23a1f687ec: baseline-nfs-arm64 2026-04-02 09:24:23,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:24,270 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:24,272 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d2cb08ea23a1f687ec/log.txt.gz 2026-04-02 09:24:24,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:24,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:24,674 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d2cb08ea23a1f687ec/lava-logs.yaml 2026-04-02 09:24:24,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:24,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:24,822 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d2cb08ea23a1f687ec/lava_callback.json.gz 2026-04-02 09:24:24,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:24,866 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d2cb08ea23a1f687ec HTTP/1.1" 200 None 2026-04-02 09:24:24,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:24,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:24:24,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:24,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d2cb08ea23a1f687ec HTTP/1.1" 200 None 2026-04-02 09:24:24,917 - lava_callback - INFO - Completed processing callback for node 69ce34d2cb08ea23a1f687ec 2026-04-02 09:24:26,225 - lava_callback - INFO - Received callback for node 69ce34f2cb08ea23a1f6885b INFO: 172.21.0.1:42588 - "POST /node/69ce34f2cb08ea23a1f6885b HTTP/1.0" 202 Accepted 2026-04-02 09:24:26,231 - lava_callback - INFO - Starting async job submit for node 69ce34f2cb08ea23a1f6885b 2026-04-02 09:24:26,256 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:26,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f2cb08ea23a1f6885b HTTP/1.1" 200 None 2026-04-02 09:24:26,272 - lava_callback - DEBUG - Processing node 69ce34f2cb08ea23a1f6885b: baseline-arm64-broonie 2026-04-02 09:24:26,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42592 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:24:26,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:26,738 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f2cb08ea23a1f6885b/log.txt.gz 2026-04-02 09:24:26,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:27,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:27,100 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f2cb08ea23a1f6885b/lava-logs.yaml 2026-04-02 09:24:27,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:27,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:27,317 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69ce34f2cb08ea23a1f6885b/lava_callback.json.gz 2026-04-02 09:24:27,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:27,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34f2cb08ea23a1f6885b HTTP/1.1" 200 None 2026-04-02 09:24:27,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:27,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:27,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:24:27,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:24:27,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:27,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34f2cb08ea23a1f6885b HTTP/1.1" 200 None 2026-04-02 09:24:27,485 - lava_callback - INFO - Completed processing callback for node 69ce34f2cb08ea23a1f6885b INFO: 172.21.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49638 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:24:46,643 - lava_callback - INFO - Received callback for node 69ce34c3cb08ea23a1f687b2 INFO: 172.21.0.1:49642 - "POST /node/69ce34c3cb08ea23a1f687b2 HTTP/1.0" 202 Accepted 2026-04-02 09:24:46,652 - lava_callback - INFO - Starting async job submit for node 69ce34c3cb08ea23a1f687b2 2026-04-02 09:24:46,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:46,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c3cb08ea23a1f687b2 HTTP/1.1" 200 None 2026-04-02 09:24:46,716 - lava_callback - DEBUG - Processing node 69ce34c3cb08ea23a1f687b2: baseline-arm64 2026-04-02 09:24:47,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:47,404 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:47,406 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c3cb08ea23a1f687b2/log.txt.gz 2026-04-02 09:24:47,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:47,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:47,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c3cb08ea23a1f687b2/lava-logs.yaml 2026-04-02 09:24:47,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:24:47,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:24:47,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34c3cb08ea23a1f687b2/lava_callback.json.gz 2026-04-02 09:24:47,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:47,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34c3cb08ea23a1f687b2 HTTP/1.1" 200 None 2026-04-02 09:24:47,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:48,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:24:48,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:48,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34c3cb08ea23a1f687b2 HTTP/1.1" 200 None 2026-04-02 09:24:48,039 - lava_callback - INFO - Completed processing callback for node 69ce34c3cb08ea23a1f687b2 INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:24:57,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:24:57,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 09:25:02,046 - lava_callback - INFO - Received callback for node 69ce34d3cb08ea23a1f687ef INFO: 172.21.0.1:59614 - "POST /node/69ce34d3cb08ea23a1f687ef HTTP/1.0" 202 Accepted 2026-04-02 09:25:02,052 - lava_callback - INFO - Starting async job submit for node 69ce34d3cb08ea23a1f687ef 2026-04-02 09:25:02,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:02,097 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d3cb08ea23a1f687ef HTTP/1.1" 200 None 2026-04-02 09:25:02,098 - lava_callback - DEBUG - Processing node 69ce34d3cb08ea23a1f687ef: baseline-nfs-arm64 2026-04-02 09:25:02,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:25:02,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:25:02,737 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d3cb08ea23a1f687ef/log.txt.gz 2026-04-02 09:25:03,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:25:03,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:25:03,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d3cb08ea23a1f687ef/lava-logs.yaml 2026-04-02 09:25:03,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:25:03,564 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:25:03,566 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d3cb08ea23a1f687ef/lava_callback.json.gz 2026-04-02 09:25:03,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:03,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d3cb08ea23a1f687ef HTTP/1.1" 200 None 2026-04-02 09:25:03,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:03,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:25:03,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:03,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d3cb08ea23a1f687ef HTTP/1.1" 200 None 2026-04-02 09:25:03,642 - lava_callback - INFO - Completed processing callback for node 69ce34d3cb08ea23a1f687ef INFO: 172.21.0.1:59620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40420 - "GET /%26 HTTP/1.0" 404 Not Found INFO: 172.21.0.1:40436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40452 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:25:24,448 - lava_callback - INFO - Received callback for node 69cb92f12a64fa9aff937639 INFO: 172.21.0.1:54046 - "POST /node/69cb92f12a64fa9aff937639 HTTP/1.0" 202 Accepted 2026-04-02 09:25:24,453 - lava_callback - INFO - Starting async job submit for node 69cb92f12a64fa9aff937639 2026-04-02 09:25:24,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:24,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb92f12a64fa9aff937639 HTTP/1.1" 200 None 2026-04-02 09:25:24,470 - lava_callback - DEBUG - Processing node 69cb92f12a64fa9aff937639: baseline-arm-baylibre 2026-04-02 09:25:24,470 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb92f12a64fa9aff937639 2026-04-02 09:25:24,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:24,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb92f12a64fa9aff937639 HTTP/1.1" 200 None 2026-04-02 09:25:24,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:24,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:25:24,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:24,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb92f12a64fa9aff937639 HTTP/1.1" 200 None 2026-04-02 09:25:24,531 - lava_callback - ERROR - Error processing callback for node 69cb92f12a64fa9aff937639: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54056 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:25:27,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:25:27,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50986 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:26:30,083 - lava_callback - INFO - Received callback for node 69ce3633cb08ea23a1f689ef INFO: 172.21.0.1:55914 - "POST /node/69ce3633cb08ea23a1f689ef HTTP/1.0" 202 Accepted 2026-04-02 09:26:30,088 - lava_callback - INFO - Starting async job submit for node 69ce3633cb08ea23a1f689ef 2026-04-02 09:26:30,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:26:30,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3633cb08ea23a1f689ef HTTP/1.1" 200 None 2026-04-02 09:26:30,107 - lava_callback - DEBUG - Processing node 69ce3633cb08ea23a1f689ef: baseline-arm 2026-04-02 09:26:30,112 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:26:30,115 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:26:30,251 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:26:30,252 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3633cb08ea23a1f689ef/lava-logs.yaml 2026-04-02 09:26:30,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:26:30,365 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:26:30,367 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3633cb08ea23a1f689ef/lava_callback.json.gz 2026-04-02 09:26:30,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:26:30,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3633cb08ea23a1f689ef HTTP/1.1" 200 None 2026-04-02 09:26:30,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:26:30,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 09:26:30,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:26:30,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3633cb08ea23a1f689ef HTTP/1.1" 200 None 2026-04-02 09:26:30,463 - lava_callback - INFO - Completed processing callback for node 69ce3633cb08ea23a1f689ef INFO: 172.21.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:26:57,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:26:57,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33660 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:29:28,516 - lava_callback - INFO - Received callback for node 69ce34d9cb08ea23a1f687fb INFO: 172.21.0.1:58718 - "POST /node/69ce34d9cb08ea23a1f687fb HTTP/1.0" 202 Accepted 2026-04-02 09:29:28,524 - lava_callback - INFO - Starting async job submit for node 69ce34d9cb08ea23a1f687fb 2026-04-02 09:29:28,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:29:28,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d9cb08ea23a1f687fb HTTP/1.1" 200 None 2026-04-02 09:29:28,595 - lava_callback - DEBUG - Processing node 69ce34d9cb08ea23a1f687fb: baseline-nfs-arm64 2026-04-02 09:29:29,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:29:29,635 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:29:29,637 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d9cb08ea23a1f687fb/log.txt.gz 2026-04-02 09:29:30,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:29:30,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:29:30,442 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d9cb08ea23a1f687fb/lava-logs.yaml 2026-04-02 09:29:30,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:29:30,648 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:29:30,650 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d9cb08ea23a1f687fb/lava_callback.json.gz 2026-04-02 09:29:30,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:29:30,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d9cb08ea23a1f687fb HTTP/1.1" 200 None 2026-04-02 09:29:30,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:29:30,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:29:30,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:29:30,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d9cb08ea23a1f687fb HTTP/1.1" 200 None 2026-04-02 09:29:30,747 - lava_callback - INFO - Completed processing callback for node 69ce34d9cb08ea23a1f687fb INFO: 172.21.0.1:36172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:29:57,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:29:57,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41160 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:30:24,461 - lava_callback - INFO - Received callback for node 69cb94232a64fa9aff93767a INFO: 172.21.0.1:60118 - "POST /node/69cb94232a64fa9aff93767a HTTP/1.0" 202 Accepted 2026-04-02 09:30:24,466 - lava_callback - INFO - Starting async job submit for node 69cb94232a64fa9aff93767a 2026-04-02 09:30:24,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:30:24,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94232a64fa9aff93767a HTTP/1.1" 200 None 2026-04-02 09:30:24,482 - lava_callback - DEBUG - Processing node 69cb94232a64fa9aff93767a: baseline-arm-baylibre 2026-04-02 09:30:24,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb94232a64fa9aff93767a 2026-04-02 09:30:24,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:30:24,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94232a64fa9aff93767a HTTP/1.1" 200 None 2026-04-02 09:30:24,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:30:24,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:30:24,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:30:24,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb94232a64fa9aff93767a HTTP/1.1" 200 None 2026-04-02 09:30:24,537 - lava_callback - ERROR - Error processing callback for node 69cb94232a64fa9aff93767a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51548 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51562 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:32:24,683 - lava_callback - INFO - Received callback for node 69cb94932a64fa9aff937694 INFO: 172.21.0.1:50286 - "POST /node/69cb94932a64fa9aff937694 HTTP/1.0" 202 Accepted 2026-04-02 09:32:24,690 - lava_callback - INFO - Starting async job submit for node 69cb94932a64fa9aff937694 2026-04-02 09:32:24,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:24,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94932a64fa9aff937694 HTTP/1.1" 200 None 2026-04-02 09:32:24,717 - lava_callback - DEBUG - Processing node 69cb94932a64fa9aff937694: baseline-arm-baylibre 2026-04-02 09:32:24,718 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb94932a64fa9aff937694 2026-04-02 09:32:24,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:24,732 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94932a64fa9aff937694 HTTP/1.1" 200 None 2026-04-02 09:32:24,734 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:24,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:32:24,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:24,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb94932a64fa9aff937694 HTTP/1.1" 200 None 2026-04-02 09:32:24,770 - lava_callback - ERROR - Error processing callback for node 69cb94932a64fa9aff937694: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:32:52,788 - lava_callback - INFO - Received callback for node 69cb94bc2a64fa9aff9376a6 INFO: 172.21.0.1:34620 - "POST /node/69cb94bc2a64fa9aff9376a6 HTTP/1.0" 202 Accepted 2026-04-02 09:32:52,793 - lava_callback - INFO - Starting async job submit for node 69cb94bc2a64fa9aff9376a6 2026-04-02 09:32:52,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:52,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94bc2a64fa9aff9376a6 HTTP/1.1" 200 None 2026-04-02 09:32:52,810 - lava_callback - DEBUG - Processing node 69cb94bc2a64fa9aff9376a6: baseline-arm-clabbe 2026-04-02 09:32:52,810 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb94bc2a64fa9aff9376a6 2026-04-02 09:32:52,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:52,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94bc2a64fa9aff9376a6 HTTP/1.1" 200 None 2026-04-02 09:32:52,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:52,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:32:52,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:32:52,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb94bc2a64fa9aff9376a6 HTTP/1.1" 200 None 2026-04-02 09:32:52,878 - lava_callback - ERROR - Error processing callback for node 69cb94bc2a64fa9aff9376a6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:33:32,774 - lava_callback - INFO - Received callback for node 69cb94e12a64fa9aff9376b4 INFO: 172.21.0.1:40860 - "POST /node/69cb94e12a64fa9aff9376b4 HTTP/1.0" 202 Accepted 2026-04-02 09:33:32,781 - lava_callback - INFO - Starting async job submit for node 69cb94e12a64fa9aff9376b4 2026-04-02 09:33:32,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:33:32,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94e12a64fa9aff9376b4 HTTP/1.1" 200 None 2026-04-02 09:33:32,802 - lava_callback - DEBUG - Processing node 69cb94e12a64fa9aff9376b4: baseline-arm-clabbe 2026-04-02 09:33:32,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb94e12a64fa9aff9376b4 2026-04-02 09:33:32,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:33:32,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb94e12a64fa9aff9376b4 HTTP/1.1" 200 None 2026-04-02 09:33:32,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:33:32,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:33:32,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:33:32,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb94e12a64fa9aff9376b4 HTTP/1.1" 200 None 2026-04-02 09:33:32,877 - lava_callback - ERROR - Error processing callback for node 69cb94e12a64fa9aff9376b4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37434 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:34:12,856 - lava_callback - INFO - Received callback for node 69cb95062a64fa9aff9376bb INFO: 172.21.0.1:55546 - "POST /node/69cb95062a64fa9aff9376bb HTTP/1.0" 202 Accepted 2026-04-02 09:34:12,862 - lava_callback - INFO - Starting async job submit for node 69cb95062a64fa9aff9376bb 2026-04-02 09:34:12,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:12,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb95062a64fa9aff9376bb HTTP/1.1" 200 None 2026-04-02 09:34:12,886 - lava_callback - DEBUG - Processing node 69cb95062a64fa9aff9376bb: baseline-arm-clabbe 2026-04-02 09:34:12,886 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb95062a64fa9aff9376bb 2026-04-02 09:34:12,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:12,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb95062a64fa9aff9376bb HTTP/1.1" 200 None 2026-04-02 09:34:12,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:12,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:34:12,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:12,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb95062a64fa9aff9376bb HTTP/1.1" 200 None 2026-04-02 09:34:12,944 - lava_callback - ERROR - Error processing callback for node 69cb95062a64fa9aff9376bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:34:52,876 - lava_callback - INFO - Received callback for node 69cb952a2a64fa9aff9376c6 INFO: 172.21.0.1:60512 - "POST /node/69cb952a2a64fa9aff9376c6 HTTP/1.0" 202 Accepted 2026-04-02 09:34:52,882 - lava_callback - INFO - Starting async job submit for node 69cb952a2a64fa9aff9376c6 2026-04-02 09:34:52,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:52,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb952a2a64fa9aff9376c6 HTTP/1.1" 200 None 2026-04-02 09:34:52,912 - lava_callback - DEBUG - Processing node 69cb952a2a64fa9aff9376c6: baseline-arm-clabbe 2026-04-02 09:34:52,912 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb952a2a64fa9aff9376c6 2026-04-02 09:34:52,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:52,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb952a2a64fa9aff9376c6 HTTP/1.1" 200 None 2026-04-02 09:34:52,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:52,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:34:52,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:52,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb952a2a64fa9aff9376c6 HTTP/1.1" 200 None 2026-04-02 09:34:52,981 - lava_callback - ERROR - Error processing callback for node 69cb952a2a64fa9aff9376c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60518 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:34:59,684 - lava_callback - INFO - Received callback for node 69ce34d1cb08ea23a1f687e9 INFO: 172.21.0.1:60532 - "POST /node/69ce34d1cb08ea23a1f687e9 HTTP/1.0" 202 Accepted 2026-04-02 09:34:59,691 - lava_callback - INFO - Starting async job submit for node 69ce34d1cb08ea23a1f687e9 2026-04-02 09:34:59,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:34:59,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d1cb08ea23a1f687e9 HTTP/1.1" 200 None 2026-04-02 09:34:59,741 - lava_callback - DEBUG - Processing node 69ce34d1cb08ea23a1f687e9: baseline-arm64 2026-04-02 09:35:00,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:00,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:00,265 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34d1cb08ea23a1f687e9/log.txt.gz 2026-04-02 09:35:00,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:00,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:00,785 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34d1cb08ea23a1f687e9/lava-logs.yaml 2026-04-02 09:35:00,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:00,970 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:00,972 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34d1cb08ea23a1f687e9/lava_callback.json.gz DEBUG: Setup failed for 69ce34d1cb08ea23a1f687e9. Transitting job node result: incomplete -> fail 2026-04-02 09:35:01,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:01,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d1cb08ea23a1f687e9 HTTP/1.1" 200 None 2026-04-02 09:35:01,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:01,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:35:01,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:01,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d1cb08ea23a1f687e9 HTTP/1.1" 200 None 2026-04-02 09:35:01,208 - lava_callback - INFO - Completed processing callback for node 69ce34d1cb08ea23a1f687e9 INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52828 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:35:27,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:27,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44470 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:35:56,903 - lava_callback - INFO - Received callback for node 69ce34cccb08ea23a1f687dc INFO: 172.21.0.1:44480 - "POST /node/69ce34cccb08ea23a1f687dc HTTP/1.0" 202 Accepted 2026-04-02 09:35:56,914 - lava_callback - INFO - Starting async job submit for node 69ce34cccb08ea23a1f687dc 2026-04-02 09:35:56,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:56,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cccb08ea23a1f687dc HTTP/1.1" 200 None 2026-04-02 09:35:56,957 - lava_callback - DEBUG - Processing node 69ce34cccb08ea23a1f687dc: baseline-arm64 2026-04-02 09:35:57,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:57,602 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:57,604 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cccb08ea23a1f687dc/log.txt.gz 2026-04-02 09:35:57,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:58,082 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:58,084 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cccb08ea23a1f687dc/lava-logs.yaml 2026-04-02 09:35:58,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:35:58,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:35:58,277 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce34cccb08ea23a1f687dc/lava_callback.json.gz 2026-04-02 09:35:58,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:58,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34cccb08ea23a1f687dc HTTP/1.1" 200 None 2026-04-02 09:35:58,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:58,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:35:58,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:35:58,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34cccb08ea23a1f687dc HTTP/1.1" 200 None 2026-04-02 09:35:58,449 - lava_callback - INFO - Completed processing callback for node 69ce34cccb08ea23a1f687dc INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:36:27,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:27,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52412 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:36:32,982 - lava_callback - INFO - Received callback for node 69cb959d2a64fa9aff9376e1 INFO: 172.21.0.1:52418 - "POST /node/69cb959d2a64fa9aff9376e1 HTTP/1.0" 202 Accepted 2026-04-02 09:36:32,989 - lava_callback - INFO - Starting async job submit for node 69cb959d2a64fa9aff9376e1 2026-04-02 09:36:32,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:33,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb959d2a64fa9aff9376e1 HTTP/1.1" 200 None 2026-04-02 09:36:33,010 - lava_callback - DEBUG - Processing node 69cb959d2a64fa9aff9376e1: baseline-arm-clabbe 2026-04-02 09:36:33,010 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb959d2a64fa9aff9376e1 2026-04-02 09:36:33,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:33,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb959d2a64fa9aff9376e1 HTTP/1.1" 200 None 2026-04-02 09:36:33,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:33,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399c1bbc022e792643e8d HTTP/1.1" 200 None 2026-04-02 09:36:33,041 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:33,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb959d2a64fa9aff9376e1 HTTP/1.1" 200 None 2026-04-02 09:36:33,067 - lava_callback - ERROR - Error processing callback for node 69cb959d2a64fa9aff9376e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:36:47,337 - lava_callback - INFO - Received callback for node 69ce34dccb08ea23a1f6880b INFO: 172.21.0.1:57956 - "POST /node/69ce34dccb08ea23a1f6880b HTTP/1.0" 202 Accepted 2026-04-02 09:36:47,344 - lava_callback - INFO - Starting async job submit for node 69ce34dccb08ea23a1f6880b 2026-04-02 09:36:47,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:47,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dccb08ea23a1f6880b HTTP/1.1" 200 None 2026-04-02 09:36:47,388 - lava_callback - DEBUG - Processing node 69ce34dccb08ea23a1f6880b: baseline-nfs-arm64 2026-04-02 09:36:47,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:36:48,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:36:48,094 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dccb08ea23a1f6880b/log.txt.gz 2026-04-02 09:36:48,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:36:48,796 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:36:48,799 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dccb08ea23a1f6880b/lava-logs.yaml 2026-04-02 09:36:48,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:36:48,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:36:48,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34dccb08ea23a1f6880b/lava_callback.json.gz 2026-04-02 09:36:49,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:49,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34dccb08ea23a1f6880b HTTP/1.1" 200 None 2026-04-02 09:36:49,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:49,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:36:49,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:49,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34dccb08ea23a1f6880b HTTP/1.1" 200 None 2026-04-02 09:36:49,151 - lava_callback - INFO - Completed processing callback for node 69ce34dccb08ea23a1f6880b INFO: 172.21.0.1:36874 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:36:57,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:36:57,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49142 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:41:27,644 - lava_callback - INFO - Received callback for node 69ce34d6cb08ea23a1f687f5 INFO: 172.21.0.1:49148 - "POST /node/69ce34d6cb08ea23a1f687f5 HTTP/1.0" 202 Accepted 2026-04-02 09:41:27,652 - lava_callback - INFO - Starting async job submit for node 69ce34d6cb08ea23a1f687f5 2026-04-02 09:41:27,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:41:27,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d6cb08ea23a1f687f5 HTTP/1.1" 200 None 2026-04-02 09:41:27,710 - lava_callback - DEBUG - Processing node 69ce34d6cb08ea23a1f687f5: baseline-nfs-arm64 2026-04-02 09:41:28,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:41:28,965 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:41:28,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d6cb08ea23a1f687f5/log.txt.gz 2026-04-02 09:41:29,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:41:30,006 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:41:30,009 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d6cb08ea23a1f687f5/lava-logs.yaml 2026-04-02 09:41:30,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:41:30,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:41:30,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce34d6cb08ea23a1f687f5/lava_callback.json.gz DEBUG: Setup failed for 69ce34d6cb08ea23a1f687f5. Transitting job node result: incomplete -> fail 2026-04-02 09:41:30,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:41:30,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce34d6cb08ea23a1f687f5 HTTP/1.1" 200 None 2026-04-02 09:41:30,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:41:30,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:41:30,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:41:30,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce34d6cb08ea23a1f687f5 HTTP/1.1" 200 None 2026-04-02 09:41:30,458 - lava_callback - INFO - Completed processing callback for node 69ce34d6cb08ea23a1f687f5 INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:41:57,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:41:57,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43862 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:45:05,270 - lava_callback - INFO - Received callback for node 69cb978f2a64fa9aff937731 INFO: 172.21.0.1:36586 - "POST /node/69cb978f2a64fa9aff937731 HTTP/1.0" 202 Accepted 2026-04-02 09:45:05,275 - lava_callback - INFO - Starting async job submit for node 69cb978f2a64fa9aff937731 2026-04-02 09:45:05,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:45:05,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb978f2a64fa9aff937731 HTTP/1.1" 200 None 2026-04-02 09:45:05,293 - lava_callback - DEBUG - Processing node 69cb978f2a64fa9aff937731: baseline-arm64-baylibre 2026-04-02 09:45:05,293 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb978f2a64fa9aff937731 2026-04-02 09:45:05,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:45:05,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb978f2a64fa9aff937731 HTTP/1.1" 200 None 2026-04-02 09:45:05,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:45:05,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 09:45:05,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:45:05,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb978f2a64fa9aff937731 HTTP/1.1" 200 None 2026-04-02 09:45:05,383 - lava_callback - ERROR - Error processing callback for node 69cb978f2a64fa9aff937731: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:47:25,355 - lava_callback - INFO - Received callback for node 69cb98262a64fa9aff937747 INFO: 172.21.0.1:40148 - "POST /node/69cb98262a64fa9aff937747 HTTP/1.0" 202 Accepted 2026-04-02 09:47:25,361 - lava_callback - INFO - Starting async job submit for node 69cb98262a64fa9aff937747 2026-04-02 09:47:25,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:47:25,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb98262a64fa9aff937747 HTTP/1.1" 200 None 2026-04-02 09:47:25,386 - lava_callback - DEBUG - Processing node 69cb98262a64fa9aff937747: baseline-arm64-baylibre 2026-04-02 09:47:25,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb98262a64fa9aff937747 2026-04-02 09:47:25,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:47:25,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb98262a64fa9aff937747 HTTP/1.1" 200 None 2026-04-02 09:47:25,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:47:25,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 09:47:25,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:47:25,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb98262a64fa9aff937747 HTTP/1.1" 200 None 2026-04-02 09:47:25,459 - lava_callback - ERROR - Error processing callback for node 69cb98262a64fa9aff937747: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:51:25,561 - lava_callback - INFO - Received callback for node 69cb990a2a64fa9aff93776f INFO: 172.21.0.1:42412 - "POST /node/69cb990a2a64fa9aff93776f HTTP/1.0" 202 Accepted 2026-04-02 09:51:25,567 - lava_callback - INFO - Starting async job submit for node 69cb990a2a64fa9aff93776f 2026-04-02 09:51:25,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:51:25,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb990a2a64fa9aff93776f HTTP/1.1" 200 None 2026-04-02 09:51:25,583 - lava_callback - DEBUG - Processing node 69cb990a2a64fa9aff93776f: baseline-arm64-baylibre 2026-04-02 09:51:25,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb990a2a64fa9aff93776f 2026-04-02 09:51:25,584 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:51:25,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb990a2a64fa9aff93776f HTTP/1.1" 200 None 2026-04-02 09:51:25,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:51:25,613 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 09:51:25,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:51:25,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb990a2a64fa9aff93776f HTTP/1.1" 200 None 2026-04-02 09:51:25,640 - lava_callback - ERROR - Error processing callback for node 69cb990a2a64fa9aff93776f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46718 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:52:24,277 - lava_callback - INFO - Received callback for node 69ce3c45cb08ea23a1f68b28 INFO: 172.21.0.1:60360 - "POST /node/69ce3c45cb08ea23a1f68b28 HTTP/1.0" 202 Accepted 2026-04-02 09:52:24,284 - lava_callback - INFO - Starting async job submit for node 69ce3c45cb08ea23a1f68b28 2026-04-02 09:52:24,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:24,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3c45cb08ea23a1f68b28 HTTP/1.1" 200 None 2026-04-02 09:52:24,304 - lava_callback - DEBUG - Processing node 69ce3c45cb08ea23a1f68b28: baseline-nfs-arm64 2026-04-02 09:52:24,306 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:52:24,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:52:24,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:52:24,525 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3c45cb08ea23a1f68b28/lava-logs.yaml 2026-04-02 09:52:24,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:52:24,678 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:52:24,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3c45cb08ea23a1f68b28/lava_callback.json.gz 2026-04-02 09:52:24,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:24,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3c45cb08ea23a1f68b28 HTTP/1.1" 200 None 2026-04-02 09:52:24,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:24,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:52:24,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:24,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3c45cb08ea23a1f68b28 HTTP/1.1" 200 None 2026-04-02 09:52:24,755 - lava_callback - INFO - Completed processing callback for node 69ce3c45cb08ea23a1f68b28 2026-04-02 09:52:25,574 - lava_callback - INFO - Received callback for node 69cb99562a64fa9aff937781 INFO: 172.21.0.1:60368 - "POST /node/69cb99562a64fa9aff937781 HTTP/1.0" 202 Accepted 2026-04-02 09:52:25,580 - lava_callback - INFO - Starting async job submit for node 69cb99562a64fa9aff937781 2026-04-02 09:52:25,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:25,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99562a64fa9aff937781 HTTP/1.1" 200 None 2026-04-02 09:52:25,597 - lava_callback - DEBUG - Processing node 69cb99562a64fa9aff937781: baseline-arm64-baylibre 2026-04-02 09:52:25,597 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb99562a64fa9aff937781 2026-04-02 09:52:25,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:25,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99562a64fa9aff937781 HTTP/1.1" 200 None 2026-04-02 09:52:25,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:25,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:52:25,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:25,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb99562a64fa9aff937781 HTTP/1.1" 200 None 2026-04-02 09:52:25,665 - lava_callback - ERROR - Error processing callback for node 69cb99562a64fa9aff937781: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60384 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:52:27,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:52:27,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43094 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:53:45,655 - lava_callback - INFO - Received callback for node 69cb99a32a64fa9aff937789 INFO: 172.21.0.1:46460 - "POST /node/69cb99a32a64fa9aff937789 HTTP/1.0" 202 Accepted 2026-04-02 09:53:45,661 - lava_callback - INFO - Starting async job submit for node 69cb99a32a64fa9aff937789 2026-04-02 09:53:45,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:53:45,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99a32a64fa9aff937789 HTTP/1.1" 200 None 2026-04-02 09:53:45,689 - lava_callback - DEBUG - Processing node 69cb99a32a64fa9aff937789: baseline-arm64-baylibre 2026-04-02 09:53:45,689 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb99a32a64fa9aff937789 2026-04-02 09:53:45,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:53:45,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99a32a64fa9aff937789 HTTP/1.1" 200 None 2026-04-02 09:53:45,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:53:45,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:53:45,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:53:45,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb99a32a64fa9aff937789 HTTP/1.1" 200 None 2026-04-02 09:53:45,740 - lava_callback - ERROR - Error processing callback for node 69cb99a32a64fa9aff937789: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:54:02,065 - lava_callback - INFO - Received callback for node 69ce3c8acb08ea23a1f68b38 INFO: 172.21.0.1:40716 - "POST /node/69ce3c8acb08ea23a1f68b38 HTTP/1.0" 202 Accepted 2026-04-02 09:54:02,072 - lava_callback - INFO - Starting async job submit for node 69ce3c8acb08ea23a1f68b38 2026-04-02 09:54:02,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:54:02,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3c8acb08ea23a1f68b38 HTTP/1.1" 200 None 2026-04-02 09:54:02,125 - lava_callback - DEBUG - Processing node 69ce3c8acb08ea23a1f68b38: baseline-arm64 2026-04-02 09:54:02,267 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:54:02,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:54:02,639 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:54:02,641 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3c8acb08ea23a1f68b38/lava-logs.yaml 2026-04-02 09:54:02,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:54:03,102 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:54:03,104 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3c8acb08ea23a1f68b38/lava_callback.json.gz 2026-04-02 09:54:03,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:54:03,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3c8acb08ea23a1f68b38 HTTP/1.1" 200 None 2026-04-02 09:54:03,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:54:03,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:54:03,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:54:03,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3c8acb08ea23a1f68b38 HTTP/1.1" 200 None 2026-04-02 09:54:03,272 - lava_callback - INFO - Completed processing callback for node 69ce3c8acb08ea23a1f68b38 INFO: 172.21.0.1:40732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33598 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:54:27,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:54:27,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48668 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:55:05,738 - lava_callback - INFO - Received callback for node 69cb99ee2a64fa9aff937795 INFO: 172.21.0.1:60586 - "POST /node/69cb99ee2a64fa9aff937795 HTTP/1.0" 202 Accepted 2026-04-02 09:55:05,743 - lava_callback - INFO - Starting async job submit for node 69cb99ee2a64fa9aff937795 2026-04-02 09:55:05,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:05,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99ee2a64fa9aff937795 HTTP/1.1" 200 None 2026-04-02 09:55:05,759 - lava_callback - DEBUG - Processing node 69cb99ee2a64fa9aff937795: baseline-arm64-baylibre 2026-04-02 09:55:05,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb99ee2a64fa9aff937795 2026-04-02 09:55:05,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:05,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb99ee2a64fa9aff937795 HTTP/1.1" 200 None 2026-04-02 09:55:05,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:05,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:55:05,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:05,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb99ee2a64fa9aff937795 HTTP/1.1" 200 None 2026-04-02 09:55:05,812 - lava_callback - ERROR - Error processing callback for node 69cb99ee2a64fa9aff937795: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49592 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:55:54,932 - lava_callback - INFO - Received callback for node 69ce3cd7cb08ea23a1f68b45 INFO: 172.21.0.1:52226 - "POST /node/69ce3cd7cb08ea23a1f68b45 HTTP/1.0" 202 Accepted 2026-04-02 09:55:54,938 - lava_callback - INFO - Starting async job submit for node 69ce3cd7cb08ea23a1f68b45 2026-04-02 09:55:54,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:54,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3cd7cb08ea23a1f68b45 HTTP/1.1" 200 None 2026-04-02 09:55:54,984 - lava_callback - DEBUG - Processing node 69ce3cd7cb08ea23a1f68b45: baseline-arm64 2026-04-02 09:55:55,118 - lava_callback - WARNING - Failed to upload log 2026-04-02 09:55:55,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:55:55,388 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:55:55,390 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3cd7cb08ea23a1f68b45/lava-logs.yaml 2026-04-02 09:55:55,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:55:55,749 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:55:55,750 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3cd7cb08ea23a1f68b45/lava_callback.json.gz 2026-04-02 09:55:55,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:55,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3cd7cb08ea23a1f68b45 HTTP/1.1" 200 None 2026-04-02 09:55:55,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:55,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:55:55,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:55,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3cd7cb08ea23a1f68b45 HTTP/1.1" 200 None 2026-04-02 09:55:55,920 - lava_callback - INFO - Completed processing callback for node 69ce3cd7cb08ea23a1f68b45 INFO: 172.21.0.1:52228 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:55:57,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:55:57,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39278 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:56:25,802 - lava_callback - INFO - Received callback for node 69cb9a3e2a64fa9aff93779d INFO: 172.21.0.1:45068 - "POST /node/69cb9a3e2a64fa9aff93779d HTTP/1.0" 202 Accepted 2026-04-02 09:56:25,808 - lava_callback - INFO - Starting async job submit for node 69cb9a3e2a64fa9aff93779d 2026-04-02 09:56:25,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:56:25,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9a3e2a64fa9aff93779d HTTP/1.1" 200 None 2026-04-02 09:56:25,827 - lava_callback - DEBUG - Processing node 69cb9a3e2a64fa9aff93779d: baseline-arm64-baylibre 2026-04-02 09:56:25,827 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9a3e2a64fa9aff93779d 2026-04-02 09:56:25,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:56:25,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9a3e2a64fa9aff93779d HTTP/1.1" 200 None 2026-04-02 09:56:25,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:56:25,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:56:25,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:56:25,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9a3e2a64fa9aff93779d HTTP/1.1" 200 None 2026-04-02 09:56:25,890 - lava_callback - ERROR - Error processing callback for node 69cb9a3e2a64fa9aff93779d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50442 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:57:42,609 - lava_callback - INFO - Received callback for node 69ce3d4bcb08ea23a1f68b64 INFO: 172.21.0.1:38158 - "POST /node/69ce3d4bcb08ea23a1f68b64 HTTP/1.0" 202 Accepted 2026-04-02 09:57:42,615 - lava_callback - INFO - Starting async job submit for node 69ce3d4bcb08ea23a1f68b64 2026-04-02 09:57:42,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:42,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d4bcb08ea23a1f68b64 HTTP/1.1" 200 None 2026-04-02 09:57:42,660 - lava_callback - DEBUG - Processing node 69ce3d4bcb08ea23a1f68b64: baseline-arm64 2026-04-02 09:57:43,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:57:43,297 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:57:43,299 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d4bcb08ea23a1f68b64/log.txt.gz 2026-04-02 09:57:43,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:57:43,809 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:57:43,811 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d4bcb08ea23a1f68b64/lava-logs.yaml 2026-04-02 09:57:43,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 09:57:43,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 09:57:43,983 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d4bcb08ea23a1f68b64/lava_callback.json.gz 2026-04-02 09:57:44,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:44,047 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d4bcb08ea23a1f68b64 HTTP/1.1" 200 None 2026-04-02 09:57:44,049 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:44,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 09:57:44,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:44,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3d4bcb08ea23a1f68b64 HTTP/1.1" 200 None 2026-04-02 09:57:44,130 - lava_callback - INFO - Completed processing callback for node 69ce3d4bcb08ea23a1f68b64 2026-04-02 09:57:45,936 - lava_callback - INFO - Received callback for node 69cb9a8a2a64fa9aff9377ad INFO: 172.21.0.1:38170 - "POST /node/69cb9a8a2a64fa9aff9377ad HTTP/1.0" 202 Accepted 2026-04-02 09:57:45,941 - lava_callback - INFO - Starting async job submit for node 69cb9a8a2a64fa9aff9377ad 2026-04-02 09:57:45,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:45,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9a8a2a64fa9aff9377ad HTTP/1.1" 200 None 2026-04-02 09:57:45,958 - lava_callback - DEBUG - Processing node 69cb9a8a2a64fa9aff9377ad: baseline-arm64-baylibre 2026-04-02 09:57:45,958 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9a8a2a64fa9aff9377ad 2026-04-02 09:57:45,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:45,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9a8a2a64fa9aff9377ad HTTP/1.1" 200 None 2026-04-02 09:57:45,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:45,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:57:45,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:46,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9a8a2a64fa9aff9377ad HTTP/1.1" 200 None 2026-04-02 09:57:46,018 - lava_callback - ERROR - Error processing callback for node 69cb9a8a2a64fa9aff9377ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:57:57,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:57:57,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44694 - "GET / HTTP/1.0" 200 OK 2026-04-02 09:59:25,977 - lava_callback - INFO - Received callback for node 69cb9afa2a64fa9aff9377c5 INFO: 172.21.0.1:36510 - "POST /node/69cb9afa2a64fa9aff9377c5 HTTP/1.0" 202 Accepted 2026-04-02 09:59:25,983 - lava_callback - INFO - Starting async job submit for node 69cb9afa2a64fa9aff9377c5 2026-04-02 09:59:25,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:59:26,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9afa2a64fa9aff9377c5 HTTP/1.1" 200 None 2026-04-02 09:59:26,001 - lava_callback - DEBUG - Processing node 69cb9afa2a64fa9aff9377c5: baseline-arm64-baylibre 2026-04-02 09:59:26,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9afa2a64fa9aff9377c5 2026-04-02 09:59:26,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:59:26,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9afa2a64fa9aff9377c5 HTTP/1.1" 200 None 2026-04-02 09:59:26,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:59:26,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 09:59:26,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 09:59:26,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9afa2a64fa9aff9377c5 HTTP/1.1" 200 None 2026-04-02 09:59:26,060 - lava_callback - ERROR - Error processing callback for node 69cb9afa2a64fa9aff9377c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36028 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:00:46,034 - lava_callback - INFO - Received callback for node 69cb9b472a64fa9aff9377ce INFO: 172.21.0.1:55534 - "POST /node/69cb9b472a64fa9aff9377ce HTTP/1.0" 202 Accepted 2026-04-02 10:00:46,040 - lava_callback - INFO - Starting async job submit for node 69cb9b472a64fa9aff9377ce 2026-04-02 10:00:46,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:00:46,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9b472a64fa9aff9377ce HTTP/1.1" 200 None 2026-04-02 10:00:46,060 - lava_callback - DEBUG - Processing node 69cb9b472a64fa9aff9377ce: baseline-arm64-baylibre 2026-04-02 10:00:46,060 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9b472a64fa9aff9377ce 2026-04-02 10:00:46,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:00:46,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9b472a64fa9aff9377ce HTTP/1.1" 200 None 2026-04-02 10:00:46,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:00:46,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:00:46,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:00:46,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9b472a64fa9aff9377ce HTTP/1.1" 200 None 2026-04-02 10:00:46,145 - lava_callback - ERROR - Error processing callback for node 69cb9b472a64fa9aff9377ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:03:34,123 - lava_callback - INFO - Received callback for node 69cb9be92a64fa9aff9377e6 INFO: 172.21.0.1:48144 - "POST /node/69cb9be92a64fa9aff9377e6 HTTP/1.0" 202 Accepted 2026-04-02 10:03:34,130 - lava_callback - INFO - Starting async job submit for node 69cb9be92a64fa9aff9377e6 2026-04-02 10:03:34,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:03:34,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9be92a64fa9aff9377e6 HTTP/1.1" 200 None 2026-04-02 10:03:34,150 - lava_callback - DEBUG - Processing node 69cb9be92a64fa9aff9377e6: baseline-arm64-clabbe 2026-04-02 10:03:34,151 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9be92a64fa9aff9377e6 2026-04-02 10:03:34,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:03:34,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9be92a64fa9aff9377e6 HTTP/1.1" 200 None 2026-04-02 10:03:34,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:03:34,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:03:34,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:03:34,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9be92a64fa9aff9377e6 HTTP/1.1" 200 None 2026-04-02 10:03:34,215 - lava_callback - ERROR - Error processing callback for node 69cb9be92a64fa9aff9377e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50590 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:04:54,232 - lava_callback - INFO - Received callback for node 69cb9c372a64fa9aff9377ec INFO: 172.21.0.1:54476 - "POST /node/69cb9c372a64fa9aff9377ec HTTP/1.0" 202 Accepted 2026-04-02 10:04:54,238 - lava_callback - INFO - Starting async job submit for node 69cb9c372a64fa9aff9377ec 2026-04-02 10:04:54,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:04:54,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9c372a64fa9aff9377ec HTTP/1.1" 200 None 2026-04-02 10:04:54,276 - lava_callback - DEBUG - Processing node 69cb9c372a64fa9aff9377ec: baseline-arm64-clabbe 2026-04-02 10:04:54,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9c372a64fa9aff9377ec 2026-04-02 10:04:54,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:04:54,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9c372a64fa9aff9377ec HTTP/1.1" 200 None 2026-04-02 10:04:54,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:04:54,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:04:54,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:04:54,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9c372a64fa9aff9377ec HTTP/1.1" 200 None 2026-04-02 10:04:54,346 - lava_callback - ERROR - Error processing callback for node 69cb9c372a64fa9aff9377ec: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45592 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:05:57,695 - lava_callback - INFO - Received callback for node 69ce3d9bcb08ea23a1f68b75 INFO: 172.21.0.1:45608 - "POST /node/69ce3d9bcb08ea23a1f68b75 HTTP/1.0" 202 Accepted 2026-04-02 10:05:57,703 - lava_callback - INFO - Starting async job submit for node 69ce3d9bcb08ea23a1f68b75 2026-04-02 10:05:57,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:05:57,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d9bcb08ea23a1f68b75 HTTP/1.1" 200 None 2026-04-02 10:05:57,768 - lava_callback - DEBUG - Processing node 69ce3d9bcb08ea23a1f68b75: baseline-arm64 2026-04-02 10:05:58,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:05:58,364 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:05:58,365 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d9bcb08ea23a1f68b75/log.txt.gz 2026-04-02 10:05:58,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:05:58,810 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:05:58,812 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d9bcb08ea23a1f68b75/lava-logs.yaml 2026-04-02 10:05:58,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:05:59,083 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:05:59,085 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3d9bcb08ea23a1f68b75/lava_callback.json.gz DEBUG: Setup failed for 69ce3d9bcb08ea23a1f68b75. Transitting job node result: incomplete -> fail 2026-04-02 10:05:59,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:05:59,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d9bcb08ea23a1f68b75 HTTP/1.1" 200 None 2026-04-02 10:05:59,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:05:59,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:05:59,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:05:59,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3d9bcb08ea23a1f68b75 HTTP/1.1" 200 None 2026-04-02 10:05:59,275 - lava_callback - INFO - Completed processing callback for node 69ce3d9bcb08ea23a1f68b75 INFO: 172.21.0.1:44798 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:06:14,245 - lava_callback - INFO - Received callback for node 69cb9c852a64fa9aff9377f8 INFO: 172.21.0.1:45332 - "POST /node/69cb9c852a64fa9aff9377f8 HTTP/1.0" 202 Accepted 2026-04-02 10:06:14,250 - lava_callback - INFO - Starting async job submit for node 69cb9c852a64fa9aff9377f8 2026-04-02 10:06:14,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:14,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9c852a64fa9aff9377f8 HTTP/1.1" 200 None 2026-04-02 10:06:14,269 - lava_callback - DEBUG - Processing node 69cb9c852a64fa9aff9377f8: baseline-arm64-clabbe 2026-04-02 10:06:14,269 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9c852a64fa9aff9377f8 2026-04-02 10:06:14,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:14,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9c852a64fa9aff9377f8 HTTP/1.1" 200 None 2026-04-02 10:06:14,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:14,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:06:14,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:14,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9c852a64fa9aff9377f8 HTTP/1.1" 200 None 2026-04-02 10:06:14,320 - lava_callback - ERROR - Error processing callback for node 69cb9c852a64fa9aff9377f8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50730 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:06:27,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:27,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:06:47,045 - lava_callback - INFO - Received callback for node 69ce3fa3cb08ea23a1f68bc6 INFO: 172.21.0.1:37402 - "POST /node/69ce3fa3cb08ea23a1f68bc6 HTTP/1.0" 202 Accepted 2026-04-02 10:06:47,051 - lava_callback - INFO - Starting async job submit for node 69ce3fa3cb08ea23a1f68bc6 2026-04-02 10:06:47,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:47,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3fa3cb08ea23a1f68bc6 HTTP/1.1" 200 None 2026-04-02 10:06:47,067 - lava_callback - DEBUG - Processing node 69ce3fa3cb08ea23a1f68bc6: baseline-nfs-arm64 2026-04-02 10:06:47,069 - lava_callback - WARNING - Failed to upload log 2026-04-02 10:06:47,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:06:47,221 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:06:47,223 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3fa3cb08ea23a1f68bc6/lava-logs.yaml 2026-04-02 10:06:47,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:06:47,351 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:06:47,353 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3fa3cb08ea23a1f68bc6/lava_callback.json.gz 2026-04-02 10:06:47,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:47,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3fa3cb08ea23a1f68bc6 HTTP/1.1" 200 None 2026-04-02 10:06:47,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:47,393 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:06:47,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:47,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3fa3cb08ea23a1f68bc6 HTTP/1.1" 200 None 2026-04-02 10:06:47,422 - lava_callback - INFO - Completed processing callback for node 69ce3fa3cb08ea23a1f68bc6 INFO: 172.21.0.1:59936 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:06:57,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:06:57,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-04-02 10:07:06,100 - lava_callback - INFO - Received callback for node 69ce3b41cb08ea23a1f68b00 INFO: 172.21.0.1:35530 - "POST /node/69ce3b41cb08ea23a1f68b00 HTTP/1.0" 202 Accepted 2026-04-02 10:07:06,157 - lava_callback - INFO - Starting async job submit for node 69ce3b41cb08ea23a1f68b00 2026-04-02 10:07:06,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:07:06,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3b41cb08ea23a1f68b00 HTTP/1.1" 200 None 2026-04-02 10:07:06,219 - lava_callback - DEBUG - Processing node 69ce3b41cb08ea23a1f68b00: baseline-arm-pengutronix 2026-04-02 10:07:06,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:07:06,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:07:06,496 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce3b41cb08ea23a1f68b00/log.txt.gz INFO: 172.21.0.1:35538 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:07:06,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:07:06,721 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:07:06,723 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce3b41cb08ea23a1f68b00/lava-logs.yaml 2026-04-02 10:07:06,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:07:06,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:07:06,847 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce3b41cb08ea23a1f68b00/lava_callback.json.gz DEBUG: Setup failed for 69ce3b41cb08ea23a1f68b00. Transitting job node result: incomplete -> fail 2026-04-02 10:07:06,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:07:06,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3b41cb08ea23a1f68b00 HTTP/1.1" 200 None 2026-04-02 10:07:06,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:07:06,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 10:07:06,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:07:06,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3b41cb08ea23a1f68b00 HTTP/1.1" 200 None 2026-04-02 10:07:07,003 - lava_callback - INFO - Completed processing callback for node 69ce3b41cb08ea23a1f68b00 INFO: 172.21.0.1:47488 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45034 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:07:27,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:07:27,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:08:54,338 - lava_callback - INFO - Received callback for node 69cb9d202a64fa9aff93780c INFO: 172.21.0.1:45900 - "POST /node/69cb9d202a64fa9aff93780c HTTP/1.0" 202 Accepted 2026-04-02 10:08:54,344 - lava_callback - INFO - Starting async job submit for node 69cb9d202a64fa9aff93780c 2026-04-02 10:08:54,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:08:54,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9d202a64fa9aff93780c HTTP/1.1" 200 None 2026-04-02 10:08:54,382 - lava_callback - DEBUG - Processing node 69cb9d202a64fa9aff93780c: baseline-arm64-clabbe 2026-04-02 10:08:54,382 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9d202a64fa9aff93780c 2026-04-02 10:08:54,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:08:54,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9d202a64fa9aff93780c HTTP/1.1" 200 None 2026-04-02 10:08:54,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:08:54,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:08:54,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:08:54,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9d202a64fa9aff93780c HTTP/1.1" 200 None 2026-04-02 10:08:54,448 - lava_callback - ERROR - Error processing callback for node 69cb9d202a64fa9aff93780c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45280 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:09:30,870 - lava_callback - INFO - Received callback for node 69ce3de4cb08ea23a1f68b80 INFO: 172.21.0.1:40050 - "POST /node/69ce3de4cb08ea23a1f68b80 HTTP/1.0" 202 Accepted 2026-04-02 10:09:30,877 - lava_callback - INFO - Starting async job submit for node 69ce3de4cb08ea23a1f68b80 2026-04-02 10:09:30,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:09:30,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3de4cb08ea23a1f68b80 HTTP/1.1" 200 None 2026-04-02 10:09:30,917 - lava_callback - DEBUG - Processing node 69ce3de4cb08ea23a1f68b80: baseline-arm64 2026-04-02 10:09:31,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:40054 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:09:31,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:09:31,564 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3de4cb08ea23a1f68b80/log.txt.gz 2026-04-02 10:09:31,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:09:32,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:09:32,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3de4cb08ea23a1f68b80/lava-logs.yaml 2026-04-02 10:09:32,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:09:32,229 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:09:32,231 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce3de4cb08ea23a1f68b80/lava_callback.json.gz 2026-04-02 10:09:32,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:09:32,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3de4cb08ea23a1f68b80 HTTP/1.1" 200 None 2026-04-02 10:09:32,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:09:32,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:09:32,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:09:32,342 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3de4cb08ea23a1f68b80 HTTP/1.1" 200 None 2026-04-02 10:09:32,395 - lava_callback - INFO - Completed processing callback for node 69ce3de4cb08ea23a1f68b80 INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47626 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:09:57,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:09:57,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:52990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:10:52,842 - lava_callback - INFO - Received callback for node 69ce3e36cb08ea23a1f68b8c INFO: 172.21.0.1:47012 - "POST /node/69ce3e36cb08ea23a1f68b8c HTTP/1.0" 202 Accepted 2026-04-02 10:10:52,849 - lava_callback - INFO - Starting async job submit for node 69ce3e36cb08ea23a1f68b8c 2026-04-02 10:10:52,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:10:52,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3e36cb08ea23a1f68b8c HTTP/1.1" 200 None 2026-04-02 10:10:52,890 - lava_callback - DEBUG - Processing node 69ce3e36cb08ea23a1f68b8c: baseline-nfs-arm64 2026-04-02 10:10:53,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:10:53,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:10:53,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e36cb08ea23a1f68b8c/log.txt.gz 2026-04-02 10:10:53,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:10:54,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:10:54,079 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e36cb08ea23a1f68b8c/lava-logs.yaml 2026-04-02 10:10:54,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:10:54,399 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:10:54,400 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e36cb08ea23a1f68b8c/lava_callback.json.gz 2026-04-02 10:10:54,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:10:54,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3e36cb08ea23a1f68b8c HTTP/1.1" 200 None 2026-04-02 10:10:54,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:10:54,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:10:54,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:10:54,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3e36cb08ea23a1f68b8c HTTP/1.1" 200 None 2026-04-02 10:10:54,546 - lava_callback - INFO - Completed processing callback for node 69ce3e36cb08ea23a1f68b8c INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:10:57,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:10:57,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35774 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:11:08,537 - lava_callback - INFO - Received callback for node 69ce4076cb08ea23a1f68beb INFO: 172.21.0.1:35788 - "POST /node/69ce4076cb08ea23a1f68beb HTTP/1.0" 202 Accepted 2026-04-02 10:11:08,544 - lava_callback - INFO - Starting async job submit for node 69ce4076cb08ea23a1f68beb 2026-04-02 10:11:08,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:11:08,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4076cb08ea23a1f68beb HTTP/1.1" 200 None 2026-04-02 10:11:08,590 - lava_callback - DEBUG - Processing node 69ce4076cb08ea23a1f68beb: baseline-arm64 2026-04-02 10:11:08,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:11:08,914 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:11:08,916 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4076cb08ea23a1f68beb/log.txt.gz 2026-04-02 10:11:09,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:11:09,248 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:11:09,250 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4076cb08ea23a1f68beb/lava-logs.yaml 2026-04-02 10:11:09,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:11:09,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:11:09,388 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4076cb08ea23a1f68beb/lava_callback.json.gz 2026-04-02 10:11:09,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:11:09,432 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4076cb08ea23a1f68beb HTTP/1.1" 200 None 2026-04-02 10:11:09,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:11:09,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:11:09,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:11:09,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4076cb08ea23a1f68beb HTTP/1.1" 200 None 2026-04-02 10:11:09,549 - lava_callback - INFO - Completed processing callback for node 69ce4076cb08ea23a1f68beb INFO: 172.21.0.1:41328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57674 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:11:27,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:11:27,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:12:34,460 - lava_callback - INFO - Received callback for node 69cb9e0e2a64fa9aff93782c INFO: 172.21.0.1:48968 - "POST /node/69cb9e0e2a64fa9aff93782c HTTP/1.0" 202 Accepted 2026-04-02 10:12:34,465 - lava_callback - INFO - Starting async job submit for node 69cb9e0e2a64fa9aff93782c 2026-04-02 10:12:34,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:12:34,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9e0e2a64fa9aff93782c HTTP/1.1" 200 None 2026-04-02 10:12:34,481 - lava_callback - DEBUG - Processing node 69cb9e0e2a64fa9aff93782c: baseline-arm64-clabbe 2026-04-02 10:12:34,482 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9e0e2a64fa9aff93782c 2026-04-02 10:12:34,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:12:34,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9e0e2a64fa9aff93782c HTTP/1.1" 200 None 2026-04-02 10:12:34,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:12:34,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:12:34,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:12:34,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9e0e2a64fa9aff93782c HTTP/1.1" 200 None 2026-04-02 10:12:34,539 - lava_callback - ERROR - Error processing callback for node 69cb9e0e2a64fa9aff93782c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET /node/698c536a755d7811a414168d%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:41292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:13:22,285 - lava_callback - INFO - Received callback for node 69ce410acb08ea23a1f68c01 INFO: 172.21.0.1:46624 - "POST /node/69ce410acb08ea23a1f68c01 HTTP/1.0" 202 Accepted 2026-04-02 10:13:22,292 - lava_callback - INFO - Starting async job submit for node 69ce410acb08ea23a1f68c01 2026-04-02 10:13:22,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:13:22,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce410acb08ea23a1f68c01 HTTP/1.1" 200 None 2026-04-02 10:13:22,338 - lava_callback - DEBUG - Processing node 69ce410acb08ea23a1f68c01: baseline-arm64 2026-04-02 10:13:22,472 - lava_callback - WARNING - Failed to upload log 2026-04-02 10:13:22,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:13:22,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:13:22,841 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce410acb08ea23a1f68c01/lava-logs.yaml 2026-04-02 10:13:22,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:13:22,984 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:13:22,986 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce410acb08ea23a1f68c01/lava_callback.json.gz 2026-04-02 10:13:23,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:13:23,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce410acb08ea23a1f68c01 HTTP/1.1" 200 None 2026-04-02 10:13:23,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:13:23,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:13:23,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:13:23,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce410acb08ea23a1f68c01 HTTP/1.1" 200 None 2026-04-02 10:13:23,129 - lava_callback - INFO - Completed processing callback for node 69ce410acb08ea23a1f68c01 INFO: 172.21.0.1:46640 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:13:27,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:13:27,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53336 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:14:01,474 - lava_callback - INFO - Received callback for node 69ce3d21cb08ea23a1f68b51 INFO: 172.21.0.1:44712 - "POST /node/69ce3d21cb08ea23a1f68b51 HTTP/1.0" 202 Accepted 2026-04-02 10:14:01,486 - lava_callback - INFO - Starting async job submit for node 69ce3d21cb08ea23a1f68b51 2026-04-02 10:14:01,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:01,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d21cb08ea23a1f68b51 HTTP/1.1" 200 None 2026-04-02 10:14:01,577 - lava_callback - DEBUG - Processing node 69ce3d21cb08ea23a1f68b51: baseline-arm 2026-04-02 10:14:02,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:03,353 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:03,355 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3d21cb08ea23a1f68b51/log.txt.gz 2026-04-02 10:14:03,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:04,081 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:04,083 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3d21cb08ea23a1f68b51/lava-logs.yaml 2026-04-02 10:14:04,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:04,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:04,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce3d21cb08ea23a1f68b51/lava_callback.json.gz DEBUG: Setup failed for 69ce3d21cb08ea23a1f68b51. Transitting job node result: incomplete -> fail 2026-04-02 10:14:04,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:04,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d21cb08ea23a1f68b51 HTTP/1.1" 200 None 2026-04-02 10:14:04,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:04,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 10:14:04,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:04,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3d21cb08ea23a1f68b51 HTTP/1.1" 200 None 2026-04-02 10:14:04,603 - lava_callback - INFO - Completed processing callback for node 69ce3d21cb08ea23a1f68b51 INFO: 172.21.0.1:44724 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:14:08,504 - lava_callback - INFO - Received callback for node 69ce3d44cb08ea23a1f68b5f INFO: 172.21.0.1:44732 - "POST /node/69ce3d44cb08ea23a1f68b5f HTTP/1.0" 202 Accepted 2026-04-02 10:14:08,511 - lava_callback - INFO - Starting async job submit for node 69ce3d44cb08ea23a1f68b5f 2026-04-02 10:14:08,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:08,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d44cb08ea23a1f68b5f HTTP/1.1" 200 None 2026-04-02 10:14:08,623 - lava_callback - DEBUG - Processing node 69ce3d44cb08ea23a1f68b5f: ltp-smoke 2026-04-02 10:14:09,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:09,322 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:09,324 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3d44cb08ea23a1f68b5f/log.txt.gz 2026-04-02 10:14:09,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:09,912 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:09,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3d44cb08ea23a1f68b5f/lava-logs.yaml 2026-04-02 10:14:09,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:14:10,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:14:10,093 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce3d44cb08ea23a1f68b5f/lava_callback.json.gz 2026-04-02 10:14:10,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:10,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3d44cb08ea23a1f68b5f HTTP/1.1" 200 None 2026-04-02 10:14:10,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:10,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce266ecb08ea23a1f68074 HTTP/1.1" 200 None 2026-04-02 10:14:10,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:10,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3d44cb08ea23a1f68b5f HTTP/1.1" 200 None 2026-04-02 10:14:10,401 - lava_callback - INFO - Completed processing callback for node 69ce3d44cb08ea23a1f68b5f INFO: 172.21.0.1:33400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46624 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:14:27,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:14:27,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:15:14,535 - lava_callback - INFO - Received callback for node 69cb9ea72a64fa9aff937840 INFO: 172.21.0.1:41860 - "POST /node/69cb9ea72a64fa9aff937840 HTTP/1.0" 202 Accepted 2026-04-02 10:15:14,541 - lava_callback - INFO - Starting async job submit for node 69cb9ea72a64fa9aff937840 2026-04-02 10:15:14,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:15:14,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9ea72a64fa9aff937840 HTTP/1.1" 200 None 2026-04-02 10:15:14,557 - lava_callback - DEBUG - Processing node 69cb9ea72a64fa9aff937840: baseline-arm64-clabbe 2026-04-02 10:15:14,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9ea72a64fa9aff937840 2026-04-02 10:15:14,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:15:14,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9ea72a64fa9aff937840 HTTP/1.1" 200 None 2026-04-02 10:15:14,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:15:14,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63cf0b98d4d3c02067dd7 HTTP/1.1" 200 None 2026-04-02 10:15:14,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:15:14,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9ea72a64fa9aff937840 HTTP/1.1" 200 None 2026-04-02 10:15:14,612 - lava_callback - ERROR - Error processing callback for node 69cb9ea72a64fa9aff937840: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37708 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:15:56,430 - lava_callback - INFO - Received callback for node 69ce41a7cb08ea23a1f68c27 INFO: 172.21.0.1:58456 - "POST /node/69ce41a7cb08ea23a1f68c27 HTTP/1.0" 202 Accepted 2026-04-02 10:15:56,440 - lava_callback - INFO - Starting async job submit for node 69ce41a7cb08ea23a1f68c27 2026-04-02 10:15:56,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:15:56,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce41a7cb08ea23a1f68c27 HTTP/1.1" 200 None 2026-04-02 10:15:56,475 - lava_callback - DEBUG - Processing node 69ce41a7cb08ea23a1f68c27: baseline-arm64 INFO: 172.21.0.1:58460 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:15:58,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:15:58,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:15:58,887 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce41a7cb08ea23a1f68c27/log.txt.gz 2026-04-02 10:16:00,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:16:00,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:16:00,445 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce41a7cb08ea23a1f68c27/lava-logs.yaml 2026-04-02 10:16:00,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:16:00,660 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:16:00,662 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce41a7cb08ea23a1f68c27/lava_callback.json.gz 2026-04-02 10:16:00,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:00,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce41a7cb08ea23a1f68c27 HTTP/1.1" 200 None 2026-04-02 10:16:00,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:00,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:16:00,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:00,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce41a7cb08ea23a1f68c27 HTTP/1.1" 200 None 2026-04-02 10:16:00,728 - lava_callback - INFO - Completed processing callback for node 69ce41a7cb08ea23a1f68c27 INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38770 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:16:27,010 - lava_callback - INFO - Received callback for node 69cb9ef82a64fa9aff937858 INFO: 172.21.0.1:38772 - "POST /node/69cb9ef82a64fa9aff937858 HTTP/1.0" 202 Accepted 2026-04-02 10:16:27,016 - lava_callback - INFO - Starting async job submit for node 69cb9ef82a64fa9aff937858 2026-04-02 10:16:27,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:27,030 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9ef82a64fa9aff937858 HTTP/1.1" 200 None 2026-04-02 10:16:27,031 - lava_callback - DEBUG - Processing node 69cb9ef82a64fa9aff937858: baseline-arm64-baylibre 2026-04-02 10:16:27,031 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9ef82a64fa9aff937858 2026-04-02 10:16:27,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:27,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9ef82a64fa9aff937858 HTTP/1.1" 200 None 2026-04-02 10:16:27,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:27,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:16:27,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:27,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9ef82a64fa9aff937858 HTTP/1.1" 200 None 2026-04-02 10:16:27,104 - lava_callback - ERROR - Error processing callback for node 69cb9ef82a64fa9aff937858: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 10:16:27,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:16:27,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54700 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59596 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:19:47,157 - lava_callback - INFO - Received callback for node 69cb9fba2a64fa9aff937875 INFO: 172.21.0.1:59598 - "POST /node/69cb9fba2a64fa9aff937875 HTTP/1.0" 202 Accepted 2026-04-02 10:19:47,162 - lava_callback - INFO - Starting async job submit for node 69cb9fba2a64fa9aff937875 2026-04-02 10:19:47,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:19:47,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9fba2a64fa9aff937875 HTTP/1.1" 200 None 2026-04-02 10:19:47,188 - lava_callback - DEBUG - Processing node 69cb9fba2a64fa9aff937875: baseline-arm64-baylibre 2026-04-02 10:19:47,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cb9fba2a64fa9aff937875 2026-04-02 10:19:47,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:19:47,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb9fba2a64fa9aff937875 HTTP/1.1" 200 None 2026-04-02 10:19:47,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:19:47,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:19:47,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:19:47,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cb9fba2a64fa9aff937875 HTTP/1.1" 200 None 2026-04-02 10:19:47,239 - lava_callback - ERROR - Error processing callback for node 69cb9fba2a64fa9aff937875: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40968 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:21:23,304 - lava_callback - INFO - Received callback for node 69ce3e7fcb08ea23a1f68b96 INFO: 172.21.0.1:34892 - "POST /node/69ce3e7fcb08ea23a1f68b96 HTTP/1.0" 202 Accepted 2026-04-02 10:21:23,312 - lava_callback - INFO - Starting async job submit for node 69ce3e7fcb08ea23a1f68b96 2026-04-02 10:21:23,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:21:23,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3e7fcb08ea23a1f68b96 HTTP/1.1" 200 None 2026-04-02 10:21:23,371 - lava_callback - DEBUG - Processing node 69ce3e7fcb08ea23a1f68b96: baseline-nfs-arm64 2026-04-02 10:21:24,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:21:24,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:21:24,983 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e7fcb08ea23a1f68b96/log.txt.gz 2026-04-02 10:21:25,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:21:25,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:21:25,914 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e7fcb08ea23a1f68b96/lava-logs.yaml 2026-04-02 10:21:25,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:21:26,118 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:21:26,120 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce3e7fcb08ea23a1f68b96/lava_callback.json.gz DEBUG: Setup failed for 69ce3e7fcb08ea23a1f68b96. Transitting job node result: incomplete -> fail 2026-04-02 10:21:26,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:21:26,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce3e7fcb08ea23a1f68b96 HTTP/1.1" 200 None 2026-04-02 10:21:26,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:21:26,239 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:21:26,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:21:26,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce3e7fcb08ea23a1f68b96 HTTP/1.1" 200 None 2026-04-02 10:21:26,382 - lava_callback - INFO - Completed processing callback for node 69ce3e7fcb08ea23a1f68b96 INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:21:27,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:21:27,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44548 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:23:54,950 - lava_callback - INFO - Received callback for node 69cba0b02a64fa9aff937895 INFO: 172.21.0.1:53038 - "POST /node/69cba0b02a64fa9aff937895 HTTP/1.0" 202 Accepted 2026-04-02 10:23:54,956 - lava_callback - INFO - Starting async job submit for node 69cba0b02a64fa9aff937895 2026-04-02 10:23:54,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:23:54,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba0b02a64fa9aff937895 HTTP/1.1" 200 None 2026-04-02 10:23:54,977 - lava_callback - DEBUG - Processing node 69cba0b02a64fa9aff937895: baseline-arm64-clabbe 2026-04-02 10:23:54,977 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba0b02a64fa9aff937895 2026-04-02 10:23:54,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:23:54,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba0b02a64fa9aff937895 HTTP/1.1" 200 None 2026-04-02 10:23:54,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:23:55,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:23:55,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:23:55,027 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba0b02a64fa9aff937895 HTTP/1.1" 200 None 2026-04-02 10:23:55,028 - lava_callback - ERROR - Error processing callback for node 69cba0b02a64fa9aff937895: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34424 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:25:14,985 - lava_callback - INFO - Received callback for node 69cba0fe2a64fa9aff9378a1 INFO: 172.21.0.1:42822 - "POST /node/69cba0fe2a64fa9aff9378a1 HTTP/1.0" 202 Accepted 2026-04-02 10:25:14,990 - lava_callback - INFO - Starting async job submit for node 69cba0fe2a64fa9aff9378a1 2026-04-02 10:25:14,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:25:15,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba0fe2a64fa9aff9378a1 HTTP/1.1" 200 None 2026-04-02 10:25:15,008 - lava_callback - DEBUG - Processing node 69cba0fe2a64fa9aff9378a1: baseline-arm64-clabbe 2026-04-02 10:25:15,008 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba0fe2a64fa9aff9378a1 2026-04-02 10:25:15,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:25:15,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba0fe2a64fa9aff9378a1 HTTP/1.1" 200 None 2026-04-02 10:25:15,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:25:15,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:25:15,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:25:15,060 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba0fe2a64fa9aff9378a1 HTTP/1.1" 200 None 2026-04-02 10:25:15,062 - lava_callback - ERROR - Error processing callback for node 69cba0fe2a64fa9aff9378a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53324 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:26:35,091 - lava_callback - INFO - Received callback for node 69cba14b2a64fa9aff9378aa INFO: 172.21.0.1:53338 - "POST /node/69cba14b2a64fa9aff9378aa HTTP/1.0" 202 Accepted 2026-04-02 10:26:35,097 - lava_callback - INFO - Starting async job submit for node 69cba14b2a64fa9aff9378aa 2026-04-02 10:26:35,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:26:35,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba14b2a64fa9aff9378aa HTTP/1.1" 200 None 2026-04-02 10:26:35,116 - lava_callback - DEBUG - Processing node 69cba14b2a64fa9aff9378aa: baseline-arm64-clabbe 2026-04-02 10:26:35,116 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba14b2a64fa9aff9378aa 2026-04-02 10:26:35,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:26:35,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba14b2a64fa9aff9378aa HTTP/1.1" 200 None 2026-04-02 10:26:35,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:26:35,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:26:35,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:26:35,174 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba14b2a64fa9aff9378aa HTTP/1.1" 200 None 2026-04-02 10:26:35,175 - lava_callback - ERROR - Error processing callback for node 69cba14b2a64fa9aff9378aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:27:45,894 - lava_callback - INFO - Received callback for node 69ce448ecb08ea23a1f68c87 INFO: 172.21.0.1:59912 - "POST /node/69ce448ecb08ea23a1f68c87 HTTP/1.0" 202 Accepted 2026-04-02 10:27:45,902 - lava_callback - INFO - Starting async job submit for node 69ce448ecb08ea23a1f68c87 2026-04-02 10:27:45,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:45,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce448ecb08ea23a1f68c87 HTTP/1.1" 200 None 2026-04-02 10:27:45,922 - lava_callback - DEBUG - Processing node 69ce448ecb08ea23a1f68c87: baseline-nfs-arm64 2026-04-02 10:27:45,923 - lava_callback - WARNING - Failed to upload log 2026-04-02 10:27:45,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:27:46,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:27:46,088 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce448ecb08ea23a1f68c87/lava-logs.yaml 2026-04-02 10:27:46,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:27:46,246 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:27:46,248 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce448ecb08ea23a1f68c87/lava_callback.json.gz 2026-04-02 10:27:46,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:46,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce448ecb08ea23a1f68c87 HTTP/1.1" 200 None 2026-04-02 10:27:46,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:46,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:27:46,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:46,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce448ecb08ea23a1f68c87 HTTP/1.1" 200 None 2026-04-02 10:27:46,313 - lava_callback - INFO - Completed processing callback for node 69ce448ecb08ea23a1f68c87 INFO: 172.21.0.1:59916 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:27:55,261 - lava_callback - INFO - Received callback for node 69cba19b2a64fa9aff9378b2 INFO: 172.21.0.1:35240 - "POST /node/69cba19b2a64fa9aff9378b2 HTTP/1.0" 202 Accepted 2026-04-02 10:27:55,266 - lava_callback - INFO - Starting async job submit for node 69cba19b2a64fa9aff9378b2 2026-04-02 10:27:55,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:55,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba19b2a64fa9aff9378b2 HTTP/1.1" 200 None 2026-04-02 10:27:55,283 - lava_callback - DEBUG - Processing node 69cba19b2a64fa9aff9378b2: baseline-arm64-clabbe 2026-04-02 10:27:55,283 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba19b2a64fa9aff9378b2 2026-04-02 10:27:55,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:55,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba19b2a64fa9aff9378b2 HTTP/1.1" 200 None 2026-04-02 10:27:55,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:55,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:27:55,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:55,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba19b2a64fa9aff9378b2 HTTP/1.1" 200 None 2026-04-02 10:27:55,354 - lava_callback - ERROR - Error processing callback for node 69cba19b2a64fa9aff9378b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35254 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:27:57,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:27:57,899 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34146 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:30:20,403 - lava_callback - INFO - Received callback for node 69ce43f6cb08ea23a1f68c75 INFO: 172.21.0.1:48298 - "POST /node/69ce43f6cb08ea23a1f68c75 HTTP/1.0" 202 Accepted 2026-04-02 10:30:20,411 - lava_callback - INFO - Starting async job submit for node 69ce43f6cb08ea23a1f68c75 2026-04-02 10:30:20,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:20,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce43f6cb08ea23a1f68c75 HTTP/1.1" 200 None 2026-04-02 10:30:20,462 - lava_callback - DEBUG - Processing node 69ce43f6cb08ea23a1f68c75: baseline-arm64 2026-04-02 10:30:20,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:30:20,996 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:30:20,998 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce43f6cb08ea23a1f68c75/log.txt.gz 2026-04-02 10:30:21,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:30:21,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:30:21,430 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce43f6cb08ea23a1f68c75/lava-logs.yaml 2026-04-02 10:30:21,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:30:21,641 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:30:21,643 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce43f6cb08ea23a1f68c75/lava_callback.json.gz DEBUG: Setup failed for 69ce43f6cb08ea23a1f68c75. Transitting job node result: incomplete -> fail 2026-04-02 10:30:21,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:21,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce43f6cb08ea23a1f68c75 HTTP/1.1" 200 None 2026-04-02 10:30:21,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:21,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:30:21,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:21,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce43f6cb08ea23a1f68c75 HTTP/1.1" 200 None 2026-04-02 10:30:21,888 - lava_callback - INFO - Completed processing callback for node 69ce43f6cb08ea23a1f68c75 INFO: 172.21.0.1:48308 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:30:27,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:27,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42692 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:30:35,209 - lava_callback - INFO - Received callback for node 69cba2352a64fa9aff9378c2 INFO: 172.21.0.1:42700 - "POST /node/69cba2352a64fa9aff9378c2 HTTP/1.0" 202 Accepted 2026-04-02 10:30:35,218 - lava_callback - INFO - Starting async job submit for node 69cba2352a64fa9aff9378c2 2026-04-02 10:30:35,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:35,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba2352a64fa9aff9378c2 HTTP/1.1" 200 None 2026-04-02 10:30:35,242 - lava_callback - DEBUG - Processing node 69cba2352a64fa9aff9378c2: baseline-arm64-clabbe 2026-04-02 10:30:35,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba2352a64fa9aff9378c2 2026-04-02 10:30:35,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:35,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba2352a64fa9aff9378c2 HTTP/1.1" 200 None 2026-04-02 10:30:35,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:35,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:30:35,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:30:35,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba2352a64fa9aff9378c2 HTTP/1.1" 200 None 2026-04-02 10:30:35,327 - lava_callback - ERROR - Error processing callback for node 69cba2352a64fa9aff9378c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44936 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:32:55,606 - lava_callback - INFO - Received callback for node 69cba2d32a64fa9aff9378d7 INFO: 172.21.0.1:53268 - "POST /node/69cba2d32a64fa9aff9378d7 HTTP/1.0" 202 Accepted 2026-04-02 10:32:55,612 - lava_callback - INFO - Starting async job submit for node 69cba2d32a64fa9aff9378d7 2026-04-02 10:32:55,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:32:55,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba2d32a64fa9aff9378d7 HTTP/1.1" 200 None 2026-04-02 10:32:55,628 - lava_callback - DEBUG - Processing node 69cba2d32a64fa9aff9378d7: baseline-arm64-clabbe 2026-04-02 10:32:55,629 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cba2d32a64fa9aff9378d7 2026-04-02 10:32:55,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:32:55,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cba2d32a64fa9aff9378d7 HTTP/1.1" 200 None 2026-04-02 10:32:55,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:32:55,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c399cdbbc022e792643ea0 HTTP/1.1" 200 None 2026-04-02 10:32:55,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:32:55,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cba2d32a64fa9aff9378d7 HTTP/1.1" 200 None 2026-04-02 10:32:55,688 - lava_callback - ERROR - Error processing callback for node 69cba2d32a64fa9aff9378d7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33516 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:33:43,105 - lava_callback - INFO - Received callback for node 69ce45d3cb08ea23a1f68cbc INFO: 172.21.0.1:41638 - "POST /node/69ce45d3cb08ea23a1f68cbc HTTP/1.0" 202 Accepted 2026-04-02 10:33:43,117 - lava_callback - INFO - Starting async job submit for node 69ce45d3cb08ea23a1f68cbc 2026-04-02 10:33:43,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:33:43,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce45d3cb08ea23a1f68cbc HTTP/1.1" 200 None 2026-04-02 10:33:43,178 - lava_callback - DEBUG - Processing node 69ce45d3cb08ea23a1f68cbc: baseline-arm64 2026-04-02 10:33:43,373 - lava_callback - WARNING - Failed to upload log 2026-04-02 10:33:43,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:33:43,625 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:33:43,627 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce45d3cb08ea23a1f68cbc/lava-logs.yaml 2026-04-02 10:33:43,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:33:43,751 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:33:43,753 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce45d3cb08ea23a1f68cbc/lava_callback.json.gz 2026-04-02 10:33:43,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:33:43,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce45d3cb08ea23a1f68cbc HTTP/1.1" 200 None 2026-04-02 10:33:43,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:33:43,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:33:43,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:33:43,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce45d3cb08ea23a1f68cbc HTTP/1.1" 200 None 2026-04-02 10:33:43,903 - lava_callback - INFO - Completed processing callback for node 69ce45d3cb08ea23a1f68cbc INFO: 172.21.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44064 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:33:57,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:33:57,940 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35152 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55692 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:36:12,857 - lava_callback - INFO - Received callback for node 69ce4669cb08ea23a1f68ccf INFO: 172.21.0.1:33822 - "POST /node/69ce4669cb08ea23a1f68ccf HTTP/1.0" 202 Accepted 2026-04-02 10:36:12,863 - lava_callback - INFO - Starting async job submit for node 69ce4669cb08ea23a1f68ccf 2026-04-02 10:36:12,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:36:12,907 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4669cb08ea23a1f68ccf HTTP/1.1" 200 None 2026-04-02 10:36:12,908 - lava_callback - DEBUG - Processing node 69ce4669cb08ea23a1f68ccf: baseline-arm64 2026-04-02 10:36:13,044 - lava_callback - WARNING - Failed to upload log 2026-04-02 10:36:13,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:36:13,321 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:36:13,323 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4669cb08ea23a1f68ccf/lava-logs.yaml 2026-04-02 10:36:13,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:36:13,633 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:36:13,635 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4669cb08ea23a1f68ccf/lava_callback.json.gz 2026-04-02 10:36:13,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:36:13,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4669cb08ea23a1f68ccf HTTP/1.1" 200 None 2026-04-02 10:36:13,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:36:13,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:36:13,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:36:13,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4669cb08ea23a1f68ccf HTTP/1.1" 200 None 2026-04-02 10:36:13,782 - lava_callback - INFO - Completed processing callback for node 69ce4669cb08ea23a1f68ccf INFO: 172.21.0.1:33836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39572 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:36:27,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:36:27,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47548 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:41:12,224 - lava_callback - INFO - Received callback for node 69ce4544cb08ea23a1f68caa INFO: 172.21.0.1:38292 - "POST /node/69ce4544cb08ea23a1f68caa HTTP/1.0" 202 Accepted 2026-04-02 10:41:12,230 - lava_callback - INFO - Starting async job submit for node 69ce4544cb08ea23a1f68caa 2026-04-02 10:41:12,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:41:12,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4544cb08ea23a1f68caa HTTP/1.1" 200 None 2026-04-02 10:41:12,291 - lava_callback - DEBUG - Processing node 69ce4544cb08ea23a1f68caa: baseline-arm64 2026-04-02 10:41:12,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:41:12,962 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:41:12,964 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4544cb08ea23a1f68caa/log.txt.gz 2026-04-02 10:41:13,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:41:13,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:41:13,594 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4544cb08ea23a1f68caa/lava-logs.yaml 2026-04-02 10:41:13,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:41:14,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:41:14,041 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4544cb08ea23a1f68caa/lava_callback.json.gz 2026-04-02 10:41:14,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:41:14,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4544cb08ea23a1f68caa HTTP/1.1" 200 None 2026-04-02 10:41:14,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:41:14,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:41:14,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:41:14,116 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4544cb08ea23a1f68caa HTTP/1.1" 200 None 2026-04-02 10:41:14,171 - lava_callback - INFO - Completed processing callback for node 69ce4544cb08ea23a1f68caa INFO: 172.21.0.1:38296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:41:27,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:41:27,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:42:32,928 - lava_callback - INFO - Received callback for node 69ce4592cb08ea23a1f68cb6 INFO: 172.21.0.1:56822 - "POST /node/69ce4592cb08ea23a1f68cb6 HTTP/1.0" 202 Accepted 2026-04-02 10:42:32,936 - lava_callback - INFO - Starting async job submit for node 69ce4592cb08ea23a1f68cb6 2026-04-02 10:42:32,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:42:32,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4592cb08ea23a1f68cb6 HTTP/1.1" 200 None 2026-04-02 10:42:32,998 - lava_callback - DEBUG - Processing node 69ce4592cb08ea23a1f68cb6: baseline-nfs-arm64 2026-04-02 10:42:33,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:42:33,896 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:42:33,898 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4592cb08ea23a1f68cb6/log.txt.gz 2026-04-02 10:42:34,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:42:34,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:42:34,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4592cb08ea23a1f68cb6/lava-logs.yaml 2026-04-02 10:42:34,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:42:34,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:42:34,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4592cb08ea23a1f68cb6/lava_callback.json.gz 2026-04-02 10:42:34,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:42:34,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4592cb08ea23a1f68cb6 HTTP/1.1" 200 None 2026-04-02 10:42:34,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:42:34,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:42:34,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:42:34,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4592cb08ea23a1f68cb6 HTTP/1.1" 200 None 2026-04-02 10:42:34,710 - lava_callback - INFO - Completed processing callback for node 69ce4592cb08ea23a1f68cb6 INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36888 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:42:57,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:42:58,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34680 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:47:34,768 - lava_callback - INFO - Received callback for node 69ce4773cb08ea23a1f68cfa INFO: 172.21.0.1:34682 - "POST /node/69ce4773cb08ea23a1f68cfa HTTP/1.0" 202 Accepted 2026-04-02 10:47:34,780 - lava_callback - INFO - Starting async job submit for node 69ce4773cb08ea23a1f68cfa 2026-04-02 10:47:34,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:47:34,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4773cb08ea23a1f68cfa HTTP/1.1" 200 None 2026-04-02 10:47:34,842 - lava_callback - DEBUG - Processing node 69ce4773cb08ea23a1f68cfa: baseline-arm64 2026-04-02 10:47:35,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:47:35,442 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:47:35,444 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4773cb08ea23a1f68cfa/log.txt.gz 2026-04-02 10:47:35,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:47:35,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:47:35,901 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4773cb08ea23a1f68cfa/lava-logs.yaml 2026-04-02 10:47:35,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:47:36,058 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:47:36,060 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce4773cb08ea23a1f68cfa/lava_callback.json.gz DEBUG: Setup failed for 69ce4773cb08ea23a1f68cfa. Transitting job node result: incomplete -> fail 2026-04-02 10:47:36,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:47:36,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4773cb08ea23a1f68cfa HTTP/1.1" 200 None 2026-04-02 10:47:36,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:47:36,183 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:47:36,185 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:47:36,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4773cb08ea23a1f68cfa HTTP/1.1" 200 None 2026-04-02 10:47:36,300 - lava_callback - INFO - Completed processing callback for node 69ce4773cb08ea23a1f68cfa INFO: 172.21.0.1:34684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51164 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:47:58,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:47:58,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:48:08,599 - lava_callback - INFO - Received callback for node 69ce44dacb08ea23a1f68c98 INFO: 172.21.0.1:55760 - "POST /node/69ce44dacb08ea23a1f68c98 HTTP/1.0" 202 Accepted 2026-04-02 10:48:08,645 - lava_callback - INFO - Starting async job submit for node 69ce44dacb08ea23a1f68c98 2026-04-02 10:48:08,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:48:08,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce44dacb08ea23a1f68c98 HTTP/1.1" 200 None 2026-04-02 10:48:08,685 - lava_callback - DEBUG - Processing node 69ce44dacb08ea23a1f68c98: baseline-arm-pengutronix 2026-04-02 10:48:08,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:48:08,917 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:48:08,919 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce44dacb08ea23a1f68c98/log.txt.gz 2026-04-02 10:48:08,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:48:09,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:48:09,139 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce44dacb08ea23a1f68c98/lava-logs.yaml 2026-04-02 10:48:09,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:48:09,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:48:09,270 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce44dacb08ea23a1f68c98/lava_callback.json.gz DEBUG: Setup failed for 69ce44dacb08ea23a1f68c98. Transitting job node result: incomplete -> fail 2026-04-02 10:48:09,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:48:09,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce44dacb08ea23a1f68c98 HTTP/1.1" 200 None 2026-04-02 10:48:09,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:48:09,355 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 10:48:09,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:48:09,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce44dacb08ea23a1f68c98 HTTP/1.1" 200 None 2026-04-02 10:48:09,439 - lava_callback - INFO - Completed processing callback for node 69ce44dacb08ea23a1f68c98 INFO: 172.21.0.1:59840 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52764 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:48:28,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:48:28,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43848 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:51:25,229 - lava_callback - INFO - Received callback for node 69ce47cfcb08ea23a1f68d04 INFO: 172.21.0.1:45108 - "POST /node/69ce47cfcb08ea23a1f68d04 HTTP/1.0" 202 Accepted 2026-04-02 10:51:25,235 - lava_callback - INFO - Starting async job submit for node 69ce47cfcb08ea23a1f68d04 2026-04-02 10:51:25,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:51:25,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce47cfcb08ea23a1f68d04 HTTP/1.1" 200 None 2026-04-02 10:51:25,312 - lava_callback - DEBUG - Processing node 69ce47cfcb08ea23a1f68d04: baseline-arm64 2026-04-02 10:51:25,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:51:26,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:51:26,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce47cfcb08ea23a1f68d04/log.txt.gz 2026-04-02 10:51:26,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:45120 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:51:26,768 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:51:26,770 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce47cfcb08ea23a1f68d04/lava-logs.yaml 2026-04-02 10:51:26,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:51:26,964 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:51:26,966 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69ce47cfcb08ea23a1f68d04/lava_callback.json.gz 2026-04-02 10:51:26,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:51:27,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce47cfcb08ea23a1f68d04 HTTP/1.1" 200 None 2026-04-02 10:51:27,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:51:27,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:51:27,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:51:27,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce47cfcb08ea23a1f68d04 HTTP/1.1" 200 None 2026-04-02 10:51:27,089 - lava_callback - INFO - Completed processing callback for node 69ce47cfcb08ea23a1f68d04 2026-04-02 10:51:28,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:51:28,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50170 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51638 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:53:09,512 - lava_callback - INFO - Received callback for node 69ce46b4cb08ea23a1f68cd8 INFO: 172.21.0.1:51640 - "POST /node/69ce46b4cb08ea23a1f68cd8 HTTP/1.0" 202 Accepted 2026-04-02 10:53:09,518 - lava_callback - INFO - Starting async job submit for node 69ce46b4cb08ea23a1f68cd8 2026-04-02 10:53:09,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:53:09,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce46b4cb08ea23a1f68cd8 HTTP/1.1" 200 None 2026-04-02 10:53:09,596 - lava_callback - DEBUG - Processing node 69ce46b4cb08ea23a1f68cd8: baseline-arm 2026-04-02 10:53:10,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:53:10,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:53:10,517 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69ce46b4cb08ea23a1f68cd8/log.txt.gz 2026-04-02 10:53:10,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:53:11,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:53:11,158 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69ce46b4cb08ea23a1f68cd8/lava-logs.yaml 2026-04-02 10:53:11,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:53:11,325 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:53:11,327 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69ce46b4cb08ea23a1f68cd8/lava_callback.json.gz DEBUG: Setup failed for 69ce46b4cb08ea23a1f68cd8. Transitting job node result: incomplete -> fail 2026-04-02 10:53:11,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:53:11,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce46b4cb08ea23a1f68cd8 HTTP/1.1" 200 None 2026-04-02 10:53:11,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:53:11,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 10:53:11,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:53:11,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce46b4cb08ea23a1f68cd8 HTTP/1.1" 200 None 2026-04-02 10:53:11,636 - lava_callback - INFO - Completed processing callback for node 69ce46b4cb08ea23a1f68cd8 INFO: 172.21.0.1:42252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60434 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:53:28,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:53:28,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48842 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:54:01,392 - lava_callback - INFO - Received callback for node 69ce4824cb08ea23a1f68d11 INFO: 172.21.0.1:55258 - "POST /node/69ce4824cb08ea23a1f68d11 HTTP/1.0" 202 Accepted 2026-04-02 10:54:01,399 - lava_callback - INFO - Starting async job submit for node 69ce4824cb08ea23a1f68d11 2026-04-02 10:54:01,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:01,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4824cb08ea23a1f68d11 HTTP/1.1" 200 None 2026-04-02 10:54:01,443 - lava_callback - DEBUG - Processing node 69ce4824cb08ea23a1f68d11: baseline-nfs-arm64 2026-04-02 10:54:02,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:02,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:02,470 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4824cb08ea23a1f68d11/log.txt.gz 2026-04-02 10:54:02,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:02,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:02,950 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4824cb08ea23a1f68d11/lava-logs.yaml 2026-04-02 10:54:02,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:03,138 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:03,140 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4824cb08ea23a1f68d11/lava_callback.json.gz 2026-04-02 10:54:03,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:03,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4824cb08ea23a1f68d11 HTTP/1.1" 200 None 2026-04-02 10:54:03,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:03,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:54:03,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:03,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4824cb08ea23a1f68d11 HTTP/1.1" 200 None 2026-04-02 10:54:03,270 - lava_callback - INFO - Completed processing callback for node 69ce4824cb08ea23a1f68d11 INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40896 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42042 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:54:28,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:28,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54972 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:54:49,566 - lava_callback - INFO - Received callback for node 69ce46d7cb08ea23a1f68ce5 INFO: 172.21.0.1:54984 - "POST /node/69ce46d7cb08ea23a1f68ce5 HTTP/1.0" 202 Accepted 2026-04-02 10:54:49,572 - lava_callback - INFO - Starting async job submit for node 69ce46d7cb08ea23a1f68ce5 2026-04-02 10:54:49,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:49,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce46d7cb08ea23a1f68ce5 HTTP/1.1" 200 None 2026-04-02 10:54:49,652 - lava_callback - DEBUG - Processing node 69ce46d7cb08ea23a1f68ce5: ltp-smoke 2026-04-02 10:54:50,282 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:50,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:50,443 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce46d7cb08ea23a1f68ce5/log.txt.gz 2026-04-02 10:54:50,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:51,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:51,010 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce46d7cb08ea23a1f68ce5/lava-logs.yaml 2026-04-02 10:54:51,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:54:51,186 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:54:51,188 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69ce46d7cb08ea23a1f68ce5/lava_callback.json.gz 2026-04-02 10:54:51,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:51,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce46d7cb08ea23a1f68ce5 HTTP/1.1" 200 None 2026-04-02 10:54:51,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:51,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce266ecb08ea23a1f68074 HTTP/1.1" 200 None 2026-04-02 10:54:51,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:51,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce46d7cb08ea23a1f68ce5 HTTP/1.1" 200 None 2026-04-02 10:54:51,506 - lava_callback - INFO - Completed processing callback for node 69ce46d7cb08ea23a1f68ce5 INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:54:58,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:54:58,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60956 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39330 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:58:25,341 - lava_callback - INFO - Received callback for node 69ce472bcb08ea23a1f68cf0 INFO: 172.21.0.1:42314 - "POST /node/69ce472bcb08ea23a1f68cf0 HTTP/1.0" 202 Accepted 2026-04-02 10:58:25,349 - lava_callback - INFO - Starting async job submit for node 69ce472bcb08ea23a1f68cf0 2026-04-02 10:58:25,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:58:25,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce472bcb08ea23a1f68cf0 HTTP/1.1" 200 None 2026-04-02 10:58:25,408 - lava_callback - DEBUG - Processing node 69ce472bcb08ea23a1f68cf0: baseline-nfs-arm64 2026-04-02 10:58:26,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:42330 - "GET / HTTP/1.0" 200 OK 2026-04-02 10:58:26,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:58:26,646 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce472bcb08ea23a1f68cf0/log.txt.gz 2026-04-02 10:58:27,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:58:27,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:58:27,612 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce472bcb08ea23a1f68cf0/lava-logs.yaml 2026-04-02 10:58:27,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 10:58:27,840 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 10:58:27,842 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce472bcb08ea23a1f68cf0/lava_callback.json.gz DEBUG: Setup failed for 69ce472bcb08ea23a1f68cf0. Transitting job node result: incomplete -> fail 2026-04-02 10:58:27,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:58:27,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce472bcb08ea23a1f68cf0 HTTP/1.1" 200 None 2026-04-02 10:58:27,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:58:27,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 10:58:27,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:58:28,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce472bcb08ea23a1f68cf0 HTTP/1.1" 200 None 2026-04-02 10:58:28,108 - lava_callback - INFO - Completed processing callback for node 69ce472bcb08ea23a1f68cf0 2026-04-02 10:58:28,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 10:58:28,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37794 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:04:50,139 - lava_callback - INFO - Received callback for node 69cbaa3f2a64fa9aff937994 INFO: 172.21.0.1:47136 - "POST /node/69cbaa3f2a64fa9aff937994 HTTP/1.0" 202 Accepted 2026-04-02 11:04:50,145 - lava_callback - INFO - Starting async job submit for node 69cbaa3f2a64fa9aff937994 2026-04-02 11:04:50,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:04:50,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaa3f2a64fa9aff937994 HTTP/1.1" 200 None 2026-04-02 11:04:50,161 - lava_callback - DEBUG - Processing node 69cbaa3f2a64fa9aff937994: baseline-arm-baylibre 2026-04-02 11:04:50,161 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbaa3f2a64fa9aff937994 2026-04-02 11:04:50,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:04:50,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaa3f2a64fa9aff937994 HTTP/1.1" 200 None 2026-04-02 11:04:50,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:04:50,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:04:50,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:04:50,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbaa3f2a64fa9aff937994 HTTP/1.1" 200 None 2026-04-02 11:04:50,217 - lava_callback - ERROR - Error processing callback for node 69cbaa3f2a64fa9aff937994: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33308 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:06:49,660 - lava_callback - INFO - Received callback for node 69cbaab72a64fa9aff9379a4 INFO: 172.21.0.1:33318 - "POST /node/69cbaab72a64fa9aff9379a4 HTTP/1.0" 202 Accepted 2026-04-02 11:06:49,665 - lava_callback - INFO - Starting async job submit for node 69cbaab72a64fa9aff9379a4 2026-04-02 11:06:49,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:06:49,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaab72a64fa9aff9379a4 HTTP/1.1" 200 None 2026-04-02 11:06:49,692 - lava_callback - DEBUG - Processing node 69cbaab72a64fa9aff9379a4: baseline-arm-baylibre 2026-04-02 11:06:49,692 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbaab72a64fa9aff9379a4 2026-04-02 11:06:49,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:06:49,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaab72a64fa9aff9379a4 HTTP/1.1" 200 None 2026-04-02 11:06:49,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:06:49,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:06:49,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:06:49,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbaab72a64fa9aff9379a4 HTTP/1.1" 200 None 2026-04-02 11:06:49,755 - lava_callback - ERROR - Error processing callback for node 69cbaab72a64fa9aff9379a4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42908 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:07:29,617 - lava_callback - INFO - Received callback for node 69cbaade2a64fa9aff9379af INFO: 172.21.0.1:42924 - "POST /node/69cbaade2a64fa9aff9379af HTTP/1.0" 202 Accepted 2026-04-02 11:07:29,622 - lava_callback - INFO - Starting async job submit for node 69cbaade2a64fa9aff9379af 2026-04-02 11:07:29,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:29,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaade2a64fa9aff9379af HTTP/1.1" 200 None 2026-04-02 11:07:29,656 - lava_callback - DEBUG - Processing node 69cbaade2a64fa9aff9379af: baseline-arm-baylibre 2026-04-02 11:07:29,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbaade2a64fa9aff9379af 2026-04-02 11:07:29,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:29,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbaade2a64fa9aff9379af HTTP/1.1" 200 None 2026-04-02 11:07:29,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:29,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:07:29,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:29,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbaade2a64fa9aff9379af HTTP/1.1" 200 None 2026-04-02 11:07:29,722 - lava_callback - ERROR - Error processing callback for node 69cbaade2a64fa9aff9379af: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47776 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:07:49,645 - lava_callback - INFO - Received callback for node 69ce4976cb08ea23a1f68d23 2026-04-02 11:07:49,648 - lava_callback - INFO - Received callback for node 69cbab022a64fa9aff9379be INFO: 172.21.0.1:47792 - "POST /node/69cbab022a64fa9aff9379be HTTP/1.0" 202 Accepted 2026-04-02 11:07:49,653 - lava_callback - INFO - Starting async job submit for node 69cbab022a64fa9aff9379be 2026-04-02 11:07:49,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:49,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab022a64fa9aff9379be HTTP/1.1" 200 None 2026-04-02 11:07:49,670 - lava_callback - DEBUG - Processing node 69cbab022a64fa9aff9379be: baseline-arm-baylibre 2026-04-02 11:07:49,670 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbab022a64fa9aff9379be 2026-04-02 11:07:49,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:49,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab022a64fa9aff9379be HTTP/1.1" 200 None 2026-04-02 11:07:49,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:49,697 - lava_callback - INFO - Starting async job submit for node 69ce4976cb08ea23a1f68d23 INFO: 172.21.0.1:47790 - "POST /node/69ce4976cb08ea23a1f68d23 HTTP/1.0" 202 Accepted 2026-04-02 11:07:49,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:49,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:07:49,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:49,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4976cb08ea23a1f68d23 HTTP/1.1" 200 None 2026-04-02 11:07:49,740 - lava_callback - DEBUG - Processing node 69ce4976cb08ea23a1f68d23: baseline-arm-pengutronix 2026-04-02 11:07:49,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbab022a64fa9aff9379be HTTP/1.1" 200 None 2026-04-02 11:07:49,829 - lava_callback - ERROR - Error processing callback for node 69cbab022a64fa9aff9379be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 11:07:49,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:07:50,084 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:07:50,086 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce4976cb08ea23a1f68d23/log.txt.gz 2026-04-02 11:07:50,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:07:50,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:07:50,334 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce4976cb08ea23a1f68d23/lava-logs.yaml 2026-04-02 11:07:50,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:07:50,634 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:07:50,635 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69ce4976cb08ea23a1f68d23/lava_callback.json.gz DEBUG: Setup failed for 69ce4976cb08ea23a1f68d23. Transitting job node result: incomplete -> fail 2026-04-02 11:07:50,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:50,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4976cb08ea23a1f68d23 HTTP/1.1" 200 None 2026-04-02 11:07:50,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:50,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2669cb08ea23a1f6806e HTTP/1.1" 200 None 2026-04-02 11:07:50,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:50,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4976cb08ea23a1f68d23 HTTP/1.1" 200 None 2026-04-02 11:07:50,786 - lava_callback - INFO - Completed processing callback for node 69ce4976cb08ea23a1f68d23 INFO: 172.21.0.1:48692 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:07:58,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:07:58,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43236 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:08:29,754 - lava_callback - INFO - Received callback for node 69cbab272a64fa9aff9379c9 INFO: 172.21.0.1:35818 - "POST /node/69cbab272a64fa9aff9379c9 HTTP/1.0" 202 Accepted 2026-04-02 11:08:29,760 - lava_callback - INFO - Starting async job submit for node 69cbab272a64fa9aff9379c9 2026-04-02 11:08:29,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:08:29,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab272a64fa9aff9379c9 HTTP/1.1" 200 None 2026-04-02 11:08:29,776 - lava_callback - DEBUG - Processing node 69cbab272a64fa9aff9379c9: baseline-arm-baylibre 2026-04-02 11:08:29,776 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbab272a64fa9aff9379c9 2026-04-02 11:08:29,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:08:29,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab272a64fa9aff9379c9 HTTP/1.1" 200 None 2026-04-02 11:08:29,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:08:29,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:08:29,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:08:29,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbab272a64fa9aff9379c9 HTTP/1.1" 200 None 2026-04-02 11:08:29,840 - lava_callback - ERROR - Error processing callback for node 69cbab272a64fa9aff9379c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34742 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:09:49,898 - lava_callback - INFO - Received callback for node 69cbab6e2a64fa9aff9379da INFO: 172.21.0.1:36196 - "POST /node/69cbab6e2a64fa9aff9379da HTTP/1.0" 202 Accepted 2026-04-02 11:09:49,906 - lava_callback - INFO - Starting async job submit for node 69cbab6e2a64fa9aff9379da 2026-04-02 11:09:49,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:09:49,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab6e2a64fa9aff9379da HTTP/1.1" 200 None 2026-04-02 11:09:49,923 - lava_callback - DEBUG - Processing node 69cbab6e2a64fa9aff9379da: baseline-arm-baylibre 2026-04-02 11:09:49,923 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbab6e2a64fa9aff9379da 2026-04-02 11:09:49,924 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:09:49,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbab6e2a64fa9aff9379da HTTP/1.1" 200 None 2026-04-02 11:09:49,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:09:49,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:09:49,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:09:49,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbab6e2a64fa9aff9379da HTTP/1.1" 200 None 2026-04-02 11:09:49,980 - lava_callback - ERROR - Error processing callback for node 69cbab6e2a64fa9aff9379da: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51214 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40560 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:14:57,206 - lava_callback - INFO - Received callback for node 69cbacaa2a64fa9aff937a08 INFO: 172.21.0.1:40564 - "POST /node/69cbacaa2a64fa9aff937a08 HTTP/1.0" 202 Accepted 2026-04-02 11:14:57,215 - lava_callback - INFO - Starting async job submit for node 69cbacaa2a64fa9aff937a08 2026-04-02 11:14:57,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:14:57,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbacaa2a64fa9aff937a08 HTTP/1.1" 200 None 2026-04-02 11:14:57,232 - lava_callback - DEBUG - Processing node 69cbacaa2a64fa9aff937a08: baseline-arm-clabbe 2026-04-02 11:14:57,232 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbacaa2a64fa9aff937a08 2026-04-02 11:14:57,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:14:57,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbacaa2a64fa9aff937a08 HTTP/1.1" 200 None 2026-04-02 11:14:57,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:14:57,262 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:14:57,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:14:57,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbacaa2a64fa9aff937a08 HTTP/1.1" 200 None 2026-04-02 11:14:57,286 - lava_callback - ERROR - Error processing callback for node 69cbacaa2a64fa9aff937a08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59912 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:16:57,283 - lava_callback - INFO - Received callback for node 69cbad162a64fa9aff937a17 INFO: 172.21.0.1:59918 - "POST /node/69cbad162a64fa9aff937a17 HTTP/1.0" 202 Accepted 2026-04-02 11:16:57,289 - lava_callback - INFO - Starting async job submit for node 69cbad162a64fa9aff937a17 2026-04-02 11:16:57,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:16:57,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad162a64fa9aff937a17 HTTP/1.1" 200 None 2026-04-02 11:16:57,306 - lava_callback - DEBUG - Processing node 69cbad162a64fa9aff937a17: baseline-arm-clabbe 2026-04-02 11:16:57,307 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbad162a64fa9aff937a17 2026-04-02 11:16:57,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:16:57,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad162a64fa9aff937a17 HTTP/1.1" 200 None 2026-04-02 11:16:57,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:16:57,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:16:57,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:16:57,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbad162a64fa9aff937a17 HTTP/1.1" 200 None 2026-04-02 11:16:57,368 - lava_callback - ERROR - Error processing callback for node 69cbad162a64fa9aff937a17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46740 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:17:37,261 - lava_callback - INFO - Received callback for node 69cbad3c2a64fa9aff937a22 INFO: 172.21.0.1:46744 - "POST /node/69cbad3c2a64fa9aff937a22 HTTP/1.0" 202 Accepted 2026-04-02 11:17:37,266 - lava_callback - INFO - Starting async job submit for node 69cbad3c2a64fa9aff937a22 2026-04-02 11:17:37,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:17:37,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad3c2a64fa9aff937a22 HTTP/1.1" 200 None 2026-04-02 11:17:37,282 - lava_callback - DEBUG - Processing node 69cbad3c2a64fa9aff937a22: baseline-arm-clabbe 2026-04-02 11:17:37,282 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbad3c2a64fa9aff937a22 2026-04-02 11:17:37,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:17:37,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad3c2a64fa9aff937a22 HTTP/1.1" 200 None 2026-04-02 11:17:37,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:17:37,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:17:37,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:17:37,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbad3c2a64fa9aff937a22 HTTP/1.1" 200 None 2026-04-02 11:17:37,346 - lava_callback - ERROR - Error processing callback for node 69cbad3c2a64fa9aff937a22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46216 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:18:31,474 - lava_callback - INFO - Received callback for node 69ce4bdccb08ea23a1f68d46 INFO: 172.21.0.1:42886 - "POST /node/69ce4bdccb08ea23a1f68d46 HTTP/1.0" 202 Accepted 2026-04-02 11:18:31,484 - lava_callback - INFO - Starting async job submit for node 69ce4bdccb08ea23a1f68d46 2026-04-02 11:18:31,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:31,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4bdccb08ea23a1f68d46 HTTP/1.1" 200 None 2026-04-02 11:18:31,569 - lava_callback - DEBUG - Processing node 69ce4bdccb08ea23a1f68d46: baseline-nfs-arm64 INFO: 172.21.0.1:42898 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:18:32,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:18:32,960 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:18:32,962 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4bdccb08ea23a1f68d46/log.txt.gz 2026-04-02 11:18:33,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:18:33,802 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:18:33,805 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4bdccb08ea23a1f68d46/lava-logs.yaml 2026-04-02 11:18:33,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 11:18:34,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 11:18:34,118 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69ce4bdccb08ea23a1f68d46/lava_callback.json.gz DEBUG: Setup failed for 69ce4bdccb08ea23a1f68d46. Transitting job node result: incomplete -> fail 2026-04-02 11:18:34,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:34,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce4bdccb08ea23a1f68d46 HTTP/1.1" 200 None 2026-04-02 11:18:34,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:34,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2677cb08ea23a1f6807d HTTP/1.1" 200 None 2026-04-02 11:18:34,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:34,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce4bdccb08ea23a1f68d46 HTTP/1.1" 200 None 2026-04-02 11:18:34,388 - lava_callback - INFO - Completed processing callback for node 69ce4bdccb08ea23a1f68d46 INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33392 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:18:57,362 - lava_callback - INFO - Received callback for node 69cbad8d2a64fa9aff937a31 INFO: 172.21.0.1:33404 - "POST /node/69cbad8d2a64fa9aff937a31 HTTP/1.0" 202 Accepted 2026-04-02 11:18:57,371 - lava_callback - INFO - Starting async job submit for node 69cbad8d2a64fa9aff937a31 2026-04-02 11:18:57,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:57,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad8d2a64fa9aff937a31 HTTP/1.1" 200 None 2026-04-02 11:18:57,389 - lava_callback - DEBUG - Processing node 69cbad8d2a64fa9aff937a31: baseline-arm-clabbe 2026-04-02 11:18:57,389 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbad8d2a64fa9aff937a31 2026-04-02 11:18:57,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:57,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbad8d2a64fa9aff937a31 HTTP/1.1" 200 None 2026-04-02 11:18:57,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:57,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:18:57,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:57,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbad8d2a64fa9aff937a31 HTTP/1.1" 200 None 2026-04-02 11:18:57,453 - lava_callback - ERROR - Error processing callback for node 69cbad8d2a64fa9aff937a31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-04-02 11:18:58,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:18:58,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:46070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36364 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:20:57,452 - lava_callback - INFO - Received callback for node 69cbae062a64fa9aff937a41 INFO: 172.21.0.1:36366 - "POST /node/69cbae062a64fa9aff937a41 HTTP/1.0" 202 Accepted 2026-04-02 11:20:57,458 - lava_callback - INFO - Starting async job submit for node 69cbae062a64fa9aff937a41 2026-04-02 11:20:57,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:20:57,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbae062a64fa9aff937a41 HTTP/1.1" 200 None 2026-04-02 11:20:57,475 - lava_callback - DEBUG - Processing node 69cbae062a64fa9aff937a41: baseline-arm-clabbe 2026-04-02 11:20:57,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbae062a64fa9aff937a41 2026-04-02 11:20:57,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:20:57,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbae062a64fa9aff937a41 HTTP/1.1" 200 None 2026-04-02 11:20:57,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:20:57,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa2484b5e3e0ab6a60b57 HTTP/1.1" 200 None 2026-04-02 11:20:57,512 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:20:57,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbae062a64fa9aff937a41 HTTP/1.1" 200 None 2026-04-02 11:20:57,540 - lava_callback - ERROR - Error processing callback for node 69cbae062a64fa9aff937a41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40132 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39046 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41604 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:41606 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:41618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33102 - "GET /login HTTP/1.0" 404 Not Found INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55730 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32904 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:54:52,318 - lava_callback - INFO - Received callback for node 69cbb6062a64fa9aff937ab7 INFO: 172.21.0.1:38326 - "POST /node/69cbb6062a64fa9aff937ab7 HTTP/1.0" 202 Accepted 2026-04-02 11:54:52,324 - lava_callback - INFO - Starting async job submit for node 69cbb6062a64fa9aff937ab7 2026-04-02 11:54:52,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:54:52,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb6062a64fa9aff937ab7 HTTP/1.1" 200 None 2026-04-02 11:54:52,341 - lava_callback - DEBUG - Processing node 69cbb6062a64fa9aff937ab7: baseline-arm64-baylibre 2026-04-02 11:54:52,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb6062a64fa9aff937ab7 2026-04-02 11:54:52,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:54:52,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb6062a64fa9aff937ab7 HTTP/1.1" 200 None 2026-04-02 11:54:52,357 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:54:52,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 11:54:52,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:54:52,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb6062a64fa9aff937ab7 HTTP/1.1" 200 None 2026-04-02 11:54:52,398 - lava_callback - ERROR - Error processing callback for node 69cbb6062a64fa9aff937ab7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44700 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:56:52,439 - lava_callback - INFO - Received callback for node 69cbb6812a64fa9aff937ac4 INFO: 172.21.0.1:59218 - "POST /node/69cbb6812a64fa9aff937ac4 HTTP/1.0" 202 Accepted 2026-04-02 11:56:52,445 - lava_callback - INFO - Starting async job submit for node 69cbb6812a64fa9aff937ac4 2026-04-02 11:56:52,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:56:52,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb6812a64fa9aff937ac4 HTTP/1.1" 200 None 2026-04-02 11:56:52,461 - lava_callback - DEBUG - Processing node 69cbb6812a64fa9aff937ac4: baseline-arm64-baylibre 2026-04-02 11:56:52,461 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb6812a64fa9aff937ac4 2026-04-02 11:56:52,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:56:52,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb6812a64fa9aff937ac4 HTTP/1.1" 200 None 2026-04-02 11:56:52,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:56:52,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 11:56:52,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:56:52,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb6812a64fa9aff937ac4 HTTP/1.1" 200 None 2026-04-02 11:56:52,512 - lava_callback - ERROR - Error processing callback for node 69cbb6812a64fa9aff937ac4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48318 - "GET / HTTP/1.0" 200 OK 2026-04-02 11:59:52,545 - lava_callback - INFO - Received callback for node 69cbb7352a64fa9aff937ad1 INFO: 172.21.0.1:56232 - "POST /node/69cbb7352a64fa9aff937ad1 HTTP/1.0" 202 Accepted 2026-04-02 11:59:52,551 - lava_callback - INFO - Starting async job submit for node 69cbb7352a64fa9aff937ad1 2026-04-02 11:59:52,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:59:52,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb7352a64fa9aff937ad1 HTTP/1.1" 200 None 2026-04-02 11:59:52,571 - lava_callback - DEBUG - Processing node 69cbb7352a64fa9aff937ad1: baseline-arm64-baylibre 2026-04-02 11:59:52,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb7352a64fa9aff937ad1 2026-04-02 11:59:52,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:59:52,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb7352a64fa9aff937ad1 HTTP/1.1" 200 None 2026-04-02 11:59:52,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:59:52,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 11:59:52,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 11:59:52,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb7352a64fa9aff937ad1 HTTP/1.1" 200 None 2026-04-02 11:59:52,630 - lava_callback - ERROR - Error processing callback for node 69cbb7352a64fa9aff937ad1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41150 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:02:59,262 - lava_callback - INFO - Received callback for node 69cbb7ef2a64fa9aff937ae8 INFO: 172.21.0.1:41156 - "POST /node/69cbb7ef2a64fa9aff937ae8 HTTP/1.0" 202 Accepted 2026-04-02 12:02:59,267 - lava_callback - INFO - Starting async job submit for node 69cbb7ef2a64fa9aff937ae8 2026-04-02 12:02:59,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:02:59,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb7ef2a64fa9aff937ae8 HTTP/1.1" 200 None 2026-04-02 12:02:59,289 - lava_callback - DEBUG - Processing node 69cbb7ef2a64fa9aff937ae8: baseline-arm64-clabbe 2026-04-02 12:02:59,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb7ef2a64fa9aff937ae8 2026-04-02 12:02:59,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:02:59,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb7ef2a64fa9aff937ae8 HTTP/1.1" 200 None 2026-04-02 12:02:59,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:02:59,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:02:59,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:02:59,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb7ef2a64fa9aff937ae8 HTTP/1.1" 200 None 2026-04-02 12:02:59,346 - lava_callback - ERROR - Error processing callback for node 69cbb7ef2a64fa9aff937ae8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55492 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:04:19,305 - lava_callback - INFO - Received callback for node 69cbb83d2a64fa9aff937af0 INFO: 172.21.0.1:55494 - "POST /node/69cbb83d2a64fa9aff937af0 HTTP/1.0" 202 Accepted 2026-04-02 12:04:19,311 - lava_callback - INFO - Starting async job submit for node 69cbb83d2a64fa9aff937af0 2026-04-02 12:04:19,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:04:19,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb83d2a64fa9aff937af0 HTTP/1.1" 200 None 2026-04-02 12:04:19,347 - lava_callback - DEBUG - Processing node 69cbb83d2a64fa9aff937af0: baseline-arm64-clabbe 2026-04-02 12:04:19,347 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb83d2a64fa9aff937af0 2026-04-02 12:04:19,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:04:19,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb83d2a64fa9aff937af0 HTTP/1.1" 200 None 2026-04-02 12:04:19,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:04:19,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:04:19,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:04:19,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb83d2a64fa9aff937af0 HTTP/1.1" 200 None 2026-04-02 12:04:19,416 - lava_callback - ERROR - Error processing callback for node 69cbb83d2a64fa9aff937af0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42776 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:07:59,425 - lava_callback - INFO - Received callback for node 69cbb91c2a64fa9aff937b02 INFO: 172.21.0.1:42792 - "POST /node/69cbb91c2a64fa9aff937b02 HTTP/1.0" 202 Accepted 2026-04-02 12:07:59,431 - lava_callback - INFO - Starting async job submit for node 69cbb91c2a64fa9aff937b02 2026-04-02 12:07:59,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:07:59,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb91c2a64fa9aff937b02 HTTP/1.1" 200 None 2026-04-02 12:07:59,451 - lava_callback - DEBUG - Processing node 69cbb91c2a64fa9aff937b02: baseline-arm64-clabbe 2026-04-02 12:07:59,452 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb91c2a64fa9aff937b02 2026-04-02 12:07:59,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:07:59,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb91c2a64fa9aff937b02 HTTP/1.1" 200 None 2026-04-02 12:07:59,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:07:59,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:07:59,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:07:59,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb91c2a64fa9aff937b02 HTTP/1.1" 200 None 2026-04-02 12:07:59,508 - lava_callback - ERROR - Error processing callback for node 69cbb91c2a64fa9aff937b02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51700 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:09:19,489 - lava_callback - INFO - Received callback for node 69cbb96b2a64fa9aff937b0a INFO: 172.21.0.1:51702 - "POST /node/69cbb96b2a64fa9aff937b0a HTTP/1.0" 202 Accepted 2026-04-02 12:09:19,494 - lava_callback - INFO - Starting async job submit for node 69cbb96b2a64fa9aff937b0a 2026-04-02 12:09:19,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:09:19,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb96b2a64fa9aff937b0a HTTP/1.1" 200 None 2026-04-02 12:09:19,512 - lava_callback - DEBUG - Processing node 69cbb96b2a64fa9aff937b0a: baseline-arm64-clabbe 2026-04-02 12:09:19,512 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb96b2a64fa9aff937b0a 2026-04-02 12:09:19,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:09:19,527 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb96b2a64fa9aff937b0a HTTP/1.1" 200 None 2026-04-02 12:09:19,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:09:19,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:09:19,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:09:19,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb96b2a64fa9aff937b0a HTTP/1.1" 200 None 2026-04-02 12:09:19,572 - lava_callback - ERROR - Error processing callback for node 69cbb96b2a64fa9aff937b0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50190 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:10:59,536 - lava_callback - INFO - Received callback for node 69cbb9d12a64fa9aff937b18 INFO: 172.21.0.1:50198 - "POST /node/69cbb9d12a64fa9aff937b18 HTTP/1.0" 202 Accepted 2026-04-02 12:10:59,541 - lava_callback - INFO - Starting async job submit for node 69cbb9d12a64fa9aff937b18 2026-04-02 12:10:59,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:10:59,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb9d12a64fa9aff937b18 HTTP/1.1" 200 None 2026-04-02 12:10:59,558 - lava_callback - DEBUG - Processing node 69cbb9d12a64fa9aff937b18: baseline-arm64-clabbe 2026-04-02 12:10:59,558 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbb9d12a64fa9aff937b18 2026-04-02 12:10:59,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:10:59,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbb9d12a64fa9aff937b18 HTTP/1.1" 200 None 2026-04-02 12:10:59,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:10:59,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:10:59,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:10:59,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbb9d12a64fa9aff937b18 HTTP/1.1" 200 None 2026-04-02 12:10:59,618 - lava_callback - ERROR - Error processing callback for node 69cbb9d12a64fa9aff937b18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38596 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46380 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:12:19,606 - lava_callback - INFO - Received callback for node 69cbba1d2a64fa9aff937b20 INFO: 172.21.0.1:46392 - "POST /node/69cbba1d2a64fa9aff937b20 HTTP/1.0" 202 Accepted 2026-04-02 12:12:19,612 - lava_callback - INFO - Starting async job submit for node 69cbba1d2a64fa9aff937b20 2026-04-02 12:12:19,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:12:19,627 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbba1d2a64fa9aff937b20 HTTP/1.1" 200 None 2026-04-02 12:12:19,628 - lava_callback - DEBUG - Processing node 69cbba1d2a64fa9aff937b20: baseline-arm64-clabbe 2026-04-02 12:12:19,628 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbba1d2a64fa9aff937b20 2026-04-02 12:12:19,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:12:19,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbba1d2a64fa9aff937b20 HTTP/1.1" 200 None 2026-04-02 12:12:19,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:12:19,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69caa25b4b5e3e0ab6a60b66 HTTP/1.1" 200 None 2026-04-02 12:12:19,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:12:19,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbba1d2a64fa9aff937b20 HTTP/1.1" 200 None 2026-04-02 12:12:19,688 - lava_callback - ERROR - Error processing callback for node 69cbba1d2a64fa9aff937b20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:23:19,649 - lava_callback - INFO - Received callback for node 69ce2be3cb08ea23a1f68449 INFO: 172.21.0.1:36026 - "POST /node/69ce2be3cb08ea23a1f68449 HTTP/1.0" 202 Accepted 2026-04-02 12:23:19,655 - lava_callback - INFO - Starting async job submit for node 69ce2be3cb08ea23a1f68449 2026-04-02 12:23:19,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:23:19,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be3cb08ea23a1f68449 HTTP/1.1" 200 None 2026-04-02 12:23:19,688 - lava_callback - DEBUG - Processing node 69ce2be3cb08ea23a1f68449: baseline-x86 2026-04-02 12:23:19,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 12:23:20,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 12:23:20,146 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be3cb08ea23a1f68449/log.txt.gz 2026-04-02 12:23:20,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 12:23:20,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 12:23:20,561 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be3cb08ea23a1f68449/lava-logs.yaml 2026-04-02 12:23:20,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-04-02 12:23:20,725 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-04-02 12:23:20,727 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69ce2be3cb08ea23a1f68449/lava_callback.json.gz 2026-04-02 12:23:20,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:23:20,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce2be3cb08ea23a1f68449 HTTP/1.1" 200 None 2026-04-02 12:23:20,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:23:20,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ce268acb08ea23a1f68099 HTTP/1.1" 200 None 2026-04-02 12:23:20,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:23:20,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ce2be3cb08ea23a1f68449 HTTP/1.1" 200 None 2026-04-02 12:23:20,838 - lava_callback - INFO - Completed processing callback for node 69ce2be3cb08ea23a1f68449 INFO: 172.21.0.1:46480 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:23:28,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:23:28,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42836 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32854 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37642 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51030 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59974 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:47:55,417 - lava_callback - INFO - Received callback for node 69cbc2712a64fa9aff937b88 INFO: 172.21.0.1:48574 - "POST /node/69cbc2712a64fa9aff937b88 HTTP/1.0" 202 Accepted 2026-04-02 12:47:55,423 - lava_callback - INFO - Starting async job submit for node 69cbc2712a64fa9aff937b88 2026-04-02 12:47:55,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:47:55,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2712a64fa9aff937b88 HTTP/1.1" 200 None 2026-04-02 12:47:55,439 - lava_callback - DEBUG - Processing node 69cbc2712a64fa9aff937b88: baseline-arm-baylibre 2026-04-02 12:47:55,440 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc2712a64fa9aff937b88 2026-04-02 12:47:55,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:47:55,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2712a64fa9aff937b88 HTTP/1.1" 200 None 2026-04-02 12:47:55,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:47:55,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:47:55,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:47:55,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc2712a64fa9aff937b88 HTTP/1.1" 200 None 2026-04-02 12:47:55,495 - lava_callback - ERROR - Error processing callback for node 69cbc2712a64fa9aff937b88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43868 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:48:55,230 - lava_callback - INFO - Received callback for node 69cbc2aa2a64fa9aff937b97 INFO: 172.21.0.1:34836 - "POST /node/69cbc2aa2a64fa9aff937b97 HTTP/1.0" 202 Accepted 2026-04-02 12:48:55,236 - lava_callback - INFO - Starting async job submit for node 69cbc2aa2a64fa9aff937b97 2026-04-02 12:48:55,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:48:55,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2aa2a64fa9aff937b97 HTTP/1.1" 200 None 2026-04-02 12:48:55,253 - lava_callback - DEBUG - Processing node 69cbc2aa2a64fa9aff937b97: baseline-arm-baylibre 2026-04-02 12:48:55,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc2aa2a64fa9aff937b97 2026-04-02 12:48:55,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:48:55,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2aa2a64fa9aff937b97 HTTP/1.1" 200 None 2026-04-02 12:48:55,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:48:55,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:48:55,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:48:55,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc2aa2a64fa9aff937b97 HTTP/1.1" 200 None 2026-04-02 12:48:55,345 - lava_callback - ERROR - Error processing callback for node 69cbc2aa2a64fa9aff937b97: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:49:35,292 - lava_callback - INFO - Received callback for node 69cbc2d02a64fa9aff937ba3 INFO: 172.21.0.1:45672 - "POST /node/69cbc2d02a64fa9aff937ba3 HTTP/1.0" 202 Accepted 2026-04-02 12:49:35,297 - lava_callback - INFO - Starting async job submit for node 69cbc2d02a64fa9aff937ba3 2026-04-02 12:49:35,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:49:35,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2d02a64fa9aff937ba3 HTTP/1.1" 200 None 2026-04-02 12:49:35,324 - lava_callback - DEBUG - Processing node 69cbc2d02a64fa9aff937ba3: baseline-arm-baylibre 2026-04-02 12:49:35,324 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc2d02a64fa9aff937ba3 2026-04-02 12:49:35,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:49:35,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc2d02a64fa9aff937ba3 HTTP/1.1" 200 None 2026-04-02 12:49:35,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:49:35,359 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:49:35,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:49:35,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc2d02a64fa9aff937ba3 HTTP/1.1" 200 None 2026-04-02 12:49:35,382 - lava_callback - ERROR - Error processing callback for node 69cbc2d02a64fa9aff937ba3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43918 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 12:50:15,318 - lava_callback - INFO - Received callback for node 69cbc3032a64fa9aff937bb1 INFO: 172.21.0.1:43922 - "POST /node/69cbc3032a64fa9aff937bb1 HTTP/1.0" 202 Accepted 2026-04-02 12:50:15,324 - lava_callback - INFO - Starting async job submit for node 69cbc3032a64fa9aff937bb1 2026-04-02 12:50:15,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:15,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3032a64fa9aff937bb1 HTTP/1.1" 200 None 2026-04-02 12:50:15,342 - lava_callback - DEBUG - Processing node 69cbc3032a64fa9aff937bb1: baseline-arm-baylibre 2026-04-02 12:50:15,342 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3032a64fa9aff937bb1 2026-04-02 12:50:15,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:15,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3032a64fa9aff937bb1 HTTP/1.1" 200 None 2026-04-02 12:50:15,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:15,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:50:15,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:15,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3032a64fa9aff937bb1 HTTP/1.1" 200 None 2026-04-02 12:50:15,403 - lava_callback - ERROR - Error processing callback for node 69cbc3032a64fa9aff937bb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35652 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:50:55,541 - lava_callback - INFO - Received callback for node 69cbc3262a64fa9aff937bc1 INFO: 172.21.0.1:34986 - "POST /node/69cbc3262a64fa9aff937bc1 HTTP/1.0" 202 Accepted 2026-04-02 12:50:55,547 - lava_callback - INFO - Starting async job submit for node 69cbc3262a64fa9aff937bc1 2026-04-02 12:50:55,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:55,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3262a64fa9aff937bc1 HTTP/1.1" 200 None 2026-04-02 12:50:55,563 - lava_callback - DEBUG - Processing node 69cbc3262a64fa9aff937bc1: baseline-arm-baylibre 2026-04-02 12:50:55,563 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3262a64fa9aff937bc1 2026-04-02 12:50:55,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:55,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3262a64fa9aff937bc1 HTTP/1.1" 200 None 2026-04-02 12:50:55,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:55,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:50:55,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:50:55,625 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3262a64fa9aff937bc1 HTTP/1.1" 200 None 2026-04-02 12:50:55,626 - lava_callback - ERROR - Error processing callback for node 69cbc3262a64fa9aff937bc1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60596 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:51:35,363 - lava_callback - INFO - Received callback for node 69cbc34d2a64fa9aff937bcb INFO: 172.21.0.1:60612 - "POST /node/69cbc34d2a64fa9aff937bcb HTTP/1.0" 202 Accepted 2026-04-02 12:51:35,369 - lava_callback - INFO - Starting async job submit for node 69cbc34d2a64fa9aff937bcb 2026-04-02 12:51:35,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:51:35,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc34d2a64fa9aff937bcb HTTP/1.1" 200 None 2026-04-02 12:51:35,386 - lava_callback - DEBUG - Processing node 69cbc34d2a64fa9aff937bcb: baseline-arm-baylibre 2026-04-02 12:51:35,386 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc34d2a64fa9aff937bcb 2026-04-02 12:51:35,386 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:51:35,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc34d2a64fa9aff937bcb HTTP/1.1" 200 None 2026-04-02 12:51:35,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:51:35,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:51:35,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:51:35,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc34d2a64fa9aff937bcb HTTP/1.1" 200 None 2026-04-02 12:51:35,444 - lava_callback - ERROR - Error processing callback for node 69cbc34d2a64fa9aff937bcb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58452 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 12:52:15,441 - lava_callback - INFO - Received callback for node 69cbc3732a64fa9aff937bdb INFO: 172.21.0.1:58466 - "POST /node/69cbc3732a64fa9aff937bdb HTTP/1.0" 202 Accepted 2026-04-02 12:52:15,446 - lava_callback - INFO - Starting async job submit for node 69cbc3732a64fa9aff937bdb 2026-04-02 12:52:15,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:15,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3732a64fa9aff937bdb HTTP/1.1" 200 None 2026-04-02 12:52:15,464 - lava_callback - DEBUG - Processing node 69cbc3732a64fa9aff937bdb: baseline-arm-baylibre 2026-04-02 12:52:15,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3732a64fa9aff937bdb 2026-04-02 12:52:15,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:15,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3732a64fa9aff937bdb HTTP/1.1" 200 None 2026-04-02 12:52:15,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:15,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:52:15,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:15,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3732a64fa9aff937bdb HTTP/1.1" 200 None 2026-04-02 12:52:15,524 - lava_callback - ERROR - Error processing callback for node 69cbc3732a64fa9aff937bdb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59494 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:52:55,418 - lava_callback - INFO - Received callback for node 69cbc3972a64fa9aff937be8 INFO: 172.21.0.1:40276 - "POST /node/69cbc3972a64fa9aff937be8 HTTP/1.0" 202 Accepted 2026-04-02 12:52:55,423 - lava_callback - INFO - Starting async job submit for node 69cbc3972a64fa9aff937be8 2026-04-02 12:52:55,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:55,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3972a64fa9aff937be8 HTTP/1.1" 200 None 2026-04-02 12:52:55,467 - lava_callback - DEBUG - Processing node 69cbc3972a64fa9aff937be8: baseline-arm-baylibre 2026-04-02 12:52:55,467 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3972a64fa9aff937be8 2026-04-02 12:52:55,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:55,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3972a64fa9aff937be8 HTTP/1.1" 200 None 2026-04-02 12:52:55,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:55,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:52:55,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:52:55,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3972a64fa9aff937be8 HTTP/1.1" 200 None 2026-04-02 12:52:55,522 - lava_callback - ERROR - Error processing callback for node 69cbc3972a64fa9aff937be8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:53:21,709 - lava_callback - INFO - Received callback for node 69cbc3bd2a64fa9aff937bf5 INFO: 172.21.0.1:55762 - "POST /node/69cbc3bd2a64fa9aff937bf5 HTTP/1.0" 202 Accepted 2026-04-02 12:53:21,714 - lava_callback - INFO - Starting async job submit for node 69cbc3bd2a64fa9aff937bf5 2026-04-02 12:53:21,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:53:21,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3bd2a64fa9aff937bf5 HTTP/1.1" 200 None 2026-04-02 12:53:21,731 - lava_callback - DEBUG - Processing node 69cbc3bd2a64fa9aff937bf5: baseline-arm-clabbe 2026-04-02 12:53:21,731 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3bd2a64fa9aff937bf5 2026-04-02 12:53:21,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:53:21,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3bd2a64fa9aff937bf5 HTTP/1.1" 200 None 2026-04-02 12:53:21,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:53:21,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:53:21,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:53:21,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3bd2a64fa9aff937bf5 HTTP/1.1" 200 None 2026-04-02 12:53:21,796 - lava_callback - ERROR - Error processing callback for node 69cbc3bd2a64fa9aff937bf5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:54:01,144 - lava_callback - INFO - Received callback for node 69cbc3e32a64fa9aff937c06 INFO: 172.21.0.1:38464 - "POST /node/69cbc3e32a64fa9aff937c06 HTTP/1.0" 202 Accepted 2026-04-02 12:54:01,151 - lava_callback - INFO - Starting async job submit for node 69cbc3e32a64fa9aff937c06 2026-04-02 12:54:01,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:01,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3e32a64fa9aff937c06 HTTP/1.1" 200 None 2026-04-02 12:54:01,168 - lava_callback - DEBUG - Processing node 69cbc3e32a64fa9aff937c06: baseline-arm-clabbe 2026-04-02 12:54:01,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc3e32a64fa9aff937c06 2026-04-02 12:54:01,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:01,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc3e32a64fa9aff937c06 HTTP/1.1" 200 None 2026-04-02 12:54:01,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:01,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:54:01,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:01,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc3e32a64fa9aff937c06 HTTP/1.1" 200 None 2026-04-02 12:54:01,231 - lava_callback - ERROR - Error processing callback for node 69cbc3e32a64fa9aff937c06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34208 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:54:41,231 - lava_callback - INFO - Received callback for node 69cbc4082a64fa9aff937c11 INFO: 172.21.0.1:54558 - "POST /node/69cbc4082a64fa9aff937c11 HTTP/1.0" 202 Accepted 2026-04-02 12:54:41,236 - lava_callback - INFO - Starting async job submit for node 69cbc4082a64fa9aff937c11 2026-04-02 12:54:41,237 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:41,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4082a64fa9aff937c11 HTTP/1.1" 200 None 2026-04-02 12:54:41,253 - lava_callback - DEBUG - Processing node 69cbc4082a64fa9aff937c11: baseline-arm-clabbe 2026-04-02 12:54:41,253 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc4082a64fa9aff937c11 2026-04-02 12:54:41,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:41,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4082a64fa9aff937c11 HTTP/1.1" 200 None 2026-04-02 12:54:41,268 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:41,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:54:41,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:54:41,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc4082a64fa9aff937c11 HTTP/1.1" 200 None 2026-04-02 12:54:41,316 - lava_callback - ERROR - Error processing callback for node 69cbc4082a64fa9aff937c11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51154 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:55:21,187 - lava_callback - INFO - Received callback for node 69cbc42e2a64fa9aff937c20 INFO: 172.21.0.1:57104 - "POST /node/69cbc42e2a64fa9aff937c20 HTTP/1.0" 202 Accepted 2026-04-02 12:55:21,192 - lava_callback - INFO - Starting async job submit for node 69cbc42e2a64fa9aff937c20 2026-04-02 12:55:21,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:55:21,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc42e2a64fa9aff937c20 HTTP/1.1" 200 None 2026-04-02 12:55:21,213 - lava_callback - DEBUG - Processing node 69cbc42e2a64fa9aff937c20: baseline-arm-clabbe 2026-04-02 12:55:21,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc42e2a64fa9aff937c20 2026-04-02 12:55:21,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:55:21,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc42e2a64fa9aff937c20 HTTP/1.1" 200 None 2026-04-02 12:55:21,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:55:21,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:55:21,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:55:21,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc42e2a64fa9aff937c20 HTTP/1.1" 200 None 2026-04-02 12:55:21,269 - lava_callback - ERROR - Error processing callback for node 69cbc42e2a64fa9aff937c20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56844 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:56:01,274 - lava_callback - INFO - Received callback for node 69cbc4542a64fa9aff937c32 INFO: 172.21.0.1:47204 - "POST /node/69cbc4542a64fa9aff937c32 HTTP/1.0" 202 Accepted 2026-04-02 12:56:01,279 - lava_callback - INFO - Starting async job submit for node 69cbc4542a64fa9aff937c32 2026-04-02 12:56:01,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:01,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4542a64fa9aff937c32 HTTP/1.1" 200 None 2026-04-02 12:56:01,295 - lava_callback - DEBUG - Processing node 69cbc4542a64fa9aff937c32: baseline-arm-clabbe 2026-04-02 12:56:01,295 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc4542a64fa9aff937c32 2026-04-02 12:56:01,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:01,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4542a64fa9aff937c32 HTTP/1.1" 200 None 2026-04-02 12:56:01,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:01,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:56:01,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:01,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc4542a64fa9aff937c32 HTTP/1.1" 200 None 2026-04-02 12:56:01,351 - lava_callback - ERROR - Error processing callback for node 69cbc4542a64fa9aff937c32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56208 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:56:41,281 - lava_callback - INFO - Received callback for node 69cbc4792a64fa9aff937c3f INFO: 172.21.0.1:49396 - "POST /node/69cbc4792a64fa9aff937c3f HTTP/1.0" 202 Accepted 2026-04-02 12:56:41,287 - lava_callback - INFO - Starting async job submit for node 69cbc4792a64fa9aff937c3f 2026-04-02 12:56:41,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:41,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4792a64fa9aff937c3f HTTP/1.1" 200 None 2026-04-02 12:56:41,313 - lava_callback - DEBUG - Processing node 69cbc4792a64fa9aff937c3f: baseline-arm-clabbe 2026-04-02 12:56:41,313 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc4792a64fa9aff937c3f 2026-04-02 12:56:41,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:41,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4792a64fa9aff937c3f HTTP/1.1" 200 None 2026-04-02 12:56:41,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:41,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:56:41,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:56:41,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc4792a64fa9aff937c3f HTTP/1.1" 200 None 2026-04-02 12:56:41,379 - lava_callback - ERROR - Error processing callback for node 69cbc4792a64fa9aff937c3f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:57:21,365 - lava_callback - INFO - Received callback for node 69cbc49e2a64fa9aff937c4e INFO: 172.21.0.1:39234 - "POST /node/69cbc49e2a64fa9aff937c4e HTTP/1.0" 202 Accepted 2026-04-02 12:57:21,370 - lava_callback - INFO - Starting async job submit for node 69cbc49e2a64fa9aff937c4e 2026-04-02 12:57:21,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:57:21,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc49e2a64fa9aff937c4e HTTP/1.1" 200 None 2026-04-02 12:57:21,405 - lava_callback - DEBUG - Processing node 69cbc49e2a64fa9aff937c4e: baseline-arm-clabbe 2026-04-02 12:57:21,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc49e2a64fa9aff937c4e 2026-04-02 12:57:21,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:57:21,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc49e2a64fa9aff937c4e HTTP/1.1" 200 None 2026-04-02 12:57:21,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:57:21,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:57:21,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:57:21,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc49e2a64fa9aff937c4e HTTP/1.1" 200 None 2026-04-02 12:57:21,495 - lava_callback - ERROR - Error processing callback for node 69cbc49e2a64fa9aff937c4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33652 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:58:01,366 - lava_callback - INFO - Received callback for node 69cbc4c42a64fa9aff937c5b INFO: 172.21.0.1:35868 - "POST /node/69cbc4c42a64fa9aff937c5b HTTP/1.0" 202 Accepted 2026-04-02 12:58:01,372 - lava_callback - INFO - Starting async job submit for node 69cbc4c42a64fa9aff937c5b 2026-04-02 12:58:01,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:01,396 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4c42a64fa9aff937c5b HTTP/1.1" 200 None 2026-04-02 12:58:01,396 - lava_callback - DEBUG - Processing node 69cbc4c42a64fa9aff937c5b: baseline-arm-clabbe 2026-04-02 12:58:01,397 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc4c42a64fa9aff937c5b 2026-04-02 12:58:01,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:01,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4c42a64fa9aff937c5b HTTP/1.1" 200 None 2026-04-02 12:58:01,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:01,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:58:01,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:01,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc4c42a64fa9aff937c5b HTTP/1.1" 200 None 2026-04-02 12:58:01,447 - lava_callback - ERROR - Error processing callback for node 69cbc4c42a64fa9aff937c5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43636 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:58:21,422 - lava_callback - INFO - Received callback for node 69cbc4ea2a64fa9aff937c67 INFO: 172.21.0.1:45038 - "POST /node/69cbc4ea2a64fa9aff937c67 HTTP/1.0" 202 Accepted 2026-04-02 12:58:21,428 - lava_callback - INFO - Starting async job submit for node 69cbc4ea2a64fa9aff937c67 2026-04-02 12:58:21,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:21,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4ea2a64fa9aff937c67 HTTP/1.1" 200 None 2026-04-02 12:58:21,444 - lava_callback - DEBUG - Processing node 69cbc4ea2a64fa9aff937c67: baseline-arm-clabbe 2026-04-02 12:58:21,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc4ea2a64fa9aff937c67 2026-04-02 12:58:21,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:21,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc4ea2a64fa9aff937c67 HTTP/1.1" 200 None 2026-04-02 12:58:21,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:21,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:58:21,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:58:21,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc4ea2a64fa9aff937c67 HTTP/1.1" 200 None 2026-04-02 12:58:21,508 - lava_callback - ERROR - Error processing callback for node 69cbc4ea2a64fa9aff937c67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51232 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:59:01,440 - lava_callback - INFO - Received callback for node 69cbc5102a64fa9aff937c79 INFO: 172.21.0.1:48916 - "POST /node/69cbc5102a64fa9aff937c79 HTTP/1.0" 202 Accepted 2026-04-02 12:59:01,446 - lava_callback - INFO - Starting async job submit for node 69cbc5102a64fa9aff937c79 2026-04-02 12:59:01,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:01,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5102a64fa9aff937c79 HTTP/1.1" 200 None 2026-04-02 12:59:01,462 - lava_callback - DEBUG - Processing node 69cbc5102a64fa9aff937c79: baseline-arm-clabbe 2026-04-02 12:59:01,462 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5102a64fa9aff937c79 2026-04-02 12:59:01,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:01,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5102a64fa9aff937c79 HTTP/1.1" 200 None 2026-04-02 12:59:01,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:01,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:59:01,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:01,536 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5102a64fa9aff937c79 HTTP/1.1" 200 None 2026-04-02 12:59:01,539 - lava_callback - ERROR - Error processing callback for node 69cbc5102a64fa9aff937c79: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55370 - "GET / HTTP/1.0" 200 OK 2026-04-02 12:59:41,456 - lava_callback - INFO - Received callback for node 69cbc5392a64fa9aff937c82 INFO: 172.21.0.1:48906 - "POST /node/69cbc5392a64fa9aff937c82 HTTP/1.0" 202 Accepted 2026-04-02 12:59:41,462 - lava_callback - INFO - Starting async job submit for node 69cbc5392a64fa9aff937c82 2026-04-02 12:59:41,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:41,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5392a64fa9aff937c82 HTTP/1.1" 200 None 2026-04-02 12:59:41,477 - lava_callback - DEBUG - Processing node 69cbc5392a64fa9aff937c82: baseline-arm-clabbe 2026-04-02 12:59:41,478 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5392a64fa9aff937c82 2026-04-02 12:59:41,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:41,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5392a64fa9aff937c82 HTTP/1.1" 200 None 2026-04-02 12:59:41,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:41,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 12:59:41,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 12:59:41,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5392a64fa9aff937c82 HTTP/1.1" 200 None 2026-04-02 12:59:41,539 - lava_callback - ERROR - Error processing callback for node 69cbc5392a64fa9aff937c82: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:00:21,457 - lava_callback - INFO - Received callback for node 69cbc5612a64fa9aff937c92 INFO: 172.21.0.1:43292 - "POST /node/69cbc5612a64fa9aff937c92 HTTP/1.0" 202 Accepted 2026-04-02 13:00:21,463 - lava_callback - INFO - Starting async job submit for node 69cbc5612a64fa9aff937c92 2026-04-02 13:00:21,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:00:21,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5612a64fa9aff937c92 HTTP/1.1" 200 None 2026-04-02 13:00:21,479 - lava_callback - DEBUG - Processing node 69cbc5612a64fa9aff937c92: baseline-arm-clabbe 2026-04-02 13:00:21,479 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5612a64fa9aff937c92 2026-04-02 13:00:21,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:00:21,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5612a64fa9aff937c92 HTTP/1.1" 200 None 2026-04-02 13:00:21,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:00:21,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 13:00:21,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:00:21,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5612a64fa9aff937c92 HTTP/1.1" 200 None 2026-04-02 13:00:21,539 - lava_callback - ERROR - Error processing callback for node 69cbc5612a64fa9aff937c92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48110 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:01:01,542 - lava_callback - INFO - Received callback for node 69cbc5892a64fa9aff937ca1 INFO: 172.21.0.1:50230 - "POST /node/69cbc5892a64fa9aff937ca1 HTTP/1.0" 202 Accepted 2026-04-02 13:01:01,548 - lava_callback - INFO - Starting async job submit for node 69cbc5892a64fa9aff937ca1 2026-04-02 13:01:01,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:01,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5892a64fa9aff937ca1 HTTP/1.1" 200 None 2026-04-02 13:01:01,605 - lava_callback - DEBUG - Processing node 69cbc5892a64fa9aff937ca1: baseline-arm-clabbe 2026-04-02 13:01:01,605 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5892a64fa9aff937ca1 2026-04-02 13:01:01,606 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:01,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5892a64fa9aff937ca1 HTTP/1.1" 200 None 2026-04-02 13:01:01,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:01,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 13:01:01,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:01,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5892a64fa9aff937ca1 HTTP/1.1" 200 None 2026-04-02 13:01:01,672 - lava_callback - ERROR - Error processing callback for node 69cbc5892a64fa9aff937ca1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54272 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:01:41,532 - lava_callback - INFO - Received callback for node 69cbc5b02a64fa9aff937ca9 INFO: 172.21.0.1:52260 - "POST /node/69cbc5b02a64fa9aff937ca9 HTTP/1.0" 202 Accepted 2026-04-02 13:01:41,538 - lava_callback - INFO - Starting async job submit for node 69cbc5b02a64fa9aff937ca9 2026-04-02 13:01:41,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:41,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5b02a64fa9aff937ca9 HTTP/1.1" 200 None 2026-04-02 13:01:41,554 - lava_callback - DEBUG - Processing node 69cbc5b02a64fa9aff937ca9: baseline-arm-clabbe 2026-04-02 13:01:41,555 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5b02a64fa9aff937ca9 2026-04-02 13:01:41,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:41,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5b02a64fa9aff937ca9 HTTP/1.1" 200 None 2026-04-02 13:01:41,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:41,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 13:01:41,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:01:41,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5b02a64fa9aff937ca9 HTTP/1.1" 200 None 2026-04-02 13:01:41,615 - lava_callback - ERROR - Error processing callback for node 69cbc5b02a64fa9aff937ca9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:02:21,594 - lava_callback - INFO - Received callback for node 69cbc5d82a64fa9aff937cb7 INFO: 172.21.0.1:56798 - "POST /node/69cbc5d82a64fa9aff937cb7 HTTP/1.0" 202 Accepted 2026-04-02 13:02:21,599 - lava_callback - INFO - Starting async job submit for node 69cbc5d82a64fa9aff937cb7 2026-04-02 13:02:21,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:02:21,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5d82a64fa9aff937cb7 HTTP/1.1" 200 None 2026-04-02 13:02:21,615 - lava_callback - DEBUG - Processing node 69cbc5d82a64fa9aff937cb7: baseline-arm-clabbe 2026-04-02 13:02:21,615 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc5d82a64fa9aff937cb7 2026-04-02 13:02:21,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:02:21,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc5d82a64fa9aff937cb7 HTTP/1.1" 200 None 2026-04-02 13:02:21,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:02:21,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f72f41e4fb6a3782f3e HTTP/1.1" 200 None 2026-04-02 13:02:21,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:02:21,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc5d82a64fa9aff937cb7 HTTP/1.1" 200 None 2026-04-02 13:02:21,666 - lava_callback - ERROR - Error processing callback for node 69cbc5d82a64fa9aff937cb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48008 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37692 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:06:56,336 - lava_callback - INFO - Received callback for node 69cbc6e32a64fa9aff937ce7 INFO: 172.21.0.1:33684 - "POST /node/69cbc6e32a64fa9aff937ce7 HTTP/1.0" 202 Accepted 2026-04-02 13:06:56,342 - lava_callback - INFO - Starting async job submit for node 69cbc6e32a64fa9aff937ce7 2026-04-02 13:06:56,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:06:56,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc6e32a64fa9aff937ce7 HTTP/1.1" 200 None 2026-04-02 13:06:56,358 - lava_callback - DEBUG - Processing node 69cbc6e32a64fa9aff937ce7: baseline-arm-baylibre 2026-04-02 13:06:56,358 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc6e32a64fa9aff937ce7 2026-04-02 13:06:56,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:06:56,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc6e32a64fa9aff937ce7 HTTP/1.1" 200 None 2026-04-02 13:06:56,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:06:56,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:06:56,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:06:56,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc6e32a64fa9aff937ce7 HTTP/1.1" 200 None 2026-04-02 13:06:56,421 - lava_callback - ERROR - Error processing callback for node 69cbc6e32a64fa9aff937ce7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:07:36,233 - lava_callback - INFO - Received callback for node 69cbc7092a64fa9aff937cf2 INFO: 172.21.0.1:59442 - "POST /node/69cbc7092a64fa9aff937cf2 HTTP/1.0" 202 Accepted 2026-04-02 13:07:36,238 - lava_callback - INFO - Starting async job submit for node 69cbc7092a64fa9aff937cf2 2026-04-02 13:07:36,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:07:36,254 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc7092a64fa9aff937cf2 HTTP/1.1" 200 None 2026-04-02 13:07:36,254 - lava_callback - DEBUG - Processing node 69cbc7092a64fa9aff937cf2: baseline-arm-baylibre 2026-04-02 13:07:36,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc7092a64fa9aff937cf2 2026-04-02 13:07:36,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:07:36,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc7092a64fa9aff937cf2 HTTP/1.1" 200 None 2026-04-02 13:07:36,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:07:36,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:07:36,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:07:36,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc7092a64fa9aff937cf2 HTTP/1.1" 200 None 2026-04-02 13:07:36,314 - lava_callback - ERROR - Error processing callback for node 69cbc7092a64fa9aff937cf2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56028 - "GET /api/metrics HTTP/1.0" 200 OK 2026-04-02 13:08:16,288 - lava_callback - INFO - Received callback for node 69cbc72f2a64fa9aff937d04 INFO: 172.21.0.1:56032 - "POST /node/69cbc72f2a64fa9aff937d04 HTTP/1.0" 202 Accepted 2026-04-02 13:08:16,297 - lava_callback - INFO - Starting async job submit for node 69cbc72f2a64fa9aff937d04 2026-04-02 13:08:16,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:08:16,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc72f2a64fa9aff937d04 HTTP/1.1" 200 None 2026-04-02 13:08:16,320 - lava_callback - DEBUG - Processing node 69cbc72f2a64fa9aff937d04: baseline-arm-baylibre 2026-04-02 13:08:16,320 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc72f2a64fa9aff937d04 2026-04-02 13:08:16,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:08:16,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc72f2a64fa9aff937d04 HTTP/1.1" 200 None 2026-04-02 13:08:16,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:08:16,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:08:16,355 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:08:16,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc72f2a64fa9aff937d04 HTTP/1.1" 200 None 2026-04-02 13:08:16,378 - lava_callback - ERROR - Error processing callback for node 69cbc72f2a64fa9aff937d04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:09:36,387 - lava_callback - INFO - Received callback for node 69cbc77b2a64fa9aff937d18 INFO: 172.21.0.1:48706 - "POST /node/69cbc77b2a64fa9aff937d18 HTTP/1.0" 202 Accepted 2026-04-02 13:09:36,393 - lava_callback - INFO - Starting async job submit for node 69cbc77b2a64fa9aff937d18 2026-04-02 13:09:36,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:36,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc77b2a64fa9aff937d18 HTTP/1.1" 200 None 2026-04-02 13:09:36,409 - lava_callback - DEBUG - Processing node 69cbc77b2a64fa9aff937d18: baseline-arm-baylibre 2026-04-02 13:09:36,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc77b2a64fa9aff937d18 2026-04-02 13:09:36,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:36,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc77b2a64fa9aff937d18 HTTP/1.1" 200 None 2026-04-02 13:09:36,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:36,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:09:36,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:36,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc77b2a64fa9aff937d18 HTTP/1.1" 200 None 2026-04-02 13:09:36,459 - lava_callback - ERROR - Error processing callback for node 69cbc77b2a64fa9aff937d18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55972 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:09:56,354 - lava_callback - INFO - Received callback for node 69cbc7a02a64fa9aff937d2b INFO: 172.21.0.1:57818 - "POST /node/69cbc7a02a64fa9aff937d2b HTTP/1.0" 202 Accepted 2026-04-02 13:09:56,359 - lava_callback - INFO - Starting async job submit for node 69cbc7a02a64fa9aff937d2b 2026-04-02 13:09:56,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:56,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc7a02a64fa9aff937d2b HTTP/1.1" 200 None 2026-04-02 13:09:56,375 - lava_callback - DEBUG - Processing node 69cbc7a02a64fa9aff937d2b: baseline-arm-baylibre 2026-04-02 13:09:56,376 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc7a02a64fa9aff937d2b 2026-04-02 13:09:56,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:56,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc7a02a64fa9aff937d2b HTTP/1.1" 200 None 2026-04-02 13:09:56,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:56,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:09:56,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:09:56,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc7a02a64fa9aff937d2b HTTP/1.1" 200 None 2026-04-02 13:09:56,450 - lava_callback - ERROR - Error processing callback for node 69cbc7a02a64fa9aff937d2b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57366 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45776 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:12:02,184 - lava_callback - INFO - Received callback for node 69cbc8102a64fa9aff937d50 INFO: 172.21.0.1:55992 - "POST /node/69cbc8102a64fa9aff937d50 HTTP/1.0" 202 Accepted 2026-04-02 13:12:02,190 - lava_callback - INFO - Starting async job submit for node 69cbc8102a64fa9aff937d50 2026-04-02 13:12:02,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:02,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8102a64fa9aff937d50 HTTP/1.1" 200 None 2026-04-02 13:12:02,208 - lava_callback - DEBUG - Processing node 69cbc8102a64fa9aff937d50: baseline-arm-clabbe 2026-04-02 13:12:02,208 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc8102a64fa9aff937d50 2026-04-02 13:12:02,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:02,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8102a64fa9aff937d50 HTTP/1.1" 200 None 2026-04-02 13:12:02,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:02,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:12:02,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:02,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc8102a64fa9aff937d50 HTTP/1.1" 200 None 2026-04-02 13:12:02,270 - lava_callback - ERROR - Error processing callback for node 69cbc8102a64fa9aff937d50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35860 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:12:41,983 - lava_callback - INFO - Received callback for node 69cbc8352a64fa9aff937d60 INFO: 172.21.0.1:46544 - "POST /node/69cbc8352a64fa9aff937d60 HTTP/1.0" 202 Accepted 2026-04-02 13:12:41,989 - lava_callback - INFO - Starting async job submit for node 69cbc8352a64fa9aff937d60 2026-04-02 13:12:41,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:42,004 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8352a64fa9aff937d60 HTTP/1.1" 200 None 2026-04-02 13:12:42,004 - lava_callback - DEBUG - Processing node 69cbc8352a64fa9aff937d60: baseline-arm-clabbe 2026-04-02 13:12:42,005 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc8352a64fa9aff937d60 2026-04-02 13:12:42,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:42,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8352a64fa9aff937d60 HTTP/1.1" 200 None 2026-04-02 13:12:42,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:42,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:12:42,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:12:42,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc8352a64fa9aff937d60 HTTP/1.1" 200 None 2026-04-02 13:12:42,080 - lava_callback - ERROR - Error processing callback for node 69cbc8352a64fa9aff937d60: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49048 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:13:02,012 - lava_callback - INFO - Received callback for node 69cbc85b2a64fa9aff937d6c INFO: 172.21.0.1:36648 - "POST /node/69cbc85b2a64fa9aff937d6c HTTP/1.0" 202 Accepted 2026-04-02 13:13:02,017 - lava_callback - INFO - Starting async job submit for node 69cbc85b2a64fa9aff937d6c 2026-04-02 13:13:02,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:02,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc85b2a64fa9aff937d6c HTTP/1.1" 200 None 2026-04-02 13:13:02,207 - lava_callback - DEBUG - Processing node 69cbc85b2a64fa9aff937d6c: baseline-arm-clabbe 2026-04-02 13:13:02,207 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc85b2a64fa9aff937d6c 2026-04-02 13:13:02,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:02,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc85b2a64fa9aff937d6c HTTP/1.1" 200 None 2026-04-02 13:13:02,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:02,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:13:02,246 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:02,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc85b2a64fa9aff937d6c HTTP/1.1" 200 None 2026-04-02 13:13:02,273 - lava_callback - ERROR - Error processing callback for node 69cbc85b2a64fa9aff937d6c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:13:42,030 - lava_callback - INFO - Received callback for node 69cbc87f2a64fa9aff937d76 INFO: 172.21.0.1:59036 - "POST /node/69cbc87f2a64fa9aff937d76 HTTP/1.0" 202 Accepted 2026-04-02 13:13:42,035 - lava_callback - INFO - Starting async job submit for node 69cbc87f2a64fa9aff937d76 2026-04-02 13:13:42,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:42,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc87f2a64fa9aff937d76 HTTP/1.1" 200 None 2026-04-02 13:13:42,051 - lava_callback - DEBUG - Processing node 69cbc87f2a64fa9aff937d76: baseline-arm-clabbe 2026-04-02 13:13:42,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc87f2a64fa9aff937d76 2026-04-02 13:13:42,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:42,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc87f2a64fa9aff937d76 HTTP/1.1" 200 None 2026-04-02 13:13:42,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:42,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:13:42,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:13:42,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc87f2a64fa9aff937d76 HTTP/1.1" 200 None 2026-04-02 13:13:42,122 - lava_callback - ERROR - Error processing callback for node 69cbc87f2a64fa9aff937d76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44864 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:14:22,101 - lava_callback - INFO - Received callback for node 69cbc8a42a64fa9aff937d83 INFO: 172.21.0.1:50040 - "POST /node/69cbc8a42a64fa9aff937d83 HTTP/1.0" 202 Accepted 2026-04-02 13:14:22,116 - lava_callback - INFO - Starting async job submit for node 69cbc8a42a64fa9aff937d83 2026-04-02 13:14:22,117 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:14:22,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8a42a64fa9aff937d83 HTTP/1.1" 200 None 2026-04-02 13:14:22,132 - lava_callback - DEBUG - Processing node 69cbc8a42a64fa9aff937d83: baseline-arm-clabbe 2026-04-02 13:14:22,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbc8a42a64fa9aff937d83 2026-04-02 13:14:22,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:14:22,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbc8a42a64fa9aff937d83 HTTP/1.1" 200 None 2026-04-02 13:14:22,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:14:22,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12cb8c06c2799bf55018 HTTP/1.1" 200 None 2026-04-02 13:14:22,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:14:22,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbc8a42a64fa9aff937d83 HTTP/1.1" 200 None 2026-04-02 13:14:22,189 - lava_callback - ERROR - Error processing callback for node 69cbc8a42a64fa9aff937d83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40060 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48508 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:30:17,599 - lava_callback - INFO - Received callback for node 69cbcc542a64fa9aff937dd7 INFO: 172.21.0.1:48522 - "POST /node/69cbcc542a64fa9aff937dd7 HTTP/1.0" 202 Accepted 2026-04-02 13:30:17,604 - lava_callback - INFO - Starting async job submit for node 69cbcc542a64fa9aff937dd7 2026-04-02 13:30:17,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:30:17,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcc542a64fa9aff937dd7 HTTP/1.1" 200 None 2026-04-02 13:30:17,620 - lava_callback - DEBUG - Processing node 69cbcc542a64fa9aff937dd7: baseline-arm64-baylibre 2026-04-02 13:30:17,620 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbcc542a64fa9aff937dd7 2026-04-02 13:30:17,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:30:17,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcc542a64fa9aff937dd7 HTTP/1.1" 200 None 2026-04-02 13:30:17,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:30:17,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:30:17,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:30:17,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbcc542a64fa9aff937dd7 HTTP/1.1" 200 None 2026-04-02 13:30:17,676 - lava_callback - ERROR - Error processing callback for node 69cbcc542a64fa9aff937dd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43268 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:34:17,699 - lava_callback - INFO - Received callback for node 69cbcd472a64fa9aff937de5 INFO: 172.21.0.1:43276 - "POST /node/69cbcd472a64fa9aff937de5 HTTP/1.0" 202 Accepted 2026-04-02 13:34:17,705 - lava_callback - INFO - Starting async job submit for node 69cbcd472a64fa9aff937de5 2026-04-02 13:34:17,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:34:17,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcd472a64fa9aff937de5 HTTP/1.1" 200 None 2026-04-02 13:34:17,721 - lava_callback - DEBUG - Processing node 69cbcd472a64fa9aff937de5: baseline-arm64-baylibre 2026-04-02 13:34:17,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbcd472a64fa9aff937de5 2026-04-02 13:34:17,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:34:17,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcd472a64fa9aff937de5 HTTP/1.1" 200 None 2026-04-02 13:34:17,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:34:17,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:34:17,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:34:17,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbcd472a64fa9aff937de5 HTTP/1.1" 200 None 2026-04-02 13:34:17,774 - lava_callback - ERROR - Error processing callback for node 69cbcd472a64fa9aff937de5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:36:23,145 - lava_callback - INFO - Received callback for node 69cbcdc62a64fa9aff937df4 INFO: 172.21.0.1:46772 - "POST /node/69cbcdc62a64fa9aff937df4 HTTP/1.0" 202 Accepted 2026-04-02 13:36:23,151 - lava_callback - INFO - Starting async job submit for node 69cbcdc62a64fa9aff937df4 2026-04-02 13:36:23,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:36:23,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcdc62a64fa9aff937df4 HTTP/1.1" 200 None 2026-04-02 13:36:23,168 - lava_callback - DEBUG - Processing node 69cbcdc62a64fa9aff937df4: baseline-arm64-clabbe 2026-04-02 13:36:23,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbcdc62a64fa9aff937df4 2026-04-02 13:36:23,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:36:23,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcdc62a64fa9aff937df4 HTTP/1.1" 200 None 2026-04-02 13:36:23,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:36:23,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:36:23,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:36:23,220 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbcdc62a64fa9aff937df4 HTTP/1.1" 200 None 2026-04-02 13:36:23,226 - lava_callback - ERROR - Error processing callback for node 69cbcdc62a64fa9aff937df4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57040 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49556 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:38:23,238 - lava_callback - INFO - Received callback for node 69cbce3d2a64fa9aff937e00 INFO: 172.21.0.1:60376 - "POST /node/69cbce3d2a64fa9aff937e00 HTTP/1.0" 202 Accepted 2026-04-02 13:38:23,244 - lava_callback - INFO - Starting async job submit for node 69cbce3d2a64fa9aff937e00 2026-04-02 13:38:23,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:38:23,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbce3d2a64fa9aff937e00 HTTP/1.1" 200 None 2026-04-02 13:38:23,261 - lava_callback - DEBUG - Processing node 69cbce3d2a64fa9aff937e00: baseline-arm64-clabbe 2026-04-02 13:38:23,261 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbce3d2a64fa9aff937e00 2026-04-02 13:38:23,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:38:23,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbce3d2a64fa9aff937e00 HTTP/1.1" 200 None 2026-04-02 13:38:23,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:38:23,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:38:23,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:38:23,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbce3d2a64fa9aff937e00 HTTP/1.1" 200 None 2026-04-02 13:38:23,313 - lava_callback - ERROR - Error processing callback for node 69cbce3d2a64fa9aff937e00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48282 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:39:43,266 - lava_callback - INFO - Received callback for node 69cbce892a64fa9aff937e0a INFO: 172.21.0.1:36894 - "POST /node/69cbce892a64fa9aff937e0a HTTP/1.0" 202 Accepted 2026-04-02 13:39:43,271 - lava_callback - INFO - Starting async job submit for node 69cbce892a64fa9aff937e0a 2026-04-02 13:39:43,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:39:43,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbce892a64fa9aff937e0a HTTP/1.1" 200 None 2026-04-02 13:39:43,287 - lava_callback - DEBUG - Processing node 69cbce892a64fa9aff937e0a: baseline-arm64-clabbe 2026-04-02 13:39:43,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbce892a64fa9aff937e0a 2026-04-02 13:39:43,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:39:43,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbce892a64fa9aff937e0a HTTP/1.1" 200 None 2026-04-02 13:39:43,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:39:43,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:39:43,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:39:43,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbce892a64fa9aff937e0a HTTP/1.1" 200 None 2026-04-02 13:39:43,350 - lava_callback - ERROR - Error processing callback for node 69cbce892a64fa9aff937e0a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41732 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:40:43,294 - lava_callback - INFO - Received callback for node 69cbced62a64fa9aff937e18 INFO: 172.21.0.1:56388 - "POST /node/69cbced62a64fa9aff937e18 HTTP/1.0" 202 Accepted 2026-04-02 13:40:43,299 - lava_callback - INFO - Starting async job submit for node 69cbced62a64fa9aff937e18 2026-04-02 13:40:43,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:40:43,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbced62a64fa9aff937e18 HTTP/1.1" 200 None 2026-04-02 13:40:43,316 - lava_callback - DEBUG - Processing node 69cbced62a64fa9aff937e18: baseline-arm64-clabbe 2026-04-02 13:40:43,317 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbced62a64fa9aff937e18 2026-04-02 13:40:43,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:40:43,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbced62a64fa9aff937e18 HTTP/1.1" 200 None 2026-04-02 13:40:43,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:40:43,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:40:43,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:40:43,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbced62a64fa9aff937e18 HTTP/1.1" 200 None 2026-04-02 13:40:43,368 - lava_callback - ERROR - Error processing callback for node 69cbced62a64fa9aff937e18: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59292 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:42:23,391 - lava_callback - INFO - Received callback for node 69cbcf2e2a64fa9aff937e24 INFO: 172.21.0.1:43838 - "POST /node/69cbcf2e2a64fa9aff937e24 HTTP/1.0" 202 Accepted 2026-04-02 13:42:23,397 - lava_callback - INFO - Starting async job submit for node 69cbcf2e2a64fa9aff937e24 2026-04-02 13:42:23,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:42:23,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcf2e2a64fa9aff937e24 HTTP/1.1" 200 None 2026-04-02 13:42:23,413 - lava_callback - DEBUG - Processing node 69cbcf2e2a64fa9aff937e24: baseline-arm64-clabbe 2026-04-02 13:42:23,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbcf2e2a64fa9aff937e24 2026-04-02 13:42:23,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:42:23,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcf2e2a64fa9aff937e24 HTTP/1.1" 200 None 2026-04-02 13:42:23,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:42:23,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:42:23,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:42:23,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbcf2e2a64fa9aff937e24 HTTP/1.1" 200 None 2026-04-02 13:42:23,470 - lava_callback - ERROR - Error processing callback for node 69cbcf2e2a64fa9aff937e24: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35938 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:43:43,423 - lava_callback - INFO - Received callback for node 69cbcf7b2a64fa9aff937e31 INFO: 172.21.0.1:45692 - "POST /node/69cbcf7b2a64fa9aff937e31 HTTP/1.0" 202 Accepted 2026-04-02 13:43:43,428 - lava_callback - INFO - Starting async job submit for node 69cbcf7b2a64fa9aff937e31 2026-04-02 13:43:43,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:43:43,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcf7b2a64fa9aff937e31 HTTP/1.1" 200 None 2026-04-02 13:43:43,444 - lava_callback - DEBUG - Processing node 69cbcf7b2a64fa9aff937e31: baseline-arm64-clabbe 2026-04-02 13:43:43,444 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbcf7b2a64fa9aff937e31 2026-04-02 13:43:43,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:43:43,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbcf7b2a64fa9aff937e31 HTTP/1.1" 200 None 2026-04-02 13:43:43,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:43:43,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb12e08c06c2799bf5502b HTTP/1.1" 200 None 2026-04-02 13:43:43,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:43:43,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbcf7b2a64fa9aff937e31 HTTP/1.1" 200 None 2026-04-02 13:43:43,496 - lava_callback - ERROR - Error processing callback for node 69cbcf7b2a64fa9aff937e31: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54086 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54092 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:49:18,436 - lava_callback - INFO - Received callback for node 69cbd0cb2a64fa9aff937e45 INFO: 172.21.0.1:54094 - "POST /node/69cbd0cb2a64fa9aff937e45 HTTP/1.0" 202 Accepted 2026-04-02 13:49:18,441 - lava_callback - INFO - Starting async job submit for node 69cbd0cb2a64fa9aff937e45 2026-04-02 13:49:18,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:49:18,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd0cb2a64fa9aff937e45 HTTP/1.1" 200 None 2026-04-02 13:49:18,457 - lava_callback - DEBUG - Processing node 69cbd0cb2a64fa9aff937e45: baseline-arm64-baylibre 2026-04-02 13:49:18,458 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd0cb2a64fa9aff937e45 2026-04-02 13:49:18,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:49:18,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd0cb2a64fa9aff937e45 HTTP/1.1" 200 None 2026-04-02 13:49:18,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:49:18,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:49:18,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:49:18,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd0cb2a64fa9aff937e45 HTTP/1.1" 200 None 2026-04-02 13:49:18,514 - lava_callback - ERROR - Error processing callback for node 69cbd0cb2a64fa9aff937e45: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50724 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:51:03,745 - lava_callback - INFO - Received callback for node 69cbd1322a64fa9aff937e4e INFO: 172.21.0.1:59088 - "POST /node/69cbd1322a64fa9aff937e4e HTTP/1.0" 202 Accepted 2026-04-02 13:51:03,750 - lava_callback - INFO - Starting async job submit for node 69cbd1322a64fa9aff937e4e 2026-04-02 13:51:03,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:51:03,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1322a64fa9aff937e4e HTTP/1.1" 200 None 2026-04-02 13:51:03,766 - lava_callback - DEBUG - Processing node 69cbd1322a64fa9aff937e4e: baseline-arm64-clabbe 2026-04-02 13:51:03,766 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd1322a64fa9aff937e4e 2026-04-02 13:51:03,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:51:03,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1322a64fa9aff937e4e HTTP/1.1" 200 None 2026-04-02 13:51:03,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:51:03,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:51:03,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:51:03,820 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd1322a64fa9aff937e4e HTTP/1.1" 200 None 2026-04-02 13:51:03,821 - lava_callback - ERROR - Error processing callback for node 69cbd1322a64fa9aff937e4e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58922 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:52:43,764 - lava_callback - INFO - Received callback for node 69cbd1962a64fa9aff937e5b INFO: 172.21.0.1:42916 - "POST /node/69cbd1962a64fa9aff937e5b HTTP/1.0" 202 Accepted 2026-04-02 13:52:43,770 - lava_callback - INFO - Starting async job submit for node 69cbd1962a64fa9aff937e5b 2026-04-02 13:52:43,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:52:43,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1962a64fa9aff937e5b HTTP/1.1" 200 None 2026-04-02 13:52:43,785 - lava_callback - DEBUG - Processing node 69cbd1962a64fa9aff937e5b: baseline-arm64-clabbe 2026-04-02 13:52:43,786 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd1962a64fa9aff937e5b 2026-04-02 13:52:43,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:52:43,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1962a64fa9aff937e5b HTTP/1.1" 200 None 2026-04-02 13:52:43,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:52:43,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:52:43,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:52:43,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd1962a64fa9aff937e5b HTTP/1.1" 200 None 2026-04-02 13:52:43,848 - lava_callback - ERROR - Error processing callback for node 69cbd1962a64fa9aff937e5b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56118 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:54:03,824 - lava_callback - INFO - Received callback for node 69cbd1e62a64fa9aff937e68 INFO: 172.21.0.1:56526 - "POST /node/69cbd1e62a64fa9aff937e68 HTTP/1.0" 202 Accepted 2026-04-02 13:54:03,830 - lava_callback - INFO - Starting async job submit for node 69cbd1e62a64fa9aff937e68 2026-04-02 13:54:03,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:54:03,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1e62a64fa9aff937e68 HTTP/1.1" 200 None 2026-04-02 13:54:03,845 - lava_callback - DEBUG - Processing node 69cbd1e62a64fa9aff937e68: baseline-arm64-clabbe 2026-04-02 13:54:03,845 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd1e62a64fa9aff937e68 2026-04-02 13:54:03,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:54:03,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd1e62a64fa9aff937e68 HTTP/1.1" 200 None 2026-04-02 13:54:03,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:54:03,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:54:03,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:54:03,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd1e62a64fa9aff937e68 HTTP/1.1" 200 None 2026-04-02 13:54:03,909 - lava_callback - ERROR - Error processing callback for node 69cbd1e62a64fa9aff937e68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33124 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33136 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:55:23,926 - lava_callback - INFO - Received callback for node 69cbd2352a64fa9aff937e76 INFO: 172.21.0.1:49220 - "POST /node/69cbd2352a64fa9aff937e76 HTTP/1.0" 202 Accepted 2026-04-02 13:55:23,932 - lava_callback - INFO - Starting async job submit for node 69cbd2352a64fa9aff937e76 2026-04-02 13:55:23,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:55:23,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd2352a64fa9aff937e76 HTTP/1.1" 200 None 2026-04-02 13:55:23,948 - lava_callback - DEBUG - Processing node 69cbd2352a64fa9aff937e76: baseline-arm64-clabbe 2026-04-02 13:55:23,948 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd2352a64fa9aff937e76 2026-04-02 13:55:23,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:55:23,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd2352a64fa9aff937e76 HTTP/1.1" 200 None 2026-04-02 13:55:23,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:55:23,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:55:23,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:55:24,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd2352a64fa9aff937e76 HTTP/1.1" 200 None 2026-04-02 13:55:24,018 - lava_callback - ERROR - Error processing callback for node 69cbd2352a64fa9aff937e76: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56590 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54636 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:57:43,991 - lava_callback - INFO - Received callback for node 69cbd2c22a64fa9aff937e81 INFO: 172.21.0.1:39734 - "POST /node/69cbd2c22a64fa9aff937e81 HTTP/1.0" 202 Accepted 2026-04-02 13:57:43,997 - lava_callback - INFO - Starting async job submit for node 69cbd2c22a64fa9aff937e81 2026-04-02 13:57:43,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:57:44,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd2c22a64fa9aff937e81 HTTP/1.1" 200 None 2026-04-02 13:57:44,021 - lava_callback - DEBUG - Processing node 69cbd2c22a64fa9aff937e81: baseline-arm64-clabbe 2026-04-02 13:57:44,022 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd2c22a64fa9aff937e81 2026-04-02 13:57:44,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:57:44,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd2c22a64fa9aff937e81 HTTP/1.1" 200 None 2026-04-02 13:57:44,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:57:44,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:57:44,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:57:44,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd2c22a64fa9aff937e81 HTTP/1.1" 200 None 2026-04-02 13:57:44,077 - lava_callback - ERROR - Error processing callback for node 69cbd2c22a64fa9aff937e81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK 2026-04-02 13:59:04,059 - lava_callback - INFO - Received callback for node 69cbd3122a64fa9aff937e8e INFO: 172.21.0.1:58858 - "POST /node/69cbd3122a64fa9aff937e8e HTTP/1.0" 202 Accepted 2026-04-02 13:59:04,064 - lava_callback - INFO - Starting async job submit for node 69cbd3122a64fa9aff937e8e 2026-04-02 13:59:04,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:59:04,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd3122a64fa9aff937e8e HTTP/1.1" 200 None 2026-04-02 13:59:04,083 - lava_callback - DEBUG - Processing node 69cbd3122a64fa9aff937e8e: baseline-arm64-clabbe 2026-04-02 13:59:04,083 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd3122a64fa9aff937e8e 2026-04-02 13:59:04,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:59:04,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd3122a64fa9aff937e8e HTTP/1.1" 200 None 2026-04-02 13:59:04,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:59:04,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 13:59:04,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 13:59:04,136 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd3122a64fa9aff937e8e HTTP/1.1" 200 None 2026-04-02 13:59:04,143 - lava_callback - ERROR - Error processing callback for node 69cbd3122a64fa9aff937e8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37608 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:12:19,653 - lava_callback - INFO - Received callback for node 69cbd6332a64fa9aff937eb3 INFO: 172.21.0.1:37624 - "POST /node/69cbd6332a64fa9aff937eb3 HTTP/1.0" 202 Accepted 2026-04-02 14:12:19,658 - lava_callback - INFO - Starting async job submit for node 69cbd6332a64fa9aff937eb3 2026-04-02 14:12:19,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:12:19,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6332a64fa9aff937eb3 HTTP/1.1" 200 None 2026-04-02 14:12:19,675 - lava_callback - DEBUG - Processing node 69cbd6332a64fa9aff937eb3: baseline-arm64-baylibre 2026-04-02 14:12:19,675 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd6332a64fa9aff937eb3 2026-04-02 14:12:19,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:12:19,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6332a64fa9aff937eb3 HTTP/1.1" 200 None 2026-04-02 14:12:19,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:12:19,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 14:12:19,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:12:19,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd6332a64fa9aff937eb3 HTTP/1.1" 200 None 2026-04-02 14:12:19,726 - lava_callback - ERROR - Error processing callback for node 69cbd6332a64fa9aff937eb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39458 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:13:44,690 - lava_callback - INFO - Received callback for node 69cbd6852a64fa9aff937ebf INFO: 172.21.0.1:37912 - "POST /node/69cbd6852a64fa9aff937ebf HTTP/1.0" 202 Accepted 2026-04-02 14:13:44,696 - lava_callback - INFO - Starting async job submit for node 69cbd6852a64fa9aff937ebf 2026-04-02 14:13:44,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:13:44,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6852a64fa9aff937ebf HTTP/1.1" 200 None 2026-04-02 14:13:44,712 - lava_callback - DEBUG - Processing node 69cbd6852a64fa9aff937ebf: baseline-arm64-clabbe 2026-04-02 14:13:44,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd6852a64fa9aff937ebf 2026-04-02 14:13:44,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:13:44,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6852a64fa9aff937ebf HTTP/1.1" 200 None 2026-04-02 14:13:44,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:13:44,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 14:13:44,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:13:44,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd6852a64fa9aff937ebf HTTP/1.1" 200 None 2026-04-02 14:13:44,778 - lava_callback - ERROR - Error processing callback for node 69cbd6852a64fa9aff937ebf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44228 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:15:04,775 - lava_callback - INFO - Received callback for node 69cbd6d22a64fa9aff937ec8 INFO: 172.21.0.1:43058 - "POST /node/69cbd6d22a64fa9aff937ec8 HTTP/1.0" 202 Accepted 2026-04-02 14:15:04,781 - lava_callback - INFO - Starting async job submit for node 69cbd6d22a64fa9aff937ec8 2026-04-02 14:15:04,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:15:04,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6d22a64fa9aff937ec8 HTTP/1.1" 200 None 2026-04-02 14:15:04,796 - lava_callback - DEBUG - Processing node 69cbd6d22a64fa9aff937ec8: baseline-arm64-clabbe 2026-04-02 14:15:04,797 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbd6d22a64fa9aff937ec8 2026-04-02 14:15:04,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:15:04,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbd6d22a64fa9aff937ec8 HTTP/1.1" 200 None 2026-04-02 14:15:04,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:15:04,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c86f7ef41e4fb6a3782f4d HTTP/1.1" 200 None 2026-04-02 14:15:04,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:15:04,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbd6d22a64fa9aff937ec8 HTTP/1.1" 200 None 2026-04-02 14:15:04,854 - lava_callback - ERROR - Error processing callback for node 69cbd6d22a64fa9aff937ec8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47970 - "GET /node/698f5ee73013abef95cf9749%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48550 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39356 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:38:01,116 - lava_callback - INFO - Received callback for node 69cbdc412a64fa9aff937f04 INFO: 172.21.0.1:35702 - "POST /node/69cbdc412a64fa9aff937f04 HTTP/1.0" 202 Accepted 2026-04-02 14:38:01,121 - lava_callback - INFO - Starting async job submit for node 69cbdc412a64fa9aff937f04 2026-04-02 14:38:01,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:38:01,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdc412a64fa9aff937f04 HTTP/1.1" 200 None 2026-04-02 14:38:01,138 - lava_callback - DEBUG - Processing node 69cbdc412a64fa9aff937f04: baseline-arm-baylibre 2026-04-02 14:38:01,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdc412a64fa9aff937f04 2026-04-02 14:38:01,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:38:01,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdc412a64fa9aff937f04 HTTP/1.1" 200 None 2026-04-02 14:38:01,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:38:01,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:38:01,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:38:01,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdc412a64fa9aff937f04 HTTP/1.1" 200 None 2026-04-02 14:38:01,204 - lava_callback - ERROR - Error processing callback for node 69cbdc412a64fa9aff937f04: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36402 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:40:01,222 - lava_callback - INFO - Received callback for node 69cbdcb62a64fa9aff937f3b INFO: 172.21.0.1:42288 - "POST /node/69cbdcb62a64fa9aff937f3b HTTP/1.0" 202 Accepted 2026-04-02 14:40:01,228 - lava_callback - INFO - Starting async job submit for node 69cbdcb62a64fa9aff937f3b 2026-04-02 14:40:01,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:01,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdcb62a64fa9aff937f3b HTTP/1.1" 200 None 2026-04-02 14:40:01,244 - lava_callback - DEBUG - Processing node 69cbdcb62a64fa9aff937f3b: baseline-arm-baylibre 2026-04-02 14:40:01,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdcb62a64fa9aff937f3b 2026-04-02 14:40:01,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:01,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdcb62a64fa9aff937f3b HTTP/1.1" 200 None 2026-04-02 14:40:01,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:01,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:40:01,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:01,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdcb62a64fa9aff937f3b HTTP/1.1" 200 None 2026-04-02 14:40:01,300 - lava_callback - ERROR - Error processing callback for node 69cbdcb62a64fa9aff937f3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39012 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:40:41,142 - lava_callback - INFO - Received callback for node 69cbdcdc2a64fa9aff937f48 INFO: 172.21.0.1:41246 - "POST /node/69cbdcdc2a64fa9aff937f48 HTTP/1.0" 202 Accepted 2026-04-02 14:40:41,148 - lava_callback - INFO - Starting async job submit for node 69cbdcdc2a64fa9aff937f48 2026-04-02 14:40:41,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:41,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdcdc2a64fa9aff937f48 HTTP/1.1" 200 None 2026-04-02 14:40:41,164 - lava_callback - DEBUG - Processing node 69cbdcdc2a64fa9aff937f48: baseline-arm-baylibre 2026-04-02 14:40:41,164 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdcdc2a64fa9aff937f48 2026-04-02 14:40:41,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:41,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdcdc2a64fa9aff937f48 HTTP/1.1" 200 None 2026-04-02 14:40:41,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:41,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:40:41,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:40:41,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdcdc2a64fa9aff937f48 HTTP/1.1" 200 None 2026-04-02 14:40:41,273 - lava_callback - ERROR - Error processing callback for node 69cbdcdc2a64fa9aff937f48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:41:21,237 - lava_callback - INFO - Received callback for node 69cbdd012a64fa9aff937f57 INFO: 172.21.0.1:47434 - "POST /node/69cbdd012a64fa9aff937f57 HTTP/1.0" 202 Accepted 2026-04-02 14:41:21,243 - lava_callback - INFO - Starting async job submit for node 69cbdd012a64fa9aff937f57 2026-04-02 14:41:21,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:41:21,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd012a64fa9aff937f57 HTTP/1.1" 200 None 2026-04-02 14:41:21,274 - lava_callback - DEBUG - Processing node 69cbdd012a64fa9aff937f57: baseline-arm-baylibre 2026-04-02 14:41:21,274 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdd012a64fa9aff937f57 2026-04-02 14:41:21,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:41:21,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd012a64fa9aff937f57 HTTP/1.1" 200 None 2026-04-02 14:41:21,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:41:21,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:41:21,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:41:21,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdd012a64fa9aff937f57 HTTP/1.1" 200 None 2026-04-02 14:41:21,326 - lava_callback - ERROR - Error processing callback for node 69cbdd012a64fa9aff937f57: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39890 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46730 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:42:01,221 - lava_callback - INFO - Received callback for node 69cbdd292a64fa9aff937f62 INFO: 172.21.0.1:56346 - "POST /node/69cbdd292a64fa9aff937f62 HTTP/1.0" 202 Accepted 2026-04-02 14:42:01,226 - lava_callback - INFO - Starting async job submit for node 69cbdd292a64fa9aff937f62 2026-04-02 14:42:01,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:01,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd292a64fa9aff937f62 HTTP/1.1" 200 None 2026-04-02 14:42:01,254 - lava_callback - DEBUG - Processing node 69cbdd292a64fa9aff937f62: baseline-arm-baylibre 2026-04-02 14:42:01,255 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdd292a64fa9aff937f62 2026-04-02 14:42:01,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:01,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd292a64fa9aff937f62 HTTP/1.1" 200 None 2026-04-02 14:42:01,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:01,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:42:01,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:01,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdd292a64fa9aff937f62 HTTP/1.1" 200 None 2026-04-02 14:42:01,328 - lava_callback - ERROR - Error processing callback for node 69cbdd292a64fa9aff937f62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33634 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:42:41,282 - lava_callback - INFO - Received callback for node 69cbdd512a64fa9aff937f70 INFO: 172.21.0.1:42158 - "POST /node/69cbdd512a64fa9aff937f70 HTTP/1.0" 202 Accepted 2026-04-02 14:42:41,288 - lava_callback - INFO - Starting async job submit for node 69cbdd512a64fa9aff937f70 2026-04-02 14:42:41,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:41,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd512a64fa9aff937f70 HTTP/1.1" 200 None 2026-04-02 14:42:41,304 - lava_callback - DEBUG - Processing node 69cbdd512a64fa9aff937f70: baseline-arm-baylibre 2026-04-02 14:42:41,304 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdd512a64fa9aff937f70 2026-04-02 14:42:41,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:41,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd512a64fa9aff937f70 HTTP/1.1" 200 None 2026-04-02 14:42:41,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:41,332 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:42:41,334 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:42:41,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdd512a64fa9aff937f70 HTTP/1.1" 200 None 2026-04-02 14:42:41,359 - lava_callback - ERROR - Error processing callback for node 69cbdd512a64fa9aff937f70: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:43:21,319 - lava_callback - INFO - Received callback for node 69cbdd782a64fa9aff937f80 INFO: 172.21.0.1:38998 - "POST /node/69cbdd782a64fa9aff937f80 HTTP/1.0" 202 Accepted 2026-04-02 14:43:21,325 - lava_callback - INFO - Starting async job submit for node 69cbdd782a64fa9aff937f80 2026-04-02 14:43:21,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:43:21,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd782a64fa9aff937f80 HTTP/1.1" 200 None 2026-04-02 14:43:21,341 - lava_callback - DEBUG - Processing node 69cbdd782a64fa9aff937f80: baseline-arm-baylibre 2026-04-02 14:43:21,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdd782a64fa9aff937f80 2026-04-02 14:43:21,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:43:21,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdd782a64fa9aff937f80 HTTP/1.1" 200 None 2026-04-02 14:43:21,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:43:21,368 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:43:21,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:43:21,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdd782a64fa9aff937f80 HTTP/1.1" 200 None 2026-04-02 14:43:21,396 - lava_callback - ERROR - Error processing callback for node 69cbdd782a64fa9aff937f80: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45020 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:45:26,101 - lava_callback - INFO - Received callback for node 69cbddf12a64fa9aff937fac INFO: 172.21.0.1:53878 - "POST /node/69cbddf12a64fa9aff937fac HTTP/1.0" 202 Accepted 2026-04-02 14:45:26,107 - lava_callback - INFO - Starting async job submit for node 69cbddf12a64fa9aff937fac 2026-04-02 14:45:26,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:45:26,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbddf12a64fa9aff937fac HTTP/1.1" 200 None 2026-04-02 14:45:26,123 - lava_callback - DEBUG - Processing node 69cbddf12a64fa9aff937fac: baseline-arm-clabbe 2026-04-02 14:45:26,124 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbddf12a64fa9aff937fac 2026-04-02 14:45:26,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:45:26,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbddf12a64fa9aff937fac HTTP/1.1" 200 None 2026-04-02 14:45:26,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:45:26,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:45:26,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:45:26,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbddf12a64fa9aff937fac HTTP/1.1" 200 None 2026-04-02 14:45:26,194 - lava_callback - ERROR - Error processing callback for node 69cbddf12a64fa9aff937fac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:46:06,049 - lava_callback - INFO - Received callback for node 69cbde1b2a64fa9aff937fb9 INFO: 172.21.0.1:35266 - "POST /node/69cbde1b2a64fa9aff937fb9 HTTP/1.0" 202 Accepted 2026-04-02 14:46:06,054 - lava_callback - INFO - Starting async job submit for node 69cbde1b2a64fa9aff937fb9 2026-04-02 14:46:06,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:06,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde1b2a64fa9aff937fb9 HTTP/1.1" 200 None 2026-04-02 14:46:06,070 - lava_callback - DEBUG - Processing node 69cbde1b2a64fa9aff937fb9: baseline-arm-clabbe 2026-04-02 14:46:06,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbde1b2a64fa9aff937fb9 2026-04-02 14:46:06,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:06,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde1b2a64fa9aff937fb9 HTTP/1.1" 200 None 2026-04-02 14:46:06,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:06,098 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:46:06,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:06,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbde1b2a64fa9aff937fb9 HTTP/1.1" 200 None 2026-04-02 14:46:06,121 - lava_callback - ERROR - Error processing callback for node 69cbde1b2a64fa9aff937fb9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48100 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:46:46,128 - lava_callback - INFO - Received callback for node 69cbde432a64fa9aff937fcc INFO: 172.21.0.1:56336 - "POST /node/69cbde432a64fa9aff937fcc HTTP/1.0" 202 Accepted 2026-04-02 14:46:46,133 - lava_callback - INFO - Starting async job submit for node 69cbde432a64fa9aff937fcc 2026-04-02 14:46:46,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:46,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde432a64fa9aff937fcc HTTP/1.1" 200 None 2026-04-02 14:46:46,149 - lava_callback - DEBUG - Processing node 69cbde432a64fa9aff937fcc: baseline-arm-clabbe 2026-04-02 14:46:46,149 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbde432a64fa9aff937fcc 2026-04-02 14:46:46,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:46,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde432a64fa9aff937fcc HTTP/1.1" 200 None 2026-04-02 14:46:46,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:46,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:46:46,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:46:46,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbde432a64fa9aff937fcc HTTP/1.1" 200 None 2026-04-02 14:46:46,202 - lava_callback - ERROR - Error processing callback for node 69cbde432a64fa9aff937fcc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50314 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:47:26,253 - lava_callback - INFO - Received callback for node 69cbde6a2a64fa9aff937fd6 INFO: 172.21.0.1:53406 - "POST /node/69cbde6a2a64fa9aff937fd6 HTTP/1.0" 202 Accepted 2026-04-02 14:47:26,258 - lava_callback - INFO - Starting async job submit for node 69cbde6a2a64fa9aff937fd6 2026-04-02 14:47:26,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:47:26,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde6a2a64fa9aff937fd6 HTTP/1.1" 200 None 2026-04-02 14:47:26,274 - lava_callback - DEBUG - Processing node 69cbde6a2a64fa9aff937fd6: baseline-arm-clabbe 2026-04-02 14:47:26,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbde6a2a64fa9aff937fd6 2026-04-02 14:47:26,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:47:26,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde6a2a64fa9aff937fd6 HTTP/1.1" 200 None 2026-04-02 14:47:26,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:47:26,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:47:26,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:47:26,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbde6a2a64fa9aff937fd6 HTTP/1.1" 200 None 2026-04-02 14:47:26,331 - lava_callback - ERROR - Error processing callback for node 69cbde6a2a64fa9aff937fd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58938 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:48:06,202 - lava_callback - INFO - Received callback for node 69cbde912a64fa9aff937fe3 INFO: 172.21.0.1:50542 - "POST /node/69cbde912a64fa9aff937fe3 HTTP/1.0" 202 Accepted 2026-04-02 14:48:06,208 - lava_callback - INFO - Starting async job submit for node 69cbde912a64fa9aff937fe3 2026-04-02 14:48:06,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:06,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde912a64fa9aff937fe3 HTTP/1.1" 200 None 2026-04-02 14:48:06,224 - lava_callback - DEBUG - Processing node 69cbde912a64fa9aff937fe3: baseline-arm-clabbe 2026-04-02 14:48:06,224 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbde912a64fa9aff937fe3 2026-04-02 14:48:06,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:06,244 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbde912a64fa9aff937fe3 HTTP/1.1" 200 None 2026-04-02 14:48:06,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:06,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb83422a64fa9aff9368ff HTTP/1.1" 200 None 2026-04-02 14:48:06,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:06,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbde912a64fa9aff937fe3 HTTP/1.1" 200 None 2026-04-02 14:48:06,291 - lava_callback - ERROR - Error processing callback for node 69cbde912a64fa9aff937fe3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40800 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:48:21,557 - lava_callback - INFO - Received callback for node 69cbdeb12a64fa9aff937fef INFO: 172.21.0.1:41426 - "POST /node/69cbdeb12a64fa9aff937fef HTTP/1.0" 202 Accepted 2026-04-02 14:48:21,563 - lava_callback - INFO - Starting async job submit for node 69cbdeb12a64fa9aff937fef 2026-04-02 14:48:21,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:21,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdeb12a64fa9aff937fef HTTP/1.1" 200 None 2026-04-02 14:48:21,578 - lava_callback - DEBUG - Processing node 69cbdeb12a64fa9aff937fef: baseline-arm-baylibre 2026-04-02 14:48:21,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdeb12a64fa9aff937fef 2026-04-02 14:48:21,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:21,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdeb12a64fa9aff937fef HTTP/1.1" 200 None 2026-04-02 14:48:21,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:21,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:48:21,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:48:21,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdeb12a64fa9aff937fef HTTP/1.1" 200 None 2026-04-02 14:48:21,656 - lava_callback - ERROR - Error processing callback for node 69cbdeb12a64fa9aff937fef: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:49:01,613 - lava_callback - INFO - Received callback for node 69cbded82a64fa9aff937ffa INFO: 172.21.0.1:55828 - "POST /node/69cbded82a64fa9aff937ffa HTTP/1.0" 202 Accepted 2026-04-02 14:49:01,619 - lava_callback - INFO - Starting async job submit for node 69cbded82a64fa9aff937ffa 2026-04-02 14:49:01,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:01,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbded82a64fa9aff937ffa HTTP/1.1" 200 None 2026-04-02 14:49:01,635 - lava_callback - DEBUG - Processing node 69cbded82a64fa9aff937ffa: baseline-arm-baylibre 2026-04-02 14:49:01,635 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbded82a64fa9aff937ffa 2026-04-02 14:49:01,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:01,649 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbded82a64fa9aff937ffa HTTP/1.1" 200 None 2026-04-02 14:49:01,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:01,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:49:01,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:01,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbded82a64fa9aff937ffa HTTP/1.1" 200 None 2026-04-02 14:49:01,699 - lava_callback - ERROR - Error processing callback for node 69cbded82a64fa9aff937ffa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35708 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:49:41,773 - lava_callback - INFO - Received callback for node 69cbdefe2a64fa9aff938005 INFO: 172.21.0.1:54332 - "POST /node/69cbdefe2a64fa9aff938005 HTTP/1.0" 202 Accepted 2026-04-02 14:49:41,778 - lava_callback - INFO - Starting async job submit for node 69cbdefe2a64fa9aff938005 2026-04-02 14:49:41,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:41,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdefe2a64fa9aff938005 HTTP/1.1" 200 None 2026-04-02 14:49:41,794 - lava_callback - DEBUG - Processing node 69cbdefe2a64fa9aff938005: baseline-arm-baylibre 2026-04-02 14:49:41,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdefe2a64fa9aff938005 2026-04-02 14:49:41,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:41,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdefe2a64fa9aff938005 HTTP/1.1" 200 None 2026-04-02 14:49:41,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:41,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:49:41,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:49:41,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdefe2a64fa9aff938005 HTTP/1.1" 200 None 2026-04-02 14:49:41,858 - lava_callback - ERROR - Error processing callback for node 69cbdefe2a64fa9aff938005: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48804 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:50:21,623 - lava_callback - INFO - Received callback for node 69cbdf252a64fa9aff938012 INFO: 172.21.0.1:33672 - "POST /node/69cbdf252a64fa9aff938012 HTTP/1.0" 202 Accepted 2026-04-02 14:50:21,628 - lava_callback - INFO - Starting async job submit for node 69cbdf252a64fa9aff938012 2026-04-02 14:50:21,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:50:21,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf252a64fa9aff938012 HTTP/1.1" 200 None 2026-04-02 14:50:21,644 - lava_callback - DEBUG - Processing node 69cbdf252a64fa9aff938012: baseline-arm-baylibre 2026-04-02 14:50:21,644 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdf252a64fa9aff938012 2026-04-02 14:50:21,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:50:21,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf252a64fa9aff938012 HTTP/1.1" 200 None 2026-04-02 14:50:21,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:50:21,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:50:21,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:50:21,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdf252a64fa9aff938012 HTTP/1.1" 200 None 2026-04-02 14:50:21,694 - lava_callback - ERROR - Error processing callback for node 69cbdf252a64fa9aff938012: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34236 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:51:01,848 - lava_callback - INFO - Received callback for node 69cbdf4c2a64fa9aff938020 INFO: 172.21.0.1:57960 - "POST /node/69cbdf4c2a64fa9aff938020 HTTP/1.0" 202 Accepted 2026-04-02 14:51:01,854 - lava_callback - INFO - Starting async job submit for node 69cbdf4c2a64fa9aff938020 2026-04-02 14:51:01,855 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:01,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf4c2a64fa9aff938020 HTTP/1.1" 200 None 2026-04-02 14:51:01,870 - lava_callback - DEBUG - Processing node 69cbdf4c2a64fa9aff938020: baseline-arm-baylibre 2026-04-02 14:51:01,871 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdf4c2a64fa9aff938020 2026-04-02 14:51:01,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:01,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf4c2a64fa9aff938020 HTTP/1.1" 200 None 2026-04-02 14:51:01,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:01,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:51:01,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:01,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdf4c2a64fa9aff938020 HTTP/1.1" 200 None 2026-04-02 14:51:01,928 - lava_callback - ERROR - Error processing callback for node 69cbdf4c2a64fa9aff938020: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39432 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:51:41,692 - lava_callback - INFO - Received callback for node 69cbdf712a64fa9aff93802c INFO: 172.21.0.1:54496 - "POST /node/69cbdf712a64fa9aff93802c HTTP/1.0" 202 Accepted 2026-04-02 14:51:41,697 - lava_callback - INFO - Starting async job submit for node 69cbdf712a64fa9aff93802c 2026-04-02 14:51:41,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:41,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf712a64fa9aff93802c HTTP/1.1" 200 None 2026-04-02 14:51:41,714 - lava_callback - DEBUG - Processing node 69cbdf712a64fa9aff93802c: baseline-arm-baylibre 2026-04-02 14:51:41,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdf712a64fa9aff93802c 2026-04-02 14:51:41,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:41,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf712a64fa9aff93802c HTTP/1.1" 200 None 2026-04-02 14:51:41,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:41,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:51:41,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:51:41,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdf712a64fa9aff93802c HTTP/1.1" 200 None 2026-04-02 14:51:41,772 - lava_callback - ERROR - Error processing callback for node 69cbdf712a64fa9aff93802c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37682 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:52:21,801 - lava_callback - INFO - Received callback for node 69cbdf982a64fa9aff938039 INFO: 172.21.0.1:55882 - "POST /node/69cbdf982a64fa9aff938039 HTTP/1.0" 202 Accepted 2026-04-02 14:52:21,807 - lava_callback - INFO - Starting async job submit for node 69cbdf982a64fa9aff938039 2026-04-02 14:52:21,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:52:21,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf982a64fa9aff938039 HTTP/1.1" 200 None 2026-04-02 14:52:21,823 - lava_callback - DEBUG - Processing node 69cbdf982a64fa9aff938039: baseline-arm-baylibre 2026-04-02 14:52:21,823 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdf982a64fa9aff938039 2026-04-02 14:52:21,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:52:21,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdf982a64fa9aff938039 HTTP/1.1" 200 None 2026-04-02 14:52:21,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:52:21,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:52:21,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:52:21,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdf982a64fa9aff938039 HTTP/1.1" 200 None 2026-04-02 14:52:21,884 - lava_callback - ERROR - Error processing callback for node 69cbdf982a64fa9aff938039: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39124 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:53:06,477 - lava_callback - INFO - Received callback for node 69cbdfbf2a64fa9aff938046 INFO: 172.21.0.1:47528 - "POST /node/69cbdfbf2a64fa9aff938046 HTTP/1.0" 202 Accepted 2026-04-02 14:53:06,483 - lava_callback - INFO - Starting async job submit for node 69cbdfbf2a64fa9aff938046 2026-04-02 14:53:06,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:53:06,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdfbf2a64fa9aff938046 HTTP/1.1" 200 None 2026-04-02 14:53:06,500 - lava_callback - DEBUG - Processing node 69cbdfbf2a64fa9aff938046: baseline-arm-clabbe 2026-04-02 14:53:06,500 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbdfbf2a64fa9aff938046 2026-04-02 14:53:06,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:53:06,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbdfbf2a64fa9aff938046 HTTP/1.1" 200 None 2026-04-02 14:53:06,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:47536 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:53:06,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:53:06,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:53:06,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbdfbf2a64fa9aff938046 HTTP/1.1" 200 None 2026-04-02 14:53:06,574 - lava_callback - ERROR - Error processing callback for node 69cbdfbf2a64fa9aff938046: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:54:06,495 - lava_callback - INFO - Received callback for node 69cbe00a2a64fa9aff938061 INFO: 172.21.0.1:55814 - "POST /node/69cbe00a2a64fa9aff938061 HTTP/1.0" 202 Accepted 2026-04-02 14:54:06,500 - lava_callback - INFO - Starting async job submit for node 69cbe00a2a64fa9aff938061 2026-04-02 14:54:06,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:55822 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:54:06,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe00a2a64fa9aff938061 HTTP/1.1" 200 None 2026-04-02 14:54:06,526 - lava_callback - DEBUG - Processing node 69cbe00a2a64fa9aff938061: baseline-arm-clabbe 2026-04-02 14:54:06,526 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe00a2a64fa9aff938061 2026-04-02 14:54:06,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:06,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe00a2a64fa9aff938061 HTTP/1.1" 200 None 2026-04-02 14:54:06,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:06,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:54:06,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:06,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe00a2a64fa9aff938061 HTTP/1.1" 200 None 2026-04-02 14:54:06,584 - lava_callback - ERROR - Error processing callback for node 69cbe00a2a64fa9aff938061: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51474 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41490 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:54:46,467 - lava_callback - INFO - Received callback for node 69cbe02f2a64fa9aff93806b INFO: 172.21.0.1:34836 - "POST /node/69cbe02f2a64fa9aff93806b HTTP/1.0" 202 Accepted 2026-04-02 14:54:46,473 - lava_callback - INFO - Starting async job submit for node 69cbe02f2a64fa9aff93806b 2026-04-02 14:54:46,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:46,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe02f2a64fa9aff93806b HTTP/1.1" 200 None 2026-04-02 14:54:46,490 - lava_callback - DEBUG - Processing node 69cbe02f2a64fa9aff93806b: baseline-arm-clabbe 2026-04-02 14:54:46,491 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe02f2a64fa9aff93806b 2026-04-02 14:54:46,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:46,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe02f2a64fa9aff93806b HTTP/1.1" 200 None 2026-04-02 14:54:46,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:54:46,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:54:46,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:54:46,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe02f2a64fa9aff93806b HTTP/1.1" 200 None 2026-04-02 14:54:46,556 - lava_callback - ERROR - Error processing callback for node 69cbe02f2a64fa9aff93806b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46020 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:55:41,964 - lava_callback - INFO - Received callback for node 69cbe0582a64fa9aff93807b INFO: 172.21.0.1:58732 - "POST /node/69cbe0582a64fa9aff93807b HTTP/1.0" 202 Accepted 2026-04-02 14:55:41,970 - lava_callback - INFO - Starting async job submit for node 69cbe0582a64fa9aff93807b 2026-04-02 14:55:41,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:55:41,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0582a64fa9aff93807b HTTP/1.1" 200 None 2026-04-02 14:55:41,989 - lava_callback - DEBUG - Processing node 69cbe0582a64fa9aff93807b: baseline-arm-baylibre 2026-04-02 14:55:41,989 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe0582a64fa9aff93807b 2026-04-02 14:55:41,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:55:42,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0582a64fa9aff93807b HTTP/1.1" 200 None 2026-04-02 14:55:42,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:55:42,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:55:42,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:55:42,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe0582a64fa9aff93807b HTTP/1.1" 200 None 2026-04-02 14:55:42,131 - lava_callback - ERROR - Error processing callback for node 69cbe0582a64fa9aff93807b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58842 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:56:06,543 - lava_callback - INFO - Received callback for node 69cbe0812a64fa9aff938099 INFO: 172.21.0.1:58852 - "POST /node/69cbe0812a64fa9aff938099 HTTP/1.0" 202 Accepted 2026-04-02 14:56:06,548 - lava_callback - INFO - Starting async job submit for node 69cbe0812a64fa9aff938099 2026-04-02 14:56:06,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:06,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0812a64fa9aff938099 HTTP/1.1" 200 None 2026-04-02 14:56:06,564 - lava_callback - DEBUG - Processing node 69cbe0812a64fa9aff938099: baseline-arm-clabbe 2026-04-02 14:56:06,565 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe0812a64fa9aff938099 2026-04-02 14:56:06,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:06,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0812a64fa9aff938099 HTTP/1.1" 200 None 2026-04-02 14:56:06,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:06,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:56:06,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:06,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe0812a64fa9aff938099 HTTP/1.1" 200 None 2026-04-02 14:56:06,617 - lava_callback - ERROR - Error processing callback for node 69cbe0812a64fa9aff938099: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:56:46,569 - lava_callback - INFO - Received callback for node 69cbe0a72a64fa9aff9380ad INFO: 172.21.0.1:33734 - "POST /node/69cbe0a72a64fa9aff9380ad HTTP/1.0" 202 Accepted 2026-04-02 14:56:46,575 - lava_callback - INFO - Starting async job submit for node 69cbe0a72a64fa9aff9380ad 2026-04-02 14:56:46,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:46,590 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0a72a64fa9aff9380ad HTTP/1.1" 200 None 2026-04-02 14:56:46,591 - lava_callback - DEBUG - Processing node 69cbe0a72a64fa9aff9380ad: baseline-arm-clabbe 2026-04-02 14:56:46,591 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe0a72a64fa9aff9380ad 2026-04-02 14:56:46,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:46,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0a72a64fa9aff9380ad HTTP/1.1" 200 None 2026-04-02 14:56:46,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:46,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:56:46,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:56:46,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe0a72a64fa9aff9380ad HTTP/1.1" 200 None 2026-04-02 14:56:46,645 - lava_callback - ERROR - Error processing callback for node 69cbe0a72a64fa9aff9380ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41398 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:57:26,637 - lava_callback - INFO - Received callback for node 69cbe0d02a64fa9aff9380cc INFO: 172.21.0.1:41402 - "POST /node/69cbe0d02a64fa9aff9380cc HTTP/1.0" 202 Accepted 2026-04-02 14:57:26,643 - lava_callback - INFO - Starting async job submit for node 69cbe0d02a64fa9aff9380cc 2026-04-02 14:57:26,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:57:26,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0d02a64fa9aff9380cc HTTP/1.1" 200 None 2026-04-02 14:57:26,662 - lava_callback - DEBUG - Processing node 69cbe0d02a64fa9aff9380cc: baseline-arm-clabbe 2026-04-02 14:57:26,662 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe0d02a64fa9aff9380cc 2026-04-02 14:57:26,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:57:26,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0d02a64fa9aff9380cc HTTP/1.1" 200 None 2026-04-02 14:57:26,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:57:26,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:57:26,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:57:26,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe0d02a64fa9aff9380cc HTTP/1.1" 200 None 2026-04-02 14:57:26,723 - lava_callback - ERROR - Error processing callback for node 69cbe0d02a64fa9aff9380cc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53384 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:58:06,631 - lava_callback - INFO - Received callback for node 69cbe0f52a64fa9aff9380dc INFO: 172.21.0.1:53392 - "POST /node/69cbe0f52a64fa9aff9380dc HTTP/1.0" 202 Accepted 2026-04-02 14:58:06,636 - lava_callback - INFO - Starting async job submit for node 69cbe0f52a64fa9aff9380dc 2026-04-02 14:58:06,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:06,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0f52a64fa9aff9380dc HTTP/1.1" 200 None 2026-04-02 14:58:06,652 - lava_callback - DEBUG - Processing node 69cbe0f52a64fa9aff9380dc: baseline-arm-clabbe 2026-04-02 14:58:06,652 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe0f52a64fa9aff9380dc 2026-04-02 14:58:06,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:06,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe0f52a64fa9aff9380dc HTTP/1.1" 200 None 2026-04-02 14:58:06,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:06,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:58:06,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:06,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe0f52a64fa9aff9380dc HTTP/1.1" 200 None 2026-04-02 14:58:06,705 - lava_callback - ERROR - Error processing callback for node 69cbe0f52a64fa9aff9380dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:58:46,690 - lava_callback - INFO - Received callback for node 69cbe11c2a64fa9aff9380e7 INFO: 172.21.0.1:49628 - "POST /node/69cbe11c2a64fa9aff9380e7 HTTP/1.0" 202 Accepted 2026-04-02 14:58:46,695 - lava_callback - INFO - Starting async job submit for node 69cbe11c2a64fa9aff9380e7 2026-04-02 14:58:46,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:46,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe11c2a64fa9aff9380e7 HTTP/1.1" 200 None 2026-04-02 14:58:46,712 - lava_callback - DEBUG - Processing node 69cbe11c2a64fa9aff9380e7: baseline-arm-clabbe 2026-04-02 14:58:46,712 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe11c2a64fa9aff9380e7 2026-04-02 14:58:46,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:46,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe11c2a64fa9aff9380e7 HTTP/1.1" 200 None 2026-04-02 14:58:46,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:46,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:58:46,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:58:46,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe11c2a64fa9aff9380e7 HTTP/1.1" 200 None 2026-04-02 14:58:46,782 - lava_callback - ERROR - Error processing callback for node 69cbe11c2a64fa9aff9380e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK 2026-04-02 14:59:26,659 - lava_callback - INFO - Received callback for node 69cbe1402a64fa9aff9380f2 INFO: 172.21.0.1:37210 - "POST /node/69cbe1402a64fa9aff9380f2 HTTP/1.0" 202 Accepted 2026-04-02 14:59:26,664 - lava_callback - INFO - Starting async job submit for node 69cbe1402a64fa9aff9380f2 2026-04-02 14:59:26,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:59:26,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1402a64fa9aff9380f2 HTTP/1.1" 200 None 2026-04-02 14:59:26,681 - lava_callback - DEBUG - Processing node 69cbe1402a64fa9aff9380f2: baseline-arm-clabbe 2026-04-02 14:59:26,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe1402a64fa9aff9380f2 2026-04-02 14:59:26,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:59:26,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1402a64fa9aff9380f2 HTTP/1.1" 200 None 2026-04-02 14:59:26,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:59:26,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 14:59:26,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 14:59:26,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe1402a64fa9aff9380f2 HTTP/1.1" 200 None 2026-04-02 14:59:26,763 - lava_callback - ERROR - Error processing callback for node 69cbe1402a64fa9aff9380f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:00:02,183 - lava_callback - INFO - Received callback for node 69cbe15f2a64fa9aff9380fb INFO: 172.21.0.1:59122 - "POST /node/69cbe15f2a64fa9aff9380fb HTTP/1.0" 202 Accepted 2026-04-02 15:00:02,189 - lava_callback - INFO - Starting async job submit for node 69cbe15f2a64fa9aff9380fb 2026-04-02 15:00:02,190 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:02,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe15f2a64fa9aff9380fb HTTP/1.1" 200 None 2026-04-02 15:00:02,230 - lava_callback - DEBUG - Processing node 69cbe15f2a64fa9aff9380fb: baseline-arm-baylibre 2026-04-02 15:00:02,231 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe15f2a64fa9aff9380fb 2026-04-02 15:00:02,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:02,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe15f2a64fa9aff9380fb HTTP/1.1" 200 None 2026-04-02 15:00:02,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:02,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:00:02,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:02,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe15f2a64fa9aff9380fb HTTP/1.1" 200 None 2026-04-02 15:00:02,293 - lava_callback - ERROR - Error processing callback for node 69cbe15f2a64fa9aff9380fb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45694 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52350 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:00:46,765 - lava_callback - INFO - Received callback for node 69cbe1892a64fa9aff93810c INFO: 172.21.0.1:52354 - "POST /node/69cbe1892a64fa9aff93810c HTTP/1.0" 202 Accepted 2026-04-02 15:00:46,770 - lava_callback - INFO - Starting async job submit for node 69cbe1892a64fa9aff93810c 2026-04-02 15:00:46,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:46,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1892a64fa9aff93810c HTTP/1.1" 200 None 2026-04-02 15:00:46,789 - lava_callback - DEBUG - Processing node 69cbe1892a64fa9aff93810c: baseline-arm-clabbe 2026-04-02 15:00:46,789 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe1892a64fa9aff93810c 2026-04-02 15:00:46,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:46,804 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1892a64fa9aff93810c HTTP/1.1" 200 None 2026-04-02 15:00:46,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:46,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dfeb6a4c026e16347d36 HTTP/1.1" 200 None 2026-04-02 15:00:46,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:00:46,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe1892a64fa9aff93810c HTTP/1.1" 200 None 2026-04-02 15:00:46,846 - lava_callback - ERROR - Error processing callback for node 69cbe1892a64fa9aff93810c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59456 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:01:02,269 - lava_callback - INFO - Received callback for node 69cbe1ab2a64fa9aff938117 INFO: 172.21.0.1:35740 - "POST /node/69cbe1ab2a64fa9aff938117 HTTP/1.0" 202 Accepted 2026-04-02 15:01:02,275 - lava_callback - INFO - Starting async job submit for node 69cbe1ab2a64fa9aff938117 2026-04-02 15:01:02,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:02,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1ab2a64fa9aff938117 HTTP/1.1" 200 None 2026-04-02 15:01:02,295 - lava_callback - DEBUG - Processing node 69cbe1ab2a64fa9aff938117: baseline-arm-baylibre 2026-04-02 15:01:02,296 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe1ab2a64fa9aff938117 2026-04-02 15:01:02,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:02,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1ab2a64fa9aff938117 HTTP/1.1" 200 None 2026-04-02 15:01:02,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:02,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:01:02,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:02,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe1ab2a64fa9aff938117 HTTP/1.1" 200 None 2026-04-02 15:01:02,352 - lava_callback - ERROR - Error processing callback for node 69cbe1ab2a64fa9aff938117: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:01:42,289 - lava_callback - INFO - Received callback for node 69cbe1d22a64fa9aff938123 INFO: 172.21.0.1:42184 - "POST /node/69cbe1d22a64fa9aff938123 HTTP/1.0" 202 Accepted 2026-04-02 15:01:42,295 - lava_callback - INFO - Starting async job submit for node 69cbe1d22a64fa9aff938123 2026-04-02 15:01:42,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:42,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1d22a64fa9aff938123 HTTP/1.1" 200 None 2026-04-02 15:01:42,312 - lava_callback - DEBUG - Processing node 69cbe1d22a64fa9aff938123: baseline-arm-baylibre 2026-04-02 15:01:42,312 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe1d22a64fa9aff938123 2026-04-02 15:01:42,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:42,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1d22a64fa9aff938123 HTTP/1.1" 200 None 2026-04-02 15:01:42,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:42,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:01:42,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:01:42,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe1d22a64fa9aff938123 HTTP/1.1" 200 None 2026-04-02 15:01:42,373 - lava_callback - ERROR - Error processing callback for node 69cbe1d22a64fa9aff938123: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49928 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49932 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:02:22,284 - lava_callback - INFO - Received callback for node 69cbe1fa2a64fa9aff93812d INFO: 172.21.0.1:40770 - "POST /node/69cbe1fa2a64fa9aff93812d HTTP/1.0" 202 Accepted 2026-04-02 15:02:22,289 - lava_callback - INFO - Starting async job submit for node 69cbe1fa2a64fa9aff93812d 2026-04-02 15:02:22,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:02:22,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1fa2a64fa9aff93812d HTTP/1.1" 200 None 2026-04-02 15:02:22,305 - lava_callback - DEBUG - Processing node 69cbe1fa2a64fa9aff93812d: baseline-arm-baylibre 2026-04-02 15:02:22,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe1fa2a64fa9aff93812d 2026-04-02 15:02:22,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:02:22,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe1fa2a64fa9aff93812d HTTP/1.1" 200 None 2026-04-02 15:02:22,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:02:22,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:02:22,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:02:22,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe1fa2a64fa9aff93812d HTTP/1.1" 200 None 2026-04-02 15:02:22,376 - lava_callback - ERROR - Error processing callback for node 69cbe1fa2a64fa9aff93812d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33686 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:03:02,369 - lava_callback - INFO - Received callback for node 69cbe2232a64fa9aff93813b INFO: 172.21.0.1:57748 - "POST /node/69cbe2232a64fa9aff93813b HTTP/1.0" 202 Accepted 2026-04-02 15:03:02,374 - lava_callback - INFO - Starting async job submit for node 69cbe2232a64fa9aff93813b 2026-04-02 15:03:02,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:02,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2232a64fa9aff93813b HTTP/1.1" 200 None 2026-04-02 15:03:02,392 - lava_callback - DEBUG - Processing node 69cbe2232a64fa9aff93813b: baseline-arm-baylibre 2026-04-02 15:03:02,392 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe2232a64fa9aff93813b 2026-04-02 15:03:02,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:02,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2232a64fa9aff93813b HTTP/1.1" 200 None 2026-04-02 15:03:02,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:02,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:03:02,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:02,448 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe2232a64fa9aff93813b HTTP/1.1" 200 None 2026-04-02 15:03:02,454 - lava_callback - ERROR - Error processing callback for node 69cbe2232a64fa9aff93813b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51054 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:03:42,374 - lava_callback - INFO - Received callback for node 69cbe24c2a64fa9aff938145 INFO: 172.21.0.1:36940 - "POST /node/69cbe24c2a64fa9aff938145 HTTP/1.0" 202 Accepted 2026-04-02 15:03:42,379 - lava_callback - INFO - Starting async job submit for node 69cbe24c2a64fa9aff938145 2026-04-02 15:03:42,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:42,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe24c2a64fa9aff938145 HTTP/1.1" 200 None 2026-04-02 15:03:42,395 - lava_callback - DEBUG - Processing node 69cbe24c2a64fa9aff938145: baseline-arm-baylibre 2026-04-02 15:03:42,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe24c2a64fa9aff938145 2026-04-02 15:03:42,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:42,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe24c2a64fa9aff938145 HTTP/1.1" 200 None 2026-04-02 15:03:42,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:42,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:03:42,425 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:03:42,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe24c2a64fa9aff938145 HTTP/1.1" 200 None 2026-04-02 15:03:42,457 - lava_callback - ERROR - Error processing callback for node 69cbe24c2a64fa9aff938145: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53478 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:04:26,932 - lava_callback - INFO - Received callback for node 69cbe2752a64fa9aff938152 INFO: 172.21.0.1:53480 - "POST /node/69cbe2752a64fa9aff938152 HTTP/1.0" 202 Accepted 2026-04-02 15:04:26,939 - lava_callback - INFO - Starting async job submit for node 69cbe2752a64fa9aff938152 2026-04-02 15:04:26,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:04:26,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2752a64fa9aff938152 HTTP/1.1" 200 None 2026-04-02 15:04:26,956 - lava_callback - DEBUG - Processing node 69cbe2752a64fa9aff938152: baseline-arm-clabbe 2026-04-02 15:04:26,956 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe2752a64fa9aff938152 2026-04-02 15:04:26,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:04:26,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2752a64fa9aff938152 HTTP/1.1" 200 None 2026-04-02 15:04:26,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:04:26,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:04:26,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:04:27,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe2752a64fa9aff938152 HTTP/1.1" 200 None 2026-04-02 15:04:27,023 - lava_callback - ERROR - Error processing callback for node 69cbe2752a64fa9aff938152: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:05:02,442 - lava_callback - INFO - Received callback for node 69cbe2982a64fa9aff93815f INFO: 172.21.0.1:49132 - "POST /node/69cbe2982a64fa9aff93815f HTTP/1.0" 202 Accepted 2026-04-02 15:05:02,447 - lava_callback - INFO - Starting async job submit for node 69cbe2982a64fa9aff93815f 2026-04-02 15:05:02,448 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:02,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2982a64fa9aff93815f HTTP/1.1" 200 None 2026-04-02 15:05:02,464 - lava_callback - DEBUG - Processing node 69cbe2982a64fa9aff93815f: baseline-arm-baylibre 2026-04-02 15:05:02,464 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe2982a64fa9aff93815f 2026-04-02 15:05:02,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:02,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2982a64fa9aff93815f HTTP/1.1" 200 None 2026-04-02 15:05:02,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:02,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:05:02,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:02,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe2982a64fa9aff93815f HTTP/1.1" 200 None 2026-04-02 15:05:02,540 - lava_callback - ERROR - Error processing callback for node 69cbe2982a64fa9aff93815f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54242 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:05:42,437 - lava_callback - INFO - Received callback for node 69cbe2bf2a64fa9aff938169 INFO: 172.21.0.1:41986 - "POST /node/69cbe2bf2a64fa9aff938169 HTTP/1.0" 202 Accepted 2026-04-02 15:05:42,442 - lava_callback - INFO - Starting async job submit for node 69cbe2bf2a64fa9aff938169 2026-04-02 15:05:42,444 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:42,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2bf2a64fa9aff938169 HTTP/1.1" 200 None 2026-04-02 15:05:42,458 - lava_callback - DEBUG - Processing node 69cbe2bf2a64fa9aff938169: baseline-arm-baylibre 2026-04-02 15:05:42,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe2bf2a64fa9aff938169 2026-04-02 15:05:42,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:42,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2bf2a64fa9aff938169 HTTP/1.1" 200 None 2026-04-02 15:05:42,474 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:42,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:05:42,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:05:42,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe2bf2a64fa9aff938169 HTTP/1.1" 200 None 2026-04-02 15:05:42,514 - lava_callback - ERROR - Error processing callback for node 69cbe2bf2a64fa9aff938169: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:06:27,014 - lava_callback - INFO - Received callback for node 69cbe2ec2a64fa9aff938172 INFO: 172.21.0.1:56688 - "POST /node/69cbe2ec2a64fa9aff938172 HTTP/1.0" 202 Accepted 2026-04-02 15:06:27,020 - lava_callback - INFO - Starting async job submit for node 69cbe2ec2a64fa9aff938172 2026-04-02 15:06:27,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:06:27,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2ec2a64fa9aff938172 HTTP/1.1" 200 None 2026-04-02 15:06:27,037 - lava_callback - DEBUG - Processing node 69cbe2ec2a64fa9aff938172: baseline-arm-clabbe 2026-04-02 15:06:27,038 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe2ec2a64fa9aff938172 2026-04-02 15:06:27,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:06:27,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe2ec2a64fa9aff938172 HTTP/1.1" 200 None 2026-04-02 15:06:27,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:06:27,082 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:06:27,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:06:27,107 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe2ec2a64fa9aff938172 HTTP/1.1" 200 None 2026-04-02 15:06:27,109 - lava_callback - ERROR - Error processing callback for node 69cbe2ec2a64fa9aff938172: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54380 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:07:02,525 - lava_callback - INFO - Received callback for node 69cbe30e2a64fa9aff93817f INFO: 172.21.0.1:54896 - "POST /node/69cbe30e2a64fa9aff93817f HTTP/1.0" 202 Accepted 2026-04-02 15:07:02,530 - lava_callback - INFO - Starting async job submit for node 69cbe30e2a64fa9aff93817f 2026-04-02 15:07:02,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:02,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe30e2a64fa9aff93817f HTTP/1.1" 200 None 2026-04-02 15:07:02,547 - lava_callback - DEBUG - Processing node 69cbe30e2a64fa9aff93817f: baseline-arm-baylibre 2026-04-02 15:07:02,547 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe30e2a64fa9aff93817f 2026-04-02 15:07:02,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:02,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe30e2a64fa9aff93817f HTTP/1.1" 200 None 2026-04-02 15:07:02,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:02,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:07:02,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:02,648 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe30e2a64fa9aff93817f HTTP/1.1" 200 None 2026-04-02 15:07:02,654 - lava_callback - ERROR - Error processing callback for node 69cbe30e2a64fa9aff93817f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38104 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:07:42,530 - lava_callback - INFO - Received callback for node 69cbe3342a64fa9aff938187 INFO: 172.21.0.1:51388 - "POST /node/69cbe3342a64fa9aff938187 HTTP/1.0" 202 Accepted 2026-04-02 15:07:42,536 - lava_callback - INFO - Starting async job submit for node 69cbe3342a64fa9aff938187 2026-04-02 15:07:42,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:42,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3342a64fa9aff938187 HTTP/1.1" 200 None 2026-04-02 15:07:42,556 - lava_callback - DEBUG - Processing node 69cbe3342a64fa9aff938187: baseline-arm-baylibre 2026-04-02 15:07:42,556 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe3342a64fa9aff938187 2026-04-02 15:07:42,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:42,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3342a64fa9aff938187 HTTP/1.1" 200 None 2026-04-02 15:07:42,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:42,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:07:42,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:07:42,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe3342a64fa9aff938187 HTTP/1.1" 200 None 2026-04-02 15:07:42,618 - lava_callback - ERROR - Error processing callback for node 69cbe3342a64fa9aff938187: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54082 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:08:22,614 - lava_callback - INFO - Received callback for node 69cbe35d2a64fa9aff938192 INFO: 172.21.0.1:41228 - "POST /node/69cbe35d2a64fa9aff938192 HTTP/1.0" 202 Accepted 2026-04-02 15:08:22,624 - lava_callback - INFO - Starting async job submit for node 69cbe35d2a64fa9aff938192 2026-04-02 15:08:22,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:08:22,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe35d2a64fa9aff938192 HTTP/1.1" 200 None 2026-04-02 15:08:22,642 - lava_callback - DEBUG - Processing node 69cbe35d2a64fa9aff938192: baseline-arm-baylibre 2026-04-02 15:08:22,642 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe35d2a64fa9aff938192 2026-04-02 15:08:22,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:08:22,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe35d2a64fa9aff938192 HTTP/1.1" 200 None 2026-04-02 15:08:22,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:08:22,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:08:22,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:08:22,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe35d2a64fa9aff938192 HTTP/1.1" 200 None 2026-04-02 15:08:22,710 - lava_callback - ERROR - Error processing callback for node 69cbe35d2a64fa9aff938192: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:09:02,618 - lava_callback - INFO - Received callback for node 69cbe3832a64fa9aff93819c INFO: 172.21.0.1:51622 - "POST /node/69cbe3832a64fa9aff93819c HTTP/1.0" 202 Accepted 2026-04-02 15:09:02,623 - lava_callback - INFO - Starting async job submit for node 69cbe3832a64fa9aff93819c 2026-04-02 15:09:02,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:02,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3832a64fa9aff93819c HTTP/1.1" 200 None 2026-04-02 15:09:02,641 - lava_callback - DEBUG - Processing node 69cbe3832a64fa9aff93819c: baseline-arm-baylibre 2026-04-02 15:09:02,641 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe3832a64fa9aff93819c 2026-04-02 15:09:02,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:02,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3832a64fa9aff93819c HTTP/1.1" 200 None 2026-04-02 15:09:02,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:02,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:09:02,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:02,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe3832a64fa9aff93819c HTTP/1.1" 200 None 2026-04-02 15:09:02,699 - lava_callback - ERROR - Error processing callback for node 69cbe3832a64fa9aff93819c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48006 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44566 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:09:47,087 - lava_callback - INFO - Received callback for node 69cbe3b22a64fa9aff9381aa INFO: 172.21.0.1:44572 - "POST /node/69cbe3b22a64fa9aff9381aa HTTP/1.0" 202 Accepted 2026-04-02 15:09:47,093 - lava_callback - INFO - Starting async job submit for node 69cbe3b22a64fa9aff9381aa 2026-04-02 15:09:47,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:47,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3b22a64fa9aff9381aa HTTP/1.1" 200 None 2026-04-02 15:09:47,110 - lava_callback - DEBUG - Processing node 69cbe3b22a64fa9aff9381aa: baseline-arm-clabbe 2026-04-02 15:09:47,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe3b22a64fa9aff9381aa 2026-04-02 15:09:47,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:47,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3b22a64fa9aff9381aa HTTP/1.1" 200 None 2026-04-02 15:09:47,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:47,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:09:47,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:09:47,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe3b22a64fa9aff9381aa HTTP/1.1" 200 None 2026-04-02 15:09:47,190 - lava_callback - ERROR - Error processing callback for node 69cbe3b22a64fa9aff9381aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43916 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:10:22,698 - lava_callback - INFO - Received callback for node 69cbe3d52a64fa9aff9381b3 INFO: 172.21.0.1:52098 - "POST /node/69cbe3d52a64fa9aff9381b3 HTTP/1.0" 202 Accepted 2026-04-02 15:10:22,704 - lava_callback - INFO - Starting async job submit for node 69cbe3d52a64fa9aff9381b3 2026-04-02 15:10:22,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:10:22,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3d52a64fa9aff9381b3 HTTP/1.1" 200 None 2026-04-02 15:10:22,742 - lava_callback - DEBUG - Processing node 69cbe3d52a64fa9aff9381b3: baseline-arm-baylibre 2026-04-02 15:10:22,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe3d52a64fa9aff9381b3 2026-04-02 15:10:22,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:10:22,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3d52a64fa9aff9381b3 HTTP/1.1" 200 None 2026-04-02 15:10:22,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:10:22,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:10:22,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:10:22,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe3d52a64fa9aff9381b3 HTTP/1.1" 200 None 2026-04-02 15:10:22,795 - lava_callback - ERROR - Error processing callback for node 69cbe3d52a64fa9aff9381b3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:11:07,180 - lava_callback - INFO - Received callback for node 69cbe3ff2a64fa9aff9381c4 INFO: 172.21.0.1:53436 - "POST /node/69cbe3ff2a64fa9aff9381c4 HTTP/1.0" 202 Accepted 2026-04-02 15:11:07,187 - lava_callback - INFO - Starting async job submit for node 69cbe3ff2a64fa9aff9381c4 2026-04-02 15:11:07,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:11:07,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3ff2a64fa9aff9381c4 HTTP/1.1" 200 None 2026-04-02 15:11:07,204 - lava_callback - DEBUG - Processing node 69cbe3ff2a64fa9aff9381c4: baseline-arm-clabbe 2026-04-02 15:11:07,205 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe3ff2a64fa9aff9381c4 2026-04-02 15:11:07,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:11:07,219 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe3ff2a64fa9aff9381c4 HTTP/1.1" 200 None 2026-04-02 15:11:07,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:11:07,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:11:07,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:11:07,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe3ff2a64fa9aff9381c4 HTTP/1.1" 200 None 2026-04-02 15:11:07,262 - lava_callback - ERROR - Error processing callback for node 69cbe3ff2a64fa9aff9381c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50158 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50160 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:12:22,772 - lava_callback - INFO - Received callback for node 69cbe44c2a64fa9aff9381d6 INFO: 172.21.0.1:42326 - "POST /node/69cbe44c2a64fa9aff9381d6 HTTP/1.0" 202 Accepted 2026-04-02 15:12:22,777 - lava_callback - INFO - Starting async job submit for node 69cbe44c2a64fa9aff9381d6 2026-04-02 15:12:22,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:12:22,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe44c2a64fa9aff9381d6 HTTP/1.1" 200 None 2026-04-02 15:12:22,794 - lava_callback - DEBUG - Processing node 69cbe44c2a64fa9aff9381d6: baseline-arm-baylibre 2026-04-02 15:12:22,794 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe44c2a64fa9aff9381d6 2026-04-02 15:12:22,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:12:22,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe44c2a64fa9aff9381d6 HTTP/1.1" 200 None 2026-04-02 15:12:22,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:12:22,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:12:22,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:12:22,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe44c2a64fa9aff9381d6 HTTP/1.1" 200 None 2026-04-02 15:12:22,847 - lava_callback - ERROR - Error processing callback for node 69cbe44c2a64fa9aff9381d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47360 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:13:07,287 - lava_callback - INFO - Received callback for node 69cbe4762a64fa9aff9381e1 INFO: 172.21.0.1:47370 - "POST /node/69cbe4762a64fa9aff9381e1 HTTP/1.0" 202 Accepted 2026-04-02 15:13:07,293 - lava_callback - INFO - Starting async job submit for node 69cbe4762a64fa9aff9381e1 2026-04-02 15:13:07,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:13:07,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe4762a64fa9aff9381e1 HTTP/1.1" 200 None 2026-04-02 15:13:07,309 - lava_callback - DEBUG - Processing node 69cbe4762a64fa9aff9381e1: baseline-arm-clabbe 2026-04-02 15:13:07,310 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe4762a64fa9aff9381e1 2026-04-02 15:13:07,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:13:07,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe4762a64fa9aff9381e1 HTTP/1.1" 200 None 2026-04-02 15:13:07,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:13:07,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:13:07,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:13:07,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe4762a64fa9aff9381e1 HTTP/1.1" 200 None 2026-04-02 15:13:07,378 - lava_callback - ERROR - Error processing callback for node 69cbe4762a64fa9aff9381e1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET /node/69903db0985e4efca431e421%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:48660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48316 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38756 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38760 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:19:43,256 - lava_callback - INFO - Received callback for node 69cbe6012a64fa9aff93822b INFO: 172.21.0.1:58464 - "POST /node/69cbe6012a64fa9aff93822b HTTP/1.0" 202 Accepted 2026-04-02 15:19:43,262 - lava_callback - INFO - Starting async job submit for node 69cbe6012a64fa9aff93822b 2026-04-02 15:19:43,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:19:43,305 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6012a64fa9aff93822b HTTP/1.1" 200 None 2026-04-02 15:19:43,306 - lava_callback - DEBUG - Processing node 69cbe6012a64fa9aff93822b: baseline-arm-baylibre 2026-04-02 15:19:43,306 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe6012a64fa9aff93822b 2026-04-02 15:19:43,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:19:43,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6012a64fa9aff93822b HTTP/1.1" 200 None 2026-04-02 15:19:43,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:19:43,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:19:43,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:19:43,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe6012a64fa9aff93822b HTTP/1.1" 200 None 2026-04-02 15:19:43,369 - lava_callback - ERROR - Error processing callback for node 69cbe6012a64fa9aff93822b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41820 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:20:23,192 - lava_callback - INFO - Received callback for node 69cbe6302a64fa9aff938238 INFO: 172.21.0.1:41014 - "POST /node/69cbe6302a64fa9aff938238 HTTP/1.0" 202 Accepted 2026-04-02 15:20:23,198 - lava_callback - INFO - Starting async job submit for node 69cbe6302a64fa9aff938238 2026-04-02 15:20:23,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:20:23,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6302a64fa9aff938238 HTTP/1.1" 200 None 2026-04-02 15:20:23,213 - lava_callback - DEBUG - Processing node 69cbe6302a64fa9aff938238: baseline-arm64-baylibre 2026-04-02 15:20:23,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe6302a64fa9aff938238 2026-04-02 15:20:23,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:20:23,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6302a64fa9aff938238 HTTP/1.1" 200 None 2026-04-02 15:20:23,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:20:23,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:20:23,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:20:23,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe6302a64fa9aff938238 HTTP/1.1" 200 None 2026-04-02 15:20:23,285 - lava_callback - ERROR - Error processing callback for node 69cbe6302a64fa9aff938238: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58068 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:22:03,368 - lava_callback - INFO - Received callback for node 69cbe6882a64fa9aff938242 INFO: 172.21.0.1:35752 - "POST /node/69cbe6882a64fa9aff938242 HTTP/1.0" 202 Accepted 2026-04-02 15:22:03,373 - lava_callback - INFO - Starting async job submit for node 69cbe6882a64fa9aff938242 2026-04-02 15:22:03,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:22:03,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6882a64fa9aff938242 HTTP/1.1" 200 None 2026-04-02 15:22:03,393 - lava_callback - DEBUG - Processing node 69cbe6882a64fa9aff938242: baseline-arm64-baylibre 2026-04-02 15:22:03,394 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe6882a64fa9aff938242 2026-04-02 15:22:03,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:22:03,409 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6882a64fa9aff938242 HTTP/1.1" 200 None 2026-04-02 15:22:03,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:22:03,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:22:03,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:22:03,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe6882a64fa9aff938242 HTTP/1.1" 200 None 2026-04-02 15:22:03,455 - lava_callback - ERROR - Error processing callback for node 69cbe6882a64fa9aff938242: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33574 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:23:23,520 - lava_callback - INFO - Received callback for node 69cbe6e02a64fa9aff93824c INFO: 172.21.0.1:60196 - "POST /node/69cbe6e02a64fa9aff93824c HTTP/1.0" 202 Accepted 2026-04-02 15:23:23,526 - lava_callback - INFO - Starting async job submit for node 69cbe6e02a64fa9aff93824c 2026-04-02 15:23:23,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:23:23,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6e02a64fa9aff93824c HTTP/1.1" 200 None 2026-04-02 15:23:23,549 - lava_callback - DEBUG - Processing node 69cbe6e02a64fa9aff93824c: baseline-arm64-baylibre 2026-04-02 15:23:23,550 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe6e02a64fa9aff93824c 2026-04-02 15:23:23,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:23:23,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe6e02a64fa9aff93824c HTTP/1.1" 200 None 2026-04-02 15:23:23,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:23:23,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:23:23,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:23:23,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe6e02a64fa9aff93824c HTTP/1.1" 200 None 2026-04-02 15:23:23,625 - lava_callback - ERROR - Error processing callback for node 69cbe6e02a64fa9aff93824c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46424 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:24:43,472 - lava_callback - INFO - Received callback for node 69cbe7372a64fa9aff938257 INFO: 172.21.0.1:35552 - "POST /node/69cbe7372a64fa9aff938257 HTTP/1.0" 202 Accepted 2026-04-02 15:24:43,478 - lava_callback - INFO - Starting async job submit for node 69cbe7372a64fa9aff938257 2026-04-02 15:24:43,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:24:43,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe7372a64fa9aff938257 HTTP/1.1" 200 None 2026-04-02 15:24:43,503 - lava_callback - DEBUG - Processing node 69cbe7372a64fa9aff938257: baseline-arm64-baylibre 2026-04-02 15:24:43,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe7372a64fa9aff938257 2026-04-02 15:24:43,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:24:43,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe7372a64fa9aff938257 HTTP/1.1" 200 None 2026-04-02 15:24:43,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:24:43,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:24:43,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:24:43,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe7372a64fa9aff938257 HTTP/1.1" 200 None 2026-04-02 15:24:43,558 - lava_callback - ERROR - Error processing callback for node 69cbe7372a64fa9aff938257: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49580 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:26:23,572 - lava_callback - INFO - Received callback for node 69cbe78f2a64fa9aff938263 INFO: 172.21.0.1:53246 - "POST /node/69cbe78f2a64fa9aff938263 HTTP/1.0" 202 Accepted 2026-04-02 15:26:23,577 - lava_callback - INFO - Starting async job submit for node 69cbe78f2a64fa9aff938263 2026-04-02 15:26:23,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:26:23,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe78f2a64fa9aff938263 HTTP/1.1" 200 None 2026-04-02 15:26:23,602 - lava_callback - DEBUG - Processing node 69cbe78f2a64fa9aff938263: baseline-arm64-baylibre 2026-04-02 15:26:23,602 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe78f2a64fa9aff938263 2026-04-02 15:26:23,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:26:23,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe78f2a64fa9aff938263 HTTP/1.1" 200 None 2026-04-02 15:26:23,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:26:23,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:26:23,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:26:23,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe78f2a64fa9aff938263 HTTP/1.1" 200 None 2026-04-02 15:26:23,655 - lava_callback - ERROR - Error processing callback for node 69cbe78f2a64fa9aff938263: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55506 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:27:43,618 - lava_callback - INFO - Received callback for node 69cbe7e92a64fa9aff93826f INFO: 172.21.0.1:45618 - "POST /node/69cbe7e92a64fa9aff93826f HTTP/1.0" 202 Accepted 2026-04-02 15:27:43,623 - lava_callback - INFO - Starting async job submit for node 69cbe7e92a64fa9aff93826f 2026-04-02 15:27:43,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:27:43,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe7e92a64fa9aff93826f HTTP/1.1" 200 None 2026-04-02 15:27:43,640 - lava_callback - DEBUG - Processing node 69cbe7e92a64fa9aff93826f: baseline-arm64-baylibre 2026-04-02 15:27:43,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe7e92a64fa9aff93826f 2026-04-02 15:27:43,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:27:43,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe7e92a64fa9aff93826f HTTP/1.1" 200 None 2026-04-02 15:27:43,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:27:43,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:27:43,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:27:43,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe7e92a64fa9aff93826f HTTP/1.1" 200 None 2026-04-02 15:27:43,696 - lava_callback - ERROR - Error processing callback for node 69cbe7e92a64fa9aff93826f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48516 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:29:03,839 - lava_callback - INFO - Received callback for node 69cbe8342a64fa9aff938276 INFO: 172.21.0.1:57144 - "POST /node/69cbe8342a64fa9aff938276 HTTP/1.0" 202 Accepted 2026-04-02 15:29:03,845 - lava_callback - INFO - Starting async job submit for node 69cbe8342a64fa9aff938276 2026-04-02 15:29:03,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:29:03,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8342a64fa9aff938276 HTTP/1.1" 200 None 2026-04-02 15:29:03,862 - lava_callback - DEBUG - Processing node 69cbe8342a64fa9aff938276: baseline-arm-baylibre 2026-04-02 15:29:03,862 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe8342a64fa9aff938276 2026-04-02 15:29:03,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:29:03,883 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8342a64fa9aff938276 HTTP/1.1" 200 None 2026-04-02 15:29:03,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:29:03,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:29:03,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:29:03,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe8342a64fa9aff938276 HTTP/1.1" 200 None 2026-04-02 15:29:03,949 - lava_callback - ERROR - Error processing callback for node 69cbe8342a64fa9aff938276: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41624 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:30:08,120 - lava_callback - INFO - Received callback for node 69cbe8712a64fa9aff938283 INFO: 172.21.0.1:41626 - "POST /node/69cbe8712a64fa9aff938283 HTTP/1.0" 202 Accepted 2026-04-02 15:30:08,129 - lava_callback - INFO - Starting async job submit for node 69cbe8712a64fa9aff938283 2026-04-02 15:30:08,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:30:08,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8712a64fa9aff938283 HTTP/1.1" 200 None 2026-04-02 15:30:08,146 - lava_callback - DEBUG - Processing node 69cbe8712a64fa9aff938283: baseline-arm64-clabbe 2026-04-02 15:30:08,146 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe8712a64fa9aff938283 2026-04-02 15:30:08,147 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:30:08,162 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8712a64fa9aff938283 HTTP/1.1" 200 None 2026-04-02 15:30:08,164 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:30:08,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:30:08,179 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:30:08,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe8712a64fa9aff938283 HTTP/1.1" 200 None 2026-04-02 15:30:08,203 - lava_callback - ERROR - Error processing callback for node 69cbe8712a64fa9aff938283: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46752 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:31:28,030 - lava_callback - INFO - Received callback for node 69cbe8c62a64fa9aff938290 INFO: 172.21.0.1:46768 - "POST /node/69cbe8c62a64fa9aff938290 HTTP/1.0" 202 Accepted 2026-04-02 15:31:28,035 - lava_callback - INFO - Starting async job submit for node 69cbe8c62a64fa9aff938290 2026-04-02 15:31:28,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:31:28,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8c62a64fa9aff938290 HTTP/1.1" 200 None 2026-04-02 15:31:28,052 - lava_callback - DEBUG - Processing node 69cbe8c62a64fa9aff938290: baseline-arm64-clabbe 2026-04-02 15:31:28,052 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe8c62a64fa9aff938290 2026-04-02 15:31:28,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:31:28,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe8c62a64fa9aff938290 HTTP/1.1" 200 None 2026-04-02 15:31:28,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:31:28,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:31:28,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:31:28,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe8c62a64fa9aff938290 HTTP/1.1" 200 None 2026-04-02 15:31:28,111 - lava_callback - ERROR - Error processing callback for node 69cbe8c62a64fa9aff938290: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39308 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:32:48,115 - lava_callback - INFO - Received callback for node 69cbe91d2a64fa9aff93829b INFO: 172.21.0.1:39318 - "POST /node/69cbe91d2a64fa9aff93829b HTTP/1.0" 202 Accepted 2026-04-02 15:32:48,121 - lava_callback - INFO - Starting async job submit for node 69cbe91d2a64fa9aff93829b 2026-04-02 15:32:48,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:32:48,137 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe91d2a64fa9aff93829b HTTP/1.1" 200 None 2026-04-02 15:32:48,138 - lava_callback - DEBUG - Processing node 69cbe91d2a64fa9aff93829b: baseline-arm64-clabbe 2026-04-02 15:32:48,138 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe91d2a64fa9aff93829b 2026-04-02 15:32:48,139 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:32:48,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe91d2a64fa9aff93829b HTTP/1.1" 200 None 2026-04-02 15:32:48,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:32:48,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:32:48,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:32:48,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe91d2a64fa9aff93829b HTTP/1.1" 200 None 2026-04-02 15:32:48,197 - lava_callback - ERROR - Error processing callback for node 69cbe91d2a64fa9aff93829b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:34:28,196 - lava_callback - INFO - Received callback for node 69cbe9782a64fa9aff9382aa INFO: 172.21.0.1:40450 - "POST /node/69cbe9782a64fa9aff9382aa HTTP/1.0" 202 Accepted 2026-04-02 15:34:28,201 - lava_callback - INFO - Starting async job submit for node 69cbe9782a64fa9aff9382aa 2026-04-02 15:34:28,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:34:28,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe9782a64fa9aff9382aa HTTP/1.1" 200 None 2026-04-02 15:34:28,229 - lava_callback - DEBUG - Processing node 69cbe9782a64fa9aff9382aa: baseline-arm64-clabbe 2026-04-02 15:34:28,230 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe9782a64fa9aff9382aa 2026-04-02 15:34:28,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:34:28,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe9782a64fa9aff9382aa HTTP/1.1" 200 None 2026-04-02 15:34:28,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:34:28,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:34:28,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:34:28,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe9782a64fa9aff9382aa HTTP/1.1" 200 None 2026-04-02 15:34:28,293 - lava_callback - ERROR - Error processing callback for node 69cbe9782a64fa9aff9382aa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37834 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:36:08,254 - lava_callback - INFO - Received callback for node 69cbe9d32a64fa9aff9382ba INFO: 172.21.0.1:37850 - "POST /node/69cbe9d32a64fa9aff9382ba HTTP/1.0" 202 Accepted 2026-04-02 15:36:08,259 - lava_callback - INFO - Starting async job submit for node 69cbe9d32a64fa9aff9382ba 2026-04-02 15:36:08,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:36:08,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe9d32a64fa9aff9382ba HTTP/1.1" 200 None 2026-04-02 15:36:08,275 - lava_callback - DEBUG - Processing node 69cbe9d32a64fa9aff9382ba: baseline-arm64-clabbe 2026-04-02 15:36:08,276 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbe9d32a64fa9aff9382ba 2026-04-02 15:36:08,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:36:08,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbe9d32a64fa9aff9382ba HTTP/1.1" 200 None 2026-04-02 15:36:08,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:36:08,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:36:08,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:36:08,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbe9d32a64fa9aff9382ba HTTP/1.1" 200 None 2026-04-02 15:36:08,337 - lava_callback - ERROR - Error processing callback for node 69cbe9d32a64fa9aff9382ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56186 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:37:28,309 - lava_callback - INFO - Received callback for node 69cbea292a64fa9aff9382c4 INFO: 172.21.0.1:56188 - "POST /node/69cbea292a64fa9aff9382c4 HTTP/1.0" 202 Accepted 2026-04-02 15:37:28,314 - lava_callback - INFO - Starting async job submit for node 69cbea292a64fa9aff9382c4 2026-04-02 15:37:28,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:37:28,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea292a64fa9aff9382c4 HTTP/1.1" 200 None 2026-04-02 15:37:28,331 - lava_callback - DEBUG - Processing node 69cbea292a64fa9aff9382c4: baseline-arm64-clabbe 2026-04-02 15:37:28,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbea292a64fa9aff9382c4 2026-04-02 15:37:28,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:37:28,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea292a64fa9aff9382c4 HTTP/1.1" 200 None 2026-04-02 15:37:28,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:37:28,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cb834d2a64fa9aff936913 HTTP/1.1" 200 None 2026-04-02 15:37:28,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:37:28,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbea292a64fa9aff9382c4 HTTP/1.1" 200 None 2026-04-02 15:37:28,389 - lava_callback - ERROR - Error processing callback for node 69cbea292a64fa9aff9382c4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44096 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60050 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:38:28,327 - lava_callback - INFO - Received callback for node 69cbea6f2a64fa9aff9382cb INFO: 172.21.0.1:60064 - "POST /node/69cbea6f2a64fa9aff9382cb HTTP/1.0" 202 Accepted 2026-04-02 15:38:28,333 - lava_callback - INFO - Starting async job submit for node 69cbea6f2a64fa9aff9382cb 2026-04-02 15:38:28,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:38:28,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea6f2a64fa9aff9382cb HTTP/1.1" 200 None 2026-04-02 15:38:28,352 - lava_callback - DEBUG - Processing node 69cbea6f2a64fa9aff9382cb: baseline-arm-clabbe 2026-04-02 15:38:28,352 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbea6f2a64fa9aff9382cb 2026-04-02 15:38:28,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:38:28,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea6f2a64fa9aff9382cb HTTP/1.1" 200 None 2026-04-02 15:38:28,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:38:28,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:38:28,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:38:28,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbea6f2a64fa9aff9382cb HTTP/1.1" 200 None 2026-04-02 15:38:28,418 - lava_callback - ERROR - Error processing callback for node 69cbea6f2a64fa9aff9382cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48936 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:39:08,328 - lava_callback - INFO - Received callback for node 69cbea992a64fa9aff9382dc INFO: 172.21.0.1:48942 - "POST /node/69cbea992a64fa9aff9382dc HTTP/1.0" 202 Accepted 2026-04-02 15:39:08,334 - lava_callback - INFO - Starting async job submit for node 69cbea992a64fa9aff9382dc 2026-04-02 15:39:08,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:39:08,354 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea992a64fa9aff9382dc HTTP/1.1" 200 None 2026-04-02 15:39:08,355 - lava_callback - DEBUG - Processing node 69cbea992a64fa9aff9382dc: baseline-arm-clabbe 2026-04-02 15:39:08,355 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbea992a64fa9aff9382dc 2026-04-02 15:39:08,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:39:08,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbea992a64fa9aff9382dc HTTP/1.1" 200 None 2026-04-02 15:39:08,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:39:08,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:39:08,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:39:08,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbea992a64fa9aff9382dc HTTP/1.1" 200 None 2026-04-02 15:39:08,417 - lava_callback - ERROR - Error processing callback for node 69cbea992a64fa9aff9382dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54718 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:40:08,470 - lava_callback - INFO - Received callback for node 69cbeac22a64fa9aff9382e8 INFO: 172.21.0.1:54730 - "POST /node/69cbeac22a64fa9aff9382e8 HTTP/1.0" 202 Accepted 2026-04-02 15:40:08,475 - lava_callback - INFO - Starting async job submit for node 69cbeac22a64fa9aff9382e8 2026-04-02 15:40:08,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:08,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeac22a64fa9aff9382e8 HTTP/1.1" 200 None 2026-04-02 15:40:08,492 - lava_callback - DEBUG - Processing node 69cbeac22a64fa9aff9382e8: baseline-arm-clabbe 2026-04-02 15:40:08,492 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeac22a64fa9aff9382e8 2026-04-02 15:40:08,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:08,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeac22a64fa9aff9382e8 HTTP/1.1" 200 None 2026-04-02 15:40:08,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:08,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:40:08,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:08,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeac22a64fa9aff9382e8 HTTP/1.1" 200 None 2026-04-02 15:40:08,547 - lava_callback - ERROR - Error processing callback for node 69cbeac22a64fa9aff9382e8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40032 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:40:48,374 - lava_callback - INFO - Received callback for node 69cbeaec2a64fa9aff9382f9 INFO: 172.21.0.1:40040 - "POST /node/69cbeaec2a64fa9aff9382f9 HTTP/1.0" 202 Accepted 2026-04-02 15:40:48,380 - lava_callback - INFO - Starting async job submit for node 69cbeaec2a64fa9aff9382f9 2026-04-02 15:40:48,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:48,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeaec2a64fa9aff9382f9 HTTP/1.1" 200 None 2026-04-02 15:40:48,406 - lava_callback - DEBUG - Processing node 69cbeaec2a64fa9aff9382f9: baseline-arm-clabbe 2026-04-02 15:40:48,406 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeaec2a64fa9aff9382f9 2026-04-02 15:40:48,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:48,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeaec2a64fa9aff9382f9 HTTP/1.1" 200 None 2026-04-02 15:40:48,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:48,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:40:48,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:40:48,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeaec2a64fa9aff9382f9 HTTP/1.1" 200 None 2026-04-02 15:40:48,461 - lava_callback - ERROR - Error processing callback for node 69cbeaec2a64fa9aff9382f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:41:28,416 - lava_callback - INFO - Received callback for node 69cbeb162a64fa9aff938302 INFO: 172.21.0.1:49462 - "POST /node/69cbeb162a64fa9aff938302 HTTP/1.0" 202 Accepted 2026-04-02 15:41:28,421 - lava_callback - INFO - Starting async job submit for node 69cbeb162a64fa9aff938302 2026-04-02 15:41:28,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:41:28,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb162a64fa9aff938302 HTTP/1.1" 200 None 2026-04-02 15:41:28,438 - lava_callback - DEBUG - Processing node 69cbeb162a64fa9aff938302: baseline-arm-clabbe 2026-04-02 15:41:28,438 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeb162a64fa9aff938302 2026-04-02 15:41:28,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:41:28,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb162a64fa9aff938302 HTTP/1.1" 200 None 2026-04-02 15:41:28,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:41:28,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:41:28,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:41:28,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeb162a64fa9aff938302 HTTP/1.1" 200 None 2026-04-02 15:41:28,503 - lava_callback - ERROR - Error processing callback for node 69cbeb162a64fa9aff938302: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42104 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:42:08,393 - lava_callback - INFO - Received callback for node 69cbeb402a64fa9aff93830d INFO: 172.21.0.1:42108 - "POST /node/69cbeb402a64fa9aff93830d HTTP/1.0" 202 Accepted 2026-04-02 15:42:08,399 - lava_callback - INFO - Starting async job submit for node 69cbeb402a64fa9aff93830d 2026-04-02 15:42:08,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:08,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb402a64fa9aff93830d HTTP/1.1" 200 None 2026-04-02 15:42:08,414 - lava_callback - DEBUG - Processing node 69cbeb402a64fa9aff93830d: baseline-arm-clabbe 2026-04-02 15:42:08,414 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeb402a64fa9aff93830d 2026-04-02 15:42:08,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:08,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb402a64fa9aff93830d HTTP/1.1" 200 None 2026-04-02 15:42:08,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:08,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:42:08,445 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:08,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeb402a64fa9aff93830d HTTP/1.1" 200 None 2026-04-02 15:42:08,484 - lava_callback - ERROR - Error processing callback for node 69cbeb402a64fa9aff93830d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44930 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:55818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41620 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:42:48,489 - lava_callback - INFO - Received callback for node 69cbeb682a64fa9aff93831c INFO: 172.21.0.1:41622 - "POST /node/69cbeb682a64fa9aff93831c HTTP/1.0" 202 Accepted 2026-04-02 15:42:48,494 - lava_callback - INFO - Starting async job submit for node 69cbeb682a64fa9aff93831c 2026-04-02 15:42:48,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:48,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb682a64fa9aff93831c HTTP/1.1" 200 None 2026-04-02 15:42:48,513 - lava_callback - DEBUG - Processing node 69cbeb682a64fa9aff93831c: baseline-arm-clabbe 2026-04-02 15:42:48,514 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeb682a64fa9aff93831c 2026-04-02 15:42:48,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:48,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb682a64fa9aff93831c HTTP/1.1" 200 None 2026-04-02 15:42:48,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:48,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:42:48,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:42:48,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeb682a64fa9aff93831c HTTP/1.1" 200 None 2026-04-02 15:42:48,577 - lava_callback - ERROR - Error processing callback for node 69cbeb682a64fa9aff93831c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52742 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55870 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:43:28,458 - lava_callback - INFO - Received callback for node 69cbeb902a64fa9aff938325 INFO: 172.21.0.1:55884 - "POST /node/69cbeb902a64fa9aff938325 HTTP/1.0" 202 Accepted 2026-04-02 15:43:28,463 - lava_callback - INFO - Starting async job submit for node 69cbeb902a64fa9aff938325 2026-04-02 15:43:28,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:43:28,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb902a64fa9aff938325 HTTP/1.1" 200 None 2026-04-02 15:43:28,495 - lava_callback - DEBUG - Processing node 69cbeb902a64fa9aff938325: baseline-arm-clabbe 2026-04-02 15:43:28,496 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeb902a64fa9aff938325 2026-04-02 15:43:28,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:43:28,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeb902a64fa9aff938325 HTTP/1.1" 200 None 2026-04-02 15:43:28,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:43:28,549 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:43:28,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:43:28,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeb902a64fa9aff938325 HTTP/1.1" 200 None 2026-04-02 15:43:28,579 - lava_callback - ERROR - Error processing callback for node 69cbeb902a64fa9aff938325: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50142 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:44:08,541 - lava_callback - INFO - Received callback for node 69cbebb72a64fa9aff938332 INFO: 172.21.0.1:50148 - "POST /node/69cbebb72a64fa9aff938332 HTTP/1.0" 202 Accepted 2026-04-02 15:44:08,547 - lava_callback - INFO - Starting async job submit for node 69cbebb72a64fa9aff938332 2026-04-02 15:44:08,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:08,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbebb72a64fa9aff938332 HTTP/1.1" 200 None 2026-04-02 15:44:08,570 - lava_callback - DEBUG - Processing node 69cbebb72a64fa9aff938332: baseline-arm-clabbe 2026-04-02 15:44:08,570 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbebb72a64fa9aff938332 2026-04-02 15:44:08,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:08,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbebb72a64fa9aff938332 HTTP/1.1" 200 None 2026-04-02 15:44:08,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:08,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:44:08,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:08,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbebb72a64fa9aff938332 HTTP/1.1" 200 None 2026-04-02 15:44:08,645 - lava_callback - ERROR - Error processing callback for node 69cbebb72a64fa9aff938332: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57602 - "GET /node/69c6495cb98d4d3c02068932%5Cn HTTP/1.0" 405 Method Not Allowed INFO: 172.21.0.1:57614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54930 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:44:48,551 - lava_callback - INFO - Received callback for node 69cbebdf2a64fa9aff93833f INFO: 172.21.0.1:54932 - "POST /node/69cbebdf2a64fa9aff93833f HTTP/1.0" 202 Accepted 2026-04-02 15:44:48,557 - lava_callback - INFO - Starting async job submit for node 69cbebdf2a64fa9aff93833f 2026-04-02 15:44:48,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:48,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbebdf2a64fa9aff93833f HTTP/1.1" 200 None 2026-04-02 15:44:48,577 - lava_callback - DEBUG - Processing node 69cbebdf2a64fa9aff93833f: baseline-arm-clabbe 2026-04-02 15:44:48,578 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbebdf2a64fa9aff93833f 2026-04-02 15:44:48,578 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:48,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbebdf2a64fa9aff93833f HTTP/1.1" 200 None 2026-04-02 15:44:48,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:48,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c63ce4b98d4d3c02067dbf HTTP/1.1" 200 None 2026-04-02 15:44:48,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:44:48,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbebdf2a64fa9aff93833f HTTP/1.1" 200 None 2026-04-02 15:44:48,629 - lava_callback - ERROR - Error processing callback for node 69cbebdf2a64fa9aff93833f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56462 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49810 - "GET /favicon.ico HTTP/1.0" 404 Not Found 2026-04-02 15:45:24,569 - lava_callback - INFO - Received callback for node 69cbec0e2a64fa9aff93834a INFO: 172.21.0.1:49826 - "POST /node/69cbec0e2a64fa9aff93834a HTTP/1.0" 202 Accepted 2026-04-02 15:45:24,575 - lava_callback - INFO - Starting async job submit for node 69cbec0e2a64fa9aff93834a 2026-04-02 15:45:24,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:45:24,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbec0e2a64fa9aff93834a HTTP/1.1" 200 None 2026-04-02 15:45:24,592 - lava_callback - DEBUG - Processing node 69cbec0e2a64fa9aff93834a: baseline-arm64-baylibre 2026-04-02 15:45:24,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbec0e2a64fa9aff93834a 2026-04-02 15:45:24,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:45:24,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbec0e2a64fa9aff93834a HTTP/1.1" 200 None 2026-04-02 15:45:24,611 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:45:24,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:45:24,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:45:24,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbec0e2a64fa9aff93834a HTTP/1.1" 200 None 2026-04-02 15:45:24,665 - lava_callback - ERROR - Error processing callback for node 69cbec0e2a64fa9aff93834a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35280 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:47:04,615 - lava_callback - INFO - Received callback for node 69cbec642a64fa9aff938353 INFO: 172.21.0.1:38812 - "POST /node/69cbec642a64fa9aff938353 HTTP/1.0" 202 Accepted 2026-04-02 15:47:04,621 - lava_callback - INFO - Starting async job submit for node 69cbec642a64fa9aff938353 2026-04-02 15:47:04,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:47:04,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbec642a64fa9aff938353 HTTP/1.1" 200 None 2026-04-02 15:47:04,637 - lava_callback - DEBUG - Processing node 69cbec642a64fa9aff938353: baseline-arm64-baylibre 2026-04-02 15:47:04,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbec642a64fa9aff938353 2026-04-02 15:47:04,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:47:04,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbec642a64fa9aff938353 HTTP/1.1" 200 None 2026-04-02 15:47:04,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:47:04,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:47:04,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:47:04,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbec642a64fa9aff938353 HTTP/1.1" 200 None 2026-04-02 15:47:04,696 - lava_callback - ERROR - Error processing callback for node 69cbec642a64fa9aff938353: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:48:24,714 - lava_callback - INFO - Received callback for node 69cbecbc2a64fa9aff93835d INFO: 172.21.0.1:47586 - "POST /node/69cbecbc2a64fa9aff93835d HTTP/1.0" 202 Accepted 2026-04-02 15:48:24,719 - lava_callback - INFO - Starting async job submit for node 69cbecbc2a64fa9aff93835d 2026-04-02 15:48:24,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:48:24,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbecbc2a64fa9aff93835d HTTP/1.1" 200 None 2026-04-02 15:48:24,735 - lava_callback - DEBUG - Processing node 69cbecbc2a64fa9aff93835d: baseline-arm64-baylibre 2026-04-02 15:48:24,736 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbecbc2a64fa9aff93835d 2026-04-02 15:48:24,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:48:24,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbecbc2a64fa9aff93835d HTTP/1.1" 200 None 2026-04-02 15:48:24,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:48:24,765 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:48:24,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:48:24,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbecbc2a64fa9aff93835d HTTP/1.1" 200 None 2026-04-02 15:48:24,795 - lava_callback - ERROR - Error processing callback for node 69cbecbc2a64fa9aff93835d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53122 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:49:44,757 - lava_callback - INFO - Received callback for node 69cbed162a64fa9aff938369 INFO: 172.21.0.1:44382 - "POST /node/69cbed162a64fa9aff938369 HTTP/1.0" 202 Accepted 2026-04-02 15:49:44,763 - lava_callback - INFO - Starting async job submit for node 69cbed162a64fa9aff938369 2026-04-02 15:49:44,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:49:44,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbed162a64fa9aff938369 HTTP/1.1" 200 None 2026-04-02 15:49:44,779 - lava_callback - DEBUG - Processing node 69cbed162a64fa9aff938369: baseline-arm64-baylibre 2026-04-02 15:49:44,779 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbed162a64fa9aff938369 2026-04-02 15:49:44,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:49:44,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbed162a64fa9aff938369 HTTP/1.1" 200 None 2026-04-02 15:49:44,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:49:44,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:49:44,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:49:44,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbed162a64fa9aff938369 HTTP/1.1" 200 None 2026-04-02 15:49:44,866 - lava_callback - ERROR - Error processing callback for node 69cbed162a64fa9aff938369: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38632 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:51:24,873 - lava_callback - INFO - Received callback for node 69cbed6f2a64fa9aff938373 INFO: 172.21.0.1:48632 - "POST /node/69cbed6f2a64fa9aff938373 HTTP/1.0" 202 Accepted 2026-04-02 15:51:24,879 - lava_callback - INFO - Starting async job submit for node 69cbed6f2a64fa9aff938373 2026-04-02 15:51:24,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:51:24,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbed6f2a64fa9aff938373 HTTP/1.1" 200 None 2026-04-02 15:51:24,895 - lava_callback - DEBUG - Processing node 69cbed6f2a64fa9aff938373: baseline-arm64-baylibre 2026-04-02 15:51:24,895 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbed6f2a64fa9aff938373 2026-04-02 15:51:24,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:51:24,920 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbed6f2a64fa9aff938373 HTTP/1.1" 200 None 2026-04-02 15:51:24,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:51:24,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:51:24,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:51:24,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbed6f2a64fa9aff938373 HTTP/1.1" 200 None 2026-04-02 15:51:24,968 - lava_callback - ERROR - Error processing callback for node 69cbed6f2a64fa9aff938373: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59672 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:52:44,891 - lava_callback - INFO - Received callback for node 69cbedc42a64fa9aff93837f INFO: 172.21.0.1:41310 - "POST /node/69cbedc42a64fa9aff93837f HTTP/1.0" 202 Accepted 2026-04-02 15:52:44,896 - lava_callback - INFO - Starting async job submit for node 69cbedc42a64fa9aff93837f 2026-04-02 15:52:44,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:52:44,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbedc42a64fa9aff93837f HTTP/1.1" 200 None 2026-04-02 15:52:44,912 - lava_callback - DEBUG - Processing node 69cbedc42a64fa9aff93837f: baseline-arm64-baylibre 2026-04-02 15:52:44,913 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbedc42a64fa9aff93837f 2026-04-02 15:52:44,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:52:44,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbedc42a64fa9aff93837f HTTP/1.1" 200 None 2026-04-02 15:52:44,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:52:44,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:52:44,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:52:44,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbedc42a64fa9aff93837f HTTP/1.1" 200 None 2026-04-02 15:52:44,972 - lava_callback - ERROR - Error processing callback for node 69cbedc42a64fa9aff93837f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52384 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:54:04,999 - lava_callback - INFO - Received callback for node 69cbee182a64fa9aff93838d INFO: 172.21.0.1:44554 - "POST /node/69cbee182a64fa9aff93838d HTTP/1.0" 202 Accepted 2026-04-02 15:54:05,006 - lava_callback - INFO - Starting async job submit for node 69cbee182a64fa9aff93838d 2026-04-02 15:54:05,007 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:54:05,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbee182a64fa9aff93838d HTTP/1.1" 200 None 2026-04-02 15:54:05,029 - lava_callback - DEBUG - Processing node 69cbee182a64fa9aff93838d: baseline-arm64-baylibre 2026-04-02 15:54:05,029 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbee182a64fa9aff93838d 2026-04-02 15:54:05,030 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:54:05,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbee182a64fa9aff93838d HTTP/1.1" 200 None 2026-04-02 15:54:05,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:54:05,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:54:05,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:54:05,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbee182a64fa9aff93838d HTTP/1.1" 200 None 2026-04-02 15:54:05,092 - lava_callback - ERROR - Error processing callback for node 69cbee182a64fa9aff93838d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53620 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:55:49,088 - lava_callback - INFO - Received callback for node 69cbee782a64fa9aff93839b INFO: 172.21.0.1:53630 - "POST /node/69cbee782a64fa9aff93839b HTTP/1.0" 202 Accepted 2026-04-02 15:55:49,093 - lava_callback - INFO - Starting async job submit for node 69cbee782a64fa9aff93839b 2026-04-02 15:55:49,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:55:49,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbee782a64fa9aff93839b HTTP/1.1" 200 None 2026-04-02 15:55:49,110 - lava_callback - DEBUG - Processing node 69cbee782a64fa9aff93839b: baseline-arm64-clabbe 2026-04-02 15:55:49,110 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbee782a64fa9aff93839b 2026-04-02 15:55:49,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:55:49,124 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbee782a64fa9aff93839b HTTP/1.1" 200 None 2026-04-02 15:55:49,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:55:49,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:55:49,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:55:49,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbee782a64fa9aff93839b HTTP/1.1" 200 None 2026-04-02 15:55:49,169 - lava_callback - ERROR - Error processing callback for node 69cbee782a64fa9aff93839b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35824 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:57:09,087 - lava_callback - INFO - Received callback for node 69cbeecf2a64fa9aff9383a7 INFO: 172.21.0.1:35834 - "POST /node/69cbeecf2a64fa9aff9383a7 HTTP/1.0" 202 Accepted 2026-04-02 15:57:09,096 - lava_callback - INFO - Starting async job submit for node 69cbeecf2a64fa9aff9383a7 2026-04-02 15:57:09,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:57:09,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeecf2a64fa9aff9383a7 HTTP/1.1" 200 None 2026-04-02 15:57:09,112 - lava_callback - DEBUG - Processing node 69cbeecf2a64fa9aff9383a7: baseline-arm64-clabbe 2026-04-02 15:57:09,112 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbeecf2a64fa9aff9383a7 2026-04-02 15:57:09,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:57:09,126 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbeecf2a64fa9aff9383a7 HTTP/1.1" 200 None 2026-04-02 15:57:09,128 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:57:09,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:57:09,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:57:09,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbeecf2a64fa9aff9383a7 HTTP/1.1" 200 None 2026-04-02 15:57:09,193 - lava_callback - ERROR - Error processing callback for node 69cbeecf2a64fa9aff9383a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43170 - "GET / HTTP/1.0" 200 OK 2026-04-02 15:58:25,260 - lava_callback - INFO - Received callback for node 69cbef1c2a64fa9aff9383b0 INFO: 172.21.0.1:44610 - "POST /node/69cbef1c2a64fa9aff9383b0 HTTP/1.0" 202 Accepted 2026-04-02 15:58:25,265 - lava_callback - INFO - Starting async job submit for node 69cbef1c2a64fa9aff9383b0 2026-04-02 15:58:25,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:58:25,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbef1c2a64fa9aff9383b0 HTTP/1.1" 200 None 2026-04-02 15:58:25,285 - lava_callback - DEBUG - Processing node 69cbef1c2a64fa9aff9383b0: baseline-arm64-baylibre 2026-04-02 15:58:25,285 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbef1c2a64fa9aff9383b0 2026-04-02 15:58:25,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:58:25,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbef1c2a64fa9aff9383b0 HTTP/1.1" 200 None 2026-04-02 15:58:25,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:58:25,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 15:58:25,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 15:58:25,346 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbef1c2a64fa9aff9383b0 HTTP/1.1" 200 None 2026-04-02 15:58:25,348 - lava_callback - ERROR - Error processing callback for node 69cbef1c2a64fa9aff9383b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45704 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:00:09,462 - lava_callback - INFO - Received callback for node 69cbef7c2a64fa9aff9383ba INFO: 172.21.0.1:45706 - "POST /node/69cbef7c2a64fa9aff9383ba HTTP/1.0" 202 Accepted 2026-04-02 16:00:09,468 - lava_callback - INFO - Starting async job submit for node 69cbef7c2a64fa9aff9383ba 2026-04-02 16:00:09,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:00:09,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbef7c2a64fa9aff9383ba HTTP/1.1" 200 None 2026-04-02 16:00:09,484 - lava_callback - DEBUG - Processing node 69cbef7c2a64fa9aff9383ba: baseline-arm64-clabbe 2026-04-02 16:00:09,484 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbef7c2a64fa9aff9383ba 2026-04-02 16:00:09,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:00:09,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbef7c2a64fa9aff9383ba HTTP/1.1" 200 None 2026-04-02 16:00:09,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:00:09,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:00:09,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:00:09,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbef7c2a64fa9aff9383ba HTTP/1.1" 200 None 2026-04-02 16:00:09,560 - lava_callback - ERROR - Error processing callback for node 69cbef7c2a64fa9aff9383ba: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56456 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56468 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:01:25,389 - lava_callback - INFO - Received callback for node 69cbefc82a64fa9aff9383c9 INFO: 172.21.0.1:43694 - "POST /node/69cbefc82a64fa9aff9383c9 HTTP/1.0" 202 Accepted 2026-04-02 16:01:25,395 - lava_callback - INFO - Starting async job submit for node 69cbefc82a64fa9aff9383c9 2026-04-02 16:01:25,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:01:25,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbefc82a64fa9aff9383c9 HTTP/1.1" 200 None 2026-04-02 16:01:25,410 - lava_callback - DEBUG - Processing node 69cbefc82a64fa9aff9383c9: baseline-arm64-baylibre 2026-04-02 16:01:25,411 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbefc82a64fa9aff9383c9 2026-04-02 16:01:25,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:01:25,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbefc82a64fa9aff9383c9 HTTP/1.1" 200 None 2026-04-02 16:01:25,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:01:25,440 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:01:25,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:01:25,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbefc82a64fa9aff9383c9 HTTP/1.1" 200 None 2026-04-02 16:01:25,467 - lava_callback - ERROR - Error processing callback for node 69cbefc82a64fa9aff9383c9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47322 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:02:45,459 - lava_callback - INFO - Received callback for node 69cbf01d2a64fa9aff9383d5 INFO: 172.21.0.1:57028 - "POST /node/69cbf01d2a64fa9aff9383d5 HTTP/1.0" 202 Accepted 2026-04-02 16:02:45,464 - lava_callback - INFO - Starting async job submit for node 69cbf01d2a64fa9aff9383d5 2026-04-02 16:02:45,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:02:45,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf01d2a64fa9aff9383d5 HTTP/1.1" 200 None 2026-04-02 16:02:45,480 - lava_callback - DEBUG - Processing node 69cbf01d2a64fa9aff9383d5: baseline-arm64-baylibre 2026-04-02 16:02:45,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf01d2a64fa9aff9383d5 2026-04-02 16:02:45,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:02:45,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf01d2a64fa9aff9383d5 HTTP/1.1" 200 None 2026-04-02 16:02:45,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:02:45,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:02:45,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:02:45,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf01d2a64fa9aff9383d5 HTTP/1.1" 200 None 2026-04-02 16:02:45,542 - lava_callback - ERROR - Error processing callback for node 69cbf01d2a64fa9aff9383d5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:04:29,407 - lava_callback - INFO - Received callback for node 69cbf0782a64fa9aff9383e2 INFO: 172.21.0.1:49630 - "POST /node/69cbf0782a64fa9aff9383e2 HTTP/1.0" 202 Accepted 2026-04-02 16:04:29,414 - lava_callback - INFO - Starting async job submit for node 69cbf0782a64fa9aff9383e2 2026-04-02 16:04:29,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:04:29,434 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf0782a64fa9aff9383e2 HTTP/1.1" 200 None 2026-04-02 16:04:29,435 - lava_callback - DEBUG - Processing node 69cbf0782a64fa9aff9383e2: baseline-arm64-clabbe 2026-04-02 16:04:29,435 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf0782a64fa9aff9383e2 2026-04-02 16:04:29,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:04:29,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf0782a64fa9aff9383e2 HTTP/1.1" 200 None 2026-04-02 16:04:29,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:04:29,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:04:29,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:04:29,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf0782a64fa9aff9383e2 HTTP/1.1" 200 None 2026-04-02 16:04:29,504 - lava_callback - ERROR - Error processing callback for node 69cbf0782a64fa9aff9383e2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53042 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:05:49,434 - lava_callback - INFO - Received callback for node 69cbf0cf2a64fa9aff9383f1 INFO: 172.21.0.1:53048 - "POST /node/69cbf0cf2a64fa9aff9383f1 HTTP/1.0" 202 Accepted 2026-04-02 16:05:49,441 - lava_callback - INFO - Starting async job submit for node 69cbf0cf2a64fa9aff9383f1 2026-04-02 16:05:49,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:05:49,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf0cf2a64fa9aff9383f1 HTTP/1.1" 200 None 2026-04-02 16:05:49,456 - lava_callback - DEBUG - Processing node 69cbf0cf2a64fa9aff9383f1: baseline-arm64-clabbe 2026-04-02 16:05:49,456 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf0cf2a64fa9aff9383f1 2026-04-02 16:05:49,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:05:49,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf0cf2a64fa9aff9383f1 HTTP/1.1" 200 None 2026-04-02 16:05:49,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:05:49,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:05:49,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:05:49,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf0cf2a64fa9aff9383f1 HTTP/1.1" 200 None 2026-04-02 16:05:49,507 - lava_callback - ERROR - Error processing callback for node 69cbf0cf2a64fa9aff9383f1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:07:05,736 - lava_callback - INFO - Received callback for node 69cbf11e2a64fa9aff9383fa INFO: 172.21.0.1:56670 - "POST /node/69cbf11e2a64fa9aff9383fa HTTP/1.0" 202 Accepted 2026-04-02 16:07:05,742 - lava_callback - INFO - Starting async job submit for node 69cbf11e2a64fa9aff9383fa 2026-04-02 16:07:05,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:07:05,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf11e2a64fa9aff9383fa HTTP/1.1" 200 None 2026-04-02 16:07:05,758 - lava_callback - DEBUG - Processing node 69cbf11e2a64fa9aff9383fa: baseline-arm64-baylibre 2026-04-02 16:07:05,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf11e2a64fa9aff9383fa 2026-04-02 16:07:05,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:07:05,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf11e2a64fa9aff9383fa HTTP/1.1" 200 None 2026-04-02 16:07:05,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:07:05,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:07:05,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:07:05,809 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf11e2a64fa9aff9383fa HTTP/1.1" 200 None 2026-04-02 16:07:05,810 - lava_callback - ERROR - Error processing callback for node 69cbf11e2a64fa9aff9383fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35706 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50470 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:08:29,532 - lava_callback - INFO - Received callback for node 69cbf17a2a64fa9aff938404 INFO: 172.21.0.1:50476 - "POST /node/69cbf17a2a64fa9aff938404 HTTP/1.0" 202 Accepted 2026-04-02 16:08:29,537 - lava_callback - INFO - Starting async job submit for node 69cbf17a2a64fa9aff938404 2026-04-02 16:08:29,538 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:08:29,552 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf17a2a64fa9aff938404 HTTP/1.1" 200 None 2026-04-02 16:08:29,553 - lava_callback - DEBUG - Processing node 69cbf17a2a64fa9aff938404: baseline-arm64-clabbe 2026-04-02 16:08:29,553 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf17a2a64fa9aff938404 2026-04-02 16:08:29,554 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:08:29,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf17a2a64fa9aff938404 HTTP/1.1" 200 None 2026-04-02 16:08:29,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:08:29,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:08:29,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:08:29,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf17a2a64fa9aff938404 HTTP/1.1" 200 None 2026-04-02 16:08:29,611 - lava_callback - ERROR - Error processing callback for node 69cbf17a2a64fa9aff938404: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60082 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:09:45,815 - lava_callback - INFO - Received callback for node 69cbf1c72a64fa9aff938411 INFO: 172.21.0.1:32926 - "POST /node/69cbf1c72a64fa9aff938411 HTTP/1.0" 202 Accepted 2026-04-02 16:09:45,821 - lava_callback - INFO - Starting async job submit for node 69cbf1c72a64fa9aff938411 2026-04-02 16:09:45,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:09:45,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf1c72a64fa9aff938411 HTTP/1.1" 200 None 2026-04-02 16:09:45,836 - lava_callback - DEBUG - Processing node 69cbf1c72a64fa9aff938411: baseline-arm64-baylibre 2026-04-02 16:09:45,836 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf1c72a64fa9aff938411 2026-04-02 16:09:45,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:09:45,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf1c72a64fa9aff938411 HTTP/1.1" 200 None 2026-04-02 16:09:45,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:09:45,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:09:45,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:09:45,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf1c72a64fa9aff938411 HTTP/1.1" 200 None 2026-04-02 16:09:45,910 - lava_callback - ERROR - Error processing callback for node 69cbf1c72a64fa9aff938411: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51076 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:11:29,704 - lava_callback - INFO - Received callback for node 69cbf2202a64fa9aff93841c INFO: 172.21.0.1:43472 - "POST /node/69cbf2202a64fa9aff93841c HTTP/1.0" 202 Accepted 2026-04-02 16:11:29,709 - lava_callback - INFO - Starting async job submit for node 69cbf2202a64fa9aff93841c 2026-04-02 16:11:29,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:11:29,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf2202a64fa9aff93841c HTTP/1.1" 200 None 2026-04-02 16:11:29,732 - lava_callback - DEBUG - Processing node 69cbf2202a64fa9aff93841c: baseline-arm64-clabbe 2026-04-02 16:11:29,732 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf2202a64fa9aff93841c 2026-04-02 16:11:29,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:11:29,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf2202a64fa9aff93841c HTTP/1.1" 200 None 2026-04-02 16:11:29,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:11:29,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:11:29,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:11:29,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf2202a64fa9aff93841c HTTP/1.1" 200 None 2026-04-02 16:11:29,809 - lava_callback - ERROR - Error processing callback for node 69cbf2202a64fa9aff93841c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47740 - "GET / HTTP/1.0" 200 OK 2026-04-02 16:12:49,727 - lava_callback - INFO - Received callback for node 69cbf2772a64fa9aff938427 INFO: 172.21.0.1:43900 - "POST /node/69cbf2772a64fa9aff938427 HTTP/1.0" 202 Accepted 2026-04-02 16:12:49,733 - lava_callback - INFO - Starting async job submit for node 69cbf2772a64fa9aff938427 2026-04-02 16:12:49,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:12:49,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf2772a64fa9aff938427 HTTP/1.1" 200 None 2026-04-02 16:12:49,757 - lava_callback - DEBUG - Processing node 69cbf2772a64fa9aff938427: baseline-arm64-clabbe 2026-04-02 16:12:49,757 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69cbf2772a64fa9aff938427 2026-04-02 16:12:49,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:12:49,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69cbf2772a64fa9aff938427 HTTP/1.1" 200 None 2026-04-02 16:12:49,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:12:49,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69c8dff86a4c026e16347d45 HTTP/1.1" 200 None 2026-04-02 16:12:49,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-04-02 16:12:49,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69cbf2772a64fa9aff938427 HTTP/1.1" 200 None 2026-04-02 16:12:49,809 - lava_callback - ERROR - Error processing callback for node 69cbf2772a64fa9aff938427: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38652 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]