INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.21.0.1:60682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39810 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40990 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50120 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43940 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59452 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58618 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:31:06,567 - lava_callback - INFO - Received callback for node 69bd055205e4bbd6ba635250 2026-03-20 08:31:06,573 - lava_callback - INFO - Starting async job submit for node 69bd055205e4bbd6ba635250 INFO: 172.21.0.1:58628 - "POST /node/69bd055205e4bbd6ba635250 HTTP/1.0" 202 Accepted 2026-03-20 08:31:06,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:31:06,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd055205e4bbd6ba635250 HTTP/1.1" 200 None 2026-03-20 08:31:06,665 - lava_callback - DEBUG - Processing node 69bd055205e4bbd6ba635250: baseline-arm 2026-03-20 08:31:06,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:31:07,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:31:07,245 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd055205e4bbd6ba635250/log.txt.gz 2026-03-20 08:31:07,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:31:07,779 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:31:07,781 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd055205e4bbd6ba635250/lava-logs.yaml 2026-03-20 08:31:07,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:31:07,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:31:07,987 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd055205e4bbd6ba635250/lava_callback.json.gz 2026-03-20 08:31:08,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:31:08,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd055205e4bbd6ba635250 HTTP/1.1" 200 None 2026-03-20 08:31:08,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:31:08,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027205e4bbd6ba634c5d HTTP/1.1" 200 None 2026-03-20 08:31:08,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:31:08,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd055205e4bbd6ba635250 HTTP/1.1" 200 None 2026-03-20 08:31:08,112 - lava_callback - INFO - Completed processing callback for node 69bd055205e4bbd6ba635250 INFO: 172.21.0.1:52304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51694 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:31:38,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:31:38,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45496 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60632 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:38:03,947 - lava_callback - INFO - Received callback for node 69ba645a537ae4d3c823746e INFO: 172.21.0.1:57848 - "POST /node/69ba645a537ae4d3c823746e HTTP/1.0" 202 Accepted 2026-03-20 08:38:03,953 - lava_callback - INFO - Starting async job submit for node 69ba645a537ae4d3c823746e 2026-03-20 08:38:03,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:03,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba645a537ae4d3c823746e HTTP/1.1" 200 None 2026-03-20 08:38:03,969 - lava_callback - DEBUG - Processing node 69ba645a537ae4d3c823746e: baseline-arm-baylibre 2026-03-20 08:38:03,969 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba645a537ae4d3c823746e 2026-03-20 08:38:03,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:03,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba645a537ae4d3c823746e HTTP/1.1" 200 None 2026-03-20 08:38:03,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:04,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 08:38:04,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:04,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba645a537ae4d3c823746e HTTP/1.1" 200 None 2026-03-20 08:38:04,063 - lava_callback - ERROR - Error processing callback for node 69ba645a537ae4d3c823746e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 08:38:04,637 - lava_callback - INFO - Received callback for node 69ba645c537ae4d3c8237471 INFO: 172.21.0.1:57850 - "POST /node/69ba645c537ae4d3c8237471 HTTP/1.0" 202 Accepted 2026-03-20 08:38:04,644 - lava_callback - INFO - Starting async job submit for node 69ba645c537ae4d3c8237471 2026-03-20 08:38:04,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:04,658 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba645c537ae4d3c8237471 HTTP/1.1" 200 None 2026-03-20 08:38:04,659 - lava_callback - DEBUG - Processing node 69ba645c537ae4d3c8237471: baseline-arm-baylibre 2026-03-20 08:38:04,659 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba645c537ae4d3c8237471 2026-03-20 08:38:04,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:04,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba645c537ae4d3c8237471 HTTP/1.1" 200 None 2026-03-20 08:38:04,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:04,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 08:38:04,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:04,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba645c537ae4d3c8237471 HTTP/1.1" 200 None 2026-03-20 08:38:04,725 - lava_callback - ERROR - Error processing callback for node 69ba645c537ae4d3c8237471: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 08:38:05,318 - lava_callback - INFO - Received callback for node 69ba645d537ae4d3c8237474 INFO: 172.21.0.1:57860 - "POST /node/69ba645d537ae4d3c8237474 HTTP/1.0" 202 Accepted 2026-03-20 08:38:05,324 - lava_callback - INFO - Starting async job submit for node 69ba645d537ae4d3c8237474 2026-03-20 08:38:05,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:05,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba645d537ae4d3c8237474 HTTP/1.1" 200 None 2026-03-20 08:38:05,340 - lava_callback - DEBUG - Processing node 69ba645d537ae4d3c8237474: baseline-arm-baylibre 2026-03-20 08:38:05,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba645d537ae4d3c8237474 2026-03-20 08:38:05,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:05,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba645d537ae4d3c8237474 HTTP/1.1" 200 None 2026-03-20 08:38:05,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:05,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 08:38:05,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:05,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba645d537ae4d3c8237474 HTTP/1.1" 200 None 2026-03-20 08:38:05,418 - lava_callback - ERROR - Error processing callback for node 69ba645d537ae4d3c8237474: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 08:38:05,989 - lava_callback - INFO - Received callback for node 69ba645e537ae4d3c8237477 INFO: 172.21.0.1:57870 - "POST /node/69ba645e537ae4d3c8237477 HTTP/1.0" 202 Accepted 2026-03-20 08:38:05,995 - lava_callback - INFO - Starting async job submit for node 69ba645e537ae4d3c8237477 2026-03-20 08:38:05,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:06,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba645e537ae4d3c8237477 HTTP/1.1" 200 None 2026-03-20 08:38:06,014 - lava_callback - DEBUG - Processing node 69ba645e537ae4d3c8237477: baseline-arm-baylibre 2026-03-20 08:38:06,014 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba645e537ae4d3c8237477 2026-03-20 08:38:06,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:06,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba645e537ae4d3c8237477 HTTP/1.1" 200 None 2026-03-20 08:38:06,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:06,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 08:38:06,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:06,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba645e537ae4d3c8237477 HTTP/1.1" 200 None 2026-03-20 08:38:06,076 - lava_callback - ERROR - Error processing callback for node 69ba645e537ae4d3c8237477: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57878 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:38:10,979 - lava_callback - INFO - Received callback for node 69ba6461537ae4d3c8237482 INFO: 172.21.0.1:33154 - "POST /node/69ba6461537ae4d3c8237482 HTTP/1.0" 202 Accepted 2026-03-20 08:38:10,984 - lava_callback - INFO - Starting async job submit for node 69ba6461537ae4d3c8237482 2026-03-20 08:38:10,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:11,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6461537ae4d3c8237482 HTTP/1.1" 200 None 2026-03-20 08:38:11,001 - lava_callback - DEBUG - Processing node 69ba6461537ae4d3c8237482: baseline-arm-baylibre 2026-03-20 08:38:11,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6461537ae4d3c8237482 2026-03-20 08:38:11,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:11,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6461537ae4d3c8237482 HTTP/1.1" 200 None 2026-03-20 08:38:11,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:11,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 08:38:11,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:11,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6461537ae4d3c8237482 HTTP/1.1" 200 None 2026-03-20 08:38:11,067 - lava_callback - ERROR - Error processing callback for node 69ba6461537ae4d3c8237482: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 08:38:11,642 - lava_callback - INFO - Received callback for node 69ba6462537ae4d3c8237485 INFO: 172.21.0.1:33162 - "POST /node/69ba6462537ae4d3c8237485 HTTP/1.0" 202 Accepted 2026-03-20 08:38:11,649 - lava_callback - INFO - Starting async job submit for node 69ba6462537ae4d3c8237485 2026-03-20 08:38:11,650 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:11,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6462537ae4d3c8237485 HTTP/1.1" 200 None 2026-03-20 08:38:11,666 - lava_callback - DEBUG - Processing node 69ba6462537ae4d3c8237485: baseline-arm-baylibre 2026-03-20 08:38:11,666 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6462537ae4d3c8237485 2026-03-20 08:38:11,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:11,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6462537ae4d3c8237485 HTTP/1.1" 200 None 2026-03-20 08:38:11,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:11,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 08:38:11,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:11,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6462537ae4d3c8237485 HTTP/1.1" 200 None 2026-03-20 08:38:11,726 - lava_callback - ERROR - Error processing callback for node 69ba6462537ae4d3c8237485: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33188 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:38:23,367 - lava_callback - INFO - Received callback for node 69ba6470537ae4d3c82374d3 INFO: 172.21.0.1:39760 - "POST /node/69ba6470537ae4d3c82374d3 HTTP/1.0" 202 Accepted 2026-03-20 08:38:23,373 - lava_callback - INFO - Starting async job submit for node 69ba6470537ae4d3c82374d3 2026-03-20 08:38:23,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:23,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6470537ae4d3c82374d3 HTTP/1.1" 200 None 2026-03-20 08:38:23,396 - lava_callback - DEBUG - Processing node 69ba6470537ae4d3c82374d3: baseline-arm-clabbe 2026-03-20 08:38:23,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6470537ae4d3c82374d3 2026-03-20 08:38:23,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:23,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6470537ae4d3c82374d3 HTTP/1.1" 200 None 2026-03-20 08:38:23,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:23,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 08:38:23,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:23,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6470537ae4d3c82374d3 HTTP/1.1" 200 None 2026-03-20 08:38:23,448 - lava_callback - ERROR - Error processing callback for node 69ba6470537ae4d3c82374d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 08:38:24,052 - lava_callback - INFO - Received callback for node 69ba646a537ae4d3c82374a1 INFO: 172.21.0.1:39762 - "POST /node/69ba646a537ae4d3c82374a1 HTTP/1.0" 202 Accepted 2026-03-20 08:38:24,058 - lava_callback - INFO - Starting async job submit for node 69ba646a537ae4d3c82374a1 2026-03-20 08:38:24,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:24,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba646a537ae4d3c82374a1 HTTP/1.1" 200 None 2026-03-20 08:38:24,073 - lava_callback - DEBUG - Processing node 69ba646a537ae4d3c82374a1: baseline-arm-clabbe 2026-03-20 08:38:24,073 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba646a537ae4d3c82374a1 2026-03-20 08:38:24,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:24,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba646a537ae4d3c82374a1 HTTP/1.1" 200 None 2026-03-20 08:38:24,094 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:24,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 08:38:24,111 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:24,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba646a537ae4d3c82374a1 HTTP/1.1" 200 None 2026-03-20 08:38:24,135 - lava_callback - ERROR - Error processing callback for node 69ba646a537ae4d3c82374a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 08:38:24,739 - lava_callback - INFO - Received callback for node 69ba646e537ae4d3c82374cd INFO: 172.21.0.1:39770 - "POST /node/69ba646e537ae4d3c82374cd HTTP/1.0" 202 Accepted 2026-03-20 08:38:24,744 - lava_callback - INFO - Starting async job submit for node 69ba646e537ae4d3c82374cd 2026-03-20 08:38:24,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:24,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba646e537ae4d3c82374cd HTTP/1.1" 200 None 2026-03-20 08:38:24,762 - lava_callback - DEBUG - Processing node 69ba646e537ae4d3c82374cd: baseline-arm-clabbe 2026-03-20 08:38:24,762 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba646e537ae4d3c82374cd 2026-03-20 08:38:24,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:24,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba646e537ae4d3c82374cd HTTP/1.1" 200 None 2026-03-20 08:38:24,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:24,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 08:38:24,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:24,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba646e537ae4d3c82374cd HTTP/1.1" 200 None 2026-03-20 08:38:24,817 - lava_callback - ERROR - Error processing callback for node 69ba646e537ae4d3c82374cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 08:38:25,428 - lava_callback - INFO - Received callback for node 69ba646f537ae4d3c82374d0 INFO: 172.21.0.1:39780 - "POST /node/69ba646f537ae4d3c82374d0 HTTP/1.0" 202 Accepted 2026-03-20 08:38:25,434 - lava_callback - INFO - Starting async job submit for node 69ba646f537ae4d3c82374d0 2026-03-20 08:38:25,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:25,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba646f537ae4d3c82374d0 HTTP/1.1" 200 None 2026-03-20 08:38:25,450 - lava_callback - DEBUG - Processing node 69ba646f537ae4d3c82374d0: baseline-arm-clabbe 2026-03-20 08:38:25,450 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba646f537ae4d3c82374d0 2026-03-20 08:38:25,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:25,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba646f537ae4d3c82374d0 HTTP/1.1" 200 None 2026-03-20 08:38:25,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:25,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 08:38:25,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:25,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba646f537ae4d3c82374d0 HTTP/1.1" 200 None 2026-03-20 08:38:25,503 - lava_callback - ERROR - Error processing callback for node 69ba646f537ae4d3c82374d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 08:38:26,094 - lava_callback - INFO - Received callback for node 69ba6472537ae4d3c82374dc INFO: 172.21.0.1:39782 - "POST /node/69ba6472537ae4d3c82374dc HTTP/1.0" 202 Accepted 2026-03-20 08:38:26,099 - lava_callback - INFO - Starting async job submit for node 69ba6472537ae4d3c82374dc 2026-03-20 08:38:26,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:26,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6472537ae4d3c82374dc HTTP/1.1" 200 None 2026-03-20 08:38:26,115 - lava_callback - DEBUG - Processing node 69ba6472537ae4d3c82374dc: baseline-arm-clabbe 2026-03-20 08:38:26,115 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6472537ae4d3c82374dc 2026-03-20 08:38:26,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:26,129 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6472537ae4d3c82374dc HTTP/1.1" 200 None 2026-03-20 08:38:26,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:26,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 08:38:26,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:38:26,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6472537ae4d3c82374dc HTTP/1.1" 200 None 2026-03-20 08:38:26,177 - lava_callback - ERROR - Error processing callback for node 69ba6472537ae4d3c82374dc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51676 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:41:35,147 - lava_callback - INFO - Received callback for node 69bd083505e4bbd6ba635354 INFO: 172.21.0.1:41362 - "POST /node/69bd083505e4bbd6ba635354 HTTP/1.0" 202 Accepted 2026-03-20 08:41:35,153 - lava_callback - INFO - Starting async job submit for node 69bd083505e4bbd6ba635354 2026-03-20 08:41:35,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:41:35,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083505e4bbd6ba635354 HTTP/1.1" 200 None 2026-03-20 08:41:35,171 - lava_callback - DEBUG - Processing node 69bd083505e4bbd6ba635354: baseline-arm 2026-03-20 08:41:35,176 - lava_callback - WARNING - Failed to upload log 2026-03-20 08:41:35,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:41:35,361 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:41:35,363 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083505e4bbd6ba635354/lava-logs.yaml 2026-03-20 08:41:35,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:41:35,473 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:41:35,474 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083505e4bbd6ba635354/lava_callback.json.gz 2026-03-20 08:41:35,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:41:35,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083505e4bbd6ba635354 HTTP/1.1" 200 None 2026-03-20 08:41:35,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:41:35,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:41:35,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:41:35,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd083505e4bbd6ba635354 HTTP/1.1" 200 None 2026-03-20 08:41:35,554 - lava_callback - INFO - Completed processing callback for node 69bd083505e4bbd6ba635354 INFO: 172.21.0.1:41364 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:41:38,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:41:38,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53018 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:41:51,872 - lava_callback - INFO - Received callback for node 69bd083505e4bbd6ba635357 INFO: 172.21.0.1:48598 - "POST /node/69bd083505e4bbd6ba635357 HTTP/1.0" 202 Accepted 2026-03-20 08:41:51,922 - lava_callback - INFO - Starting async job submit for node 69bd083505e4bbd6ba635357 2026-03-20 08:41:51,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:41:51,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083505e4bbd6ba635357 HTTP/1.1" 200 None 2026-03-20 08:41:51,959 - lava_callback - DEBUG - Processing node 69bd083505e4bbd6ba635357: baseline-arm 2026-03-20 08:41:52,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:41:52,222 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:41:52,224 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083505e4bbd6ba635357/log.txt.gz 2026-03-20 08:41:52,298 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:41:52,461 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:41:52,463 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083505e4bbd6ba635357/lava-logs.yaml 2026-03-20 08:41:52,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:41:52,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:41:52,612 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083505e4bbd6ba635357/lava_callback.json.gz 2026-03-20 08:41:52,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:41:52,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083505e4bbd6ba635357 HTTP/1.1" 200 None 2026-03-20 08:41:52,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:41:52,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:41:52,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:41:52,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd083505e4bbd6ba635357 HTTP/1.1" 200 None 2026-03-20 08:41:52,727 - lava_callback - INFO - Completed processing callback for node 69bd083505e4bbd6ba635357 INFO: 172.21.0.1:48602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51722 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:42:08,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:08,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35302 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:42:16,874 - lava_callback - INFO - Received callback for node 69bd083805e4bbd6ba635360 INFO: 172.21.0.1:35310 - "POST /node/69bd083805e4bbd6ba635360 HTTP/1.0" 202 Accepted 2026-03-20 08:42:16,922 - lava_callback - INFO - Starting async job submit for node 69bd083805e4bbd6ba635360 2026-03-20 08:42:16,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:16,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083805e4bbd6ba635360 HTTP/1.1" 200 None 2026-03-20 08:42:16,954 - lava_callback - DEBUG - Processing node 69bd083805e4bbd6ba635360: baseline-arm 2026-03-20 08:42:17,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:17,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:17,249 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083805e4bbd6ba635360/log.txt.gz 2026-03-20 08:42:17,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:17,506 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:17,509 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083805e4bbd6ba635360/lava-logs.yaml 2026-03-20 08:42:17,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:17,637 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:17,639 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083805e4bbd6ba635360/lava_callback.json.gz 2026-03-20 08:42:17,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:17,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083805e4bbd6ba635360 HTTP/1.1" 200 None 2026-03-20 08:42:17,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:17,688 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:42:17,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:17,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd083805e4bbd6ba635360 HTTP/1.1" 200 None 2026-03-20 08:42:17,716 - lava_callback - INFO - Completed processing callback for node 69bd083805e4bbd6ba635360 INFO: 172.21.0.1:32906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:42:38,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:38,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:42:46,979 - lava_callback - INFO - Received callback for node 69bd083405e4bbd6ba635351 INFO: 172.21.0.1:48990 - "POST /node/69bd083405e4bbd6ba635351 HTTP/1.0" 202 Accepted 2026-03-20 08:42:46,985 - lava_callback - INFO - Starting async job submit for node 69bd083405e4bbd6ba635351 2026-03-20 08:42:47,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:47,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083405e4bbd6ba635351 HTTP/1.1" 200 None 2026-03-20 08:42:47,043 - lava_callback - DEBUG - Processing node 69bd083405e4bbd6ba635351: baseline-arm 2026-03-20 08:42:47,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:47,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:47,413 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083405e4bbd6ba635351/log.txt.gz 2026-03-20 08:42:47,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:47,729 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:47,731 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083405e4bbd6ba635351/lava-logs.yaml 2026-03-20 08:42:47,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:47,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:47,872 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083405e4bbd6ba635351/lava_callback.json.gz 2026-03-20 08:42:47,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:47,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083405e4bbd6ba635351 HTTP/1.1" 200 None 2026-03-20 08:42:47,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:47,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:42:47,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:47,951 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd083405e4bbd6ba635351 HTTP/1.1" 200 None 2026-03-20 08:42:47,953 - lava_callback - INFO - Completed processing callback for node 69bd083405e4bbd6ba635351 2026-03-20 08:42:48,528 - lava_callback - INFO - Received callback for node 69bd085305e4bbd6ba6353dd INFO: 172.21.0.1:48992 - "POST /node/69bd085305e4bbd6ba6353dd HTTP/1.0" 202 Accepted 2026-03-20 08:42:48,538 - lava_callback - INFO - Starting async job submit for node 69bd085305e4bbd6ba6353dd 2026-03-20 08:42:48,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:48,588 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd085305e4bbd6ba6353dd HTTP/1.1" 200 None 2026-03-20 08:42:48,589 - lava_callback - DEBUG - Processing node 69bd085305e4bbd6ba6353dd: baseline-arm-pengutronix 2026-03-20 08:42:48,642 - lava_callback - INFO - Received callback for node 69bd083705e4bbd6ba63535d 2026-03-20 08:42:48,667 - lava_callback - INFO - Starting async job submit for node 69bd083705e4bbd6ba63535d INFO: 172.21.0.1:48994 - "POST /node/69bd083705e4bbd6ba63535d HTTP/1.0" 202 Accepted 2026-03-20 08:42:48,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:48,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083705e4bbd6ba63535d HTTP/1.1" 200 None 2026-03-20 08:42:48,838 - lava_callback - DEBUG - Processing node 69bd083705e4bbd6ba63535d: baseline-arm 2026-03-20 08:42:48,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:49,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:49004 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:42:49,444 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:49,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085305e4bbd6ba6353dd/log.txt.gz 2026-03-20 08:42:49,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:49,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:49,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083705e4bbd6ba63535d/log.txt.gz 2026-03-20 08:42:49,868 - lava_callback - INFO - Received callback for node 69bd085105e4bbd6ba6353da 2026-03-20 08:42:49,902 - lava_callback - INFO - Starting async job submit for node 69bd085105e4bbd6ba6353da INFO: 172.21.0.1:51664 - "POST /node/69bd085105e4bbd6ba6353da HTTP/1.0" 202 Accepted 2026-03-20 08:42:49,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:50,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:50,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd085105e4bbd6ba6353da HTTP/1.1" 200 None 2026-03-20 08:42:50,014 - lava_callback - DEBUG - Processing node 69bd085105e4bbd6ba6353da: baseline-arm-pengutronix 2026-03-20 08:42:50,239 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:50,242 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085305e4bbd6ba6353dd/lava-logs.yaml 2026-03-20 08:42:50,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:50,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:50,724 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:50,726 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083705e4bbd6ba63535d/lava-logs.yaml 2026-03-20 08:42:50,733 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:50,783 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:50,785 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085105e4bbd6ba6353da/log.txt.gz 2026-03-20 08:42:50,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:50,885 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085305e4bbd6ba6353dd/lava_callback.json.gz 2026-03-20 08:42:50,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:50,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:50,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd085305e4bbd6ba6353dd HTTP/1.1" 200 None 2026-03-20 08:42:50,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:50,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:42:50,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:51,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd085305e4bbd6ba6353dd HTTP/1.1" 200 None 2026-03-20 08:42:51,025 - lava_callback - INFO - Completed processing callback for node 69bd085305e4bbd6ba6353dd 2026-03-20 08:42:51,410 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:51,412 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083705e4bbd6ba63535d/lava_callback.json.gz 2026-03-20 08:42:51,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:51,455 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083705e4bbd6ba63535d HTTP/1.1" 200 None 2026-03-20 08:42:51,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:51,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:42:51,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:51,512 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd083705e4bbd6ba63535d HTTP/1.1" 200 None 2026-03-20 08:42:51,514 - lava_callback - INFO - Completed processing callback for node 69bd083705e4bbd6ba63535d 2026-03-20 08:42:51,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:51,615 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085105e4bbd6ba6353da/lava-logs.yaml 2026-03-20 08:42:51,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:52,200 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:52,202 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085105e4bbd6ba6353da/lava_callback.json.gz 2026-03-20 08:42:52,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:52,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd085105e4bbd6ba6353da HTTP/1.1" 200 None 2026-03-20 08:42:52,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:52,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:42:52,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:52,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd085105e4bbd6ba6353da HTTP/1.1" 200 None 2026-03-20 08:42:52,346 - lava_callback - INFO - Completed processing callback for node 69bd085105e4bbd6ba6353da INFO: 172.21.0.1:51678 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:42:58,091 - lava_callback - INFO - Received callback for node 69bd085505e4bbd6ba635415 INFO: 172.21.0.1:51688 - "POST /node/69bd085505e4bbd6ba635415 HTTP/1.0" 202 Accepted 2026-03-20 08:42:58,140 - lava_callback - INFO - Starting async job submit for node 69bd085505e4bbd6ba635415 2026-03-20 08:42:58,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:42:58,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd085505e4bbd6ba635415 HTTP/1.1" 200 None 2026-03-20 08:42:58,194 - lava_callback - DEBUG - Processing node 69bd085505e4bbd6ba635415: baseline-arm-pengutronix 2026-03-20 08:42:58,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:58,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:58,847 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085505e4bbd6ba635415/log.txt.gz 2026-03-20 08:42:58,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:59,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:59,496 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085505e4bbd6ba635415/lava-logs.yaml 2026-03-20 08:42:59,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:42:59,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:42:59,985 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085505e4bbd6ba635415/lava_callback.json.gz 2026-03-20 08:43:00,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:00,040 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd085505e4bbd6ba635415 HTTP/1.1" 200 None 2026-03-20 08:43:00,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:00,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:43:00,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:00,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd085505e4bbd6ba635415 HTTP/1.1" 200 None 2026-03-20 08:43:00,108 - lava_callback - INFO - Completed processing callback for node 69bd085505e4bbd6ba635415 INFO: 172.21.0.1:50844 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:43:07,054 - lava_callback - INFO - Received callback for node 69bd084005e4bbd6ba63539f INFO: 172.21.0.1:50856 - "POST /node/69bd084005e4bbd6ba63539f HTTP/1.0" 202 Accepted 2026-03-20 08:43:07,063 - lava_callback - INFO - Starting async job submit for node 69bd084005e4bbd6ba63539f 2026-03-20 08:43:07,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:07,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084005e4bbd6ba63539f HTTP/1.1" 200 None 2026-03-20 08:43:07,116 - lava_callback - DEBUG - Processing node 69bd084005e4bbd6ba63539f: baseline-arm-broonie 2026-03-20 08:43:07,402 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:07,865 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:07,867 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd084005e4bbd6ba63539f/log.txt.gz 2026-03-20 08:43:08,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:08,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:08,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-20 08:43:08,570 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:08,572 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd084005e4bbd6ba63539f/lava-logs.yaml 2026-03-20 08:43:08,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:09,025 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:09,027 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd084005e4bbd6ba63539f/lava_callback.json.gz 2026-03-20 08:43:09,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:09,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084005e4bbd6ba63539f HTTP/1.1" 200 None 2026-03-20 08:43:09,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:09,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:43:09,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:09,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd084005e4bbd6ba63539f HTTP/1.1" 200 None 2026-03-20 08:43:09,157 - lava_callback - INFO - Completed processing callback for node 69bd084005e4bbd6ba63539f INFO: 172.21.0.1:37906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:43:19,536 - lava_callback - INFO - Received callback for node 69bd084705e4bbd6ba6353b5 INFO: 172.21.0.1:37912 - "POST /node/69bd084705e4bbd6ba6353b5 HTTP/1.0" 202 Accepted 2026-03-20 08:43:19,545 - lava_callback - INFO - Starting async job submit for node 69bd084705e4bbd6ba6353b5 2026-03-20 08:43:19,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:19,604 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084705e4bbd6ba6353b5 HTTP/1.1" 200 None 2026-03-20 08:43:19,605 - lava_callback - DEBUG - Processing node 69bd084705e4bbd6ba6353b5: baseline-arm-clabbe 2026-03-20 08:43:19,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:20,756 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:20,758 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084705e4bbd6ba6353b5/log.txt.gz 2026-03-20 08:43:20,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:21,907 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:21,909 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084705e4bbd6ba6353b5/lava-logs.yaml 2026-03-20 08:43:21,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:22,034 - lava_callback - INFO - Received callback for node 69bd084405e4bbd6ba6353a6 INFO: 172.21.0.1:37648 - "POST /node/69bd084405e4bbd6ba6353a6 HTTP/1.0" 202 Accepted 2026-03-20 08:43:22,044 - lava_callback - INFO - Starting async job submit for node 69bd084405e4bbd6ba6353a6 2026-03-20 08:43:22,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:22,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084405e4bbd6ba6353a6 HTTP/1.1" 200 None 2026-03-20 08:43:22,113 - lava_callback - DEBUG - Processing node 69bd084405e4bbd6ba6353a6: baseline-arm-broonie 2026-03-20 08:43:22,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:22,909 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:22,911 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084705e4bbd6ba6353b5/lava_callback.json.gz 2026-03-20 08:43:22,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:22,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084705e4bbd6ba6353b5 HTTP/1.1" 200 None 2026-03-20 08:43:22,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:23,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:43:23,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:23,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd084705e4bbd6ba6353b5 HTTP/1.1" 200 None 2026-03-20 08:43:23,054 - lava_callback - INFO - Completed processing callback for node 69bd084705e4bbd6ba6353b5 2026-03-20 08:43:23,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:23,540 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd084405e4bbd6ba6353a6/log.txt.gz 2026-03-20 08:43:23,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:24,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:24,838 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd084405e4bbd6ba6353a6/lava-logs.yaml 2026-03-20 08:43:24,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:25,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:25,748 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd084405e4bbd6ba6353a6/lava_callback.json.gz 2026-03-20 08:43:25,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:25,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084405e4bbd6ba6353a6 HTTP/1.1" 200 None 2026-03-20 08:43:25,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:25,826 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:43:25,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:25,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd084405e4bbd6ba6353a6 HTTP/1.1" 200 None 2026-03-20 08:43:25,866 - lava_callback - INFO - Completed processing callback for node 69bd084405e4bbd6ba6353a6 INFO: 172.21.0.1:37660 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:43:27,323 - lava_callback - INFO - Received callback for node 69bd084205e4bbd6ba6353a3 INFO: 172.21.0.1:37666 - "POST /node/69bd084205e4bbd6ba6353a3 HTTP/1.0" 202 Accepted 2026-03-20 08:43:27,333 - lava_callback - INFO - Starting async job submit for node 69bd084205e4bbd6ba6353a3 2026-03-20 08:43:27,371 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:27,392 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084205e4bbd6ba6353a3 HTTP/1.1" 200 None 2026-03-20 08:43:27,393 - lava_callback - DEBUG - Processing node 69bd084205e4bbd6ba6353a3: baseline-arm-broonie 2026-03-20 08:43:27,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:28,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:28,665 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd084205e4bbd6ba6353a3/log.txt.gz 2026-03-20 08:43:28,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:29,842 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:29,845 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd084205e4bbd6ba6353a3/lava-logs.yaml 2026-03-20 08:43:29,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:43:30,843 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:43:30,845 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bd084205e4bbd6ba6353a3/lava_callback.json.gz 2026-03-20 08:43:30,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:30,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084205e4bbd6ba6353a3 HTTP/1.1" 200 None 2026-03-20 08:43:30,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:30,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:43:30,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:30,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd084205e4bbd6ba6353a3 HTTP/1.1" 200 None 2026-03-20 08:43:30,963 - lava_callback - INFO - Completed processing callback for node 69bd084205e4bbd6ba6353a3 INFO: 172.21.0.1:53578 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:43:38,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:43:38,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.21.0.1:51194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51984 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:44:04,650 - lava_callback - INFO - Received callback for node 69bd086b05e4bbd6ba635437 INFO: 172.21.0.1:39050 - "POST /node/69bd086b05e4bbd6ba635437 HTTP/1.0" 202 Accepted 2026-03-20 08:44:04,658 - lava_callback - INFO - Starting async job submit for node 69bd086b05e4bbd6ba635437 2026-03-20 08:44:04,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:44:04,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd086b05e4bbd6ba635437 HTTP/1.1" 200 None 2026-03-20 08:44:04,716 - lava_callback - DEBUG - Processing node 69bd086b05e4bbd6ba635437: ltp-dio 2026-03-20 08:44:05,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:44:06,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:44:06,327 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69bd086b05e4bbd6ba635437/log.txt.gz INFO: 172.21.0.1:39058 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:44:06,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:44:07,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:44:07,741 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69bd086b05e4bbd6ba635437/lava-logs.yaml 2026-03-20 08:44:07,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:44:08,742 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:44:08,744 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69bd086b05e4bbd6ba635437/lava_callback.json.gz 2026-03-20 08:44:08,771 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:44:08,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd086b05e4bbd6ba635437 HTTP/1.1" 200 None 2026-03-20 08:44:08,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:44:08,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:44:08,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:44:08,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd086b05e4bbd6ba635437 HTTP/1.1" 200 None 2026-03-20 08:44:08,873 - lava_callback - INFO - Completed processing callback for node 69bd086b05e4bbd6ba635437 INFO: 172.21.0.1:40430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48986 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:44:38,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:44:38,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35178 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:44:54,651 - lava_callback - INFO - Received callback for node 69bd084905e4bbd6ba6353b9 INFO: 172.21.0.1:58040 - "POST /node/69bd084905e4bbd6ba6353b9 HTTP/1.0" 202 Accepted 2026-03-20 08:44:54,661 - lava_callback - INFO - Starting async job submit for node 69bd084905e4bbd6ba6353b9 2026-03-20 08:44:54,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:44:54,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084905e4bbd6ba6353b9 HTTP/1.1" 200 None 2026-03-20 08:44:54,766 - lava_callback - DEBUG - Processing node 69bd084905e4bbd6ba6353b9: baseline-arm-clabbe 2026-03-20 08:44:55,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:44:55,662 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:44:55,664 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084905e4bbd6ba6353b9/log.txt.gz 2026-03-20 08:44:55,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:58044 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:44:56,482 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:44:56,484 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084905e4bbd6ba6353b9/lava-logs.yaml 2026-03-20 08:44:56,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:44:57,007 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:44:57,009 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084905e4bbd6ba6353b9/lava_callback.json.gz 2026-03-20 08:44:57,046 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:44:57,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084905e4bbd6ba6353b9 HTTP/1.1" 200 None 2026-03-20 08:44:57,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:44:57,079 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:44:57,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:44:57,117 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd084905e4bbd6ba6353b9 HTTP/1.1" 200 None 2026-03-20 08:44:57,118 - lava_callback - INFO - Completed processing callback for node 69bd084905e4bbd6ba6353b9 INFO: 172.21.0.1:56708 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:45:08,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:08,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-20 08:45:09,960 - lava_callback - INFO - Received callback for node 69bd08f605e4bbd6ba63556c INFO: 172.21.0.1:42392 - "POST /node/69bd08f605e4bbd6ba63556c HTTP/1.0" 202 Accepted 2026-03-20 08:45:09,971 - lava_callback - INFO - Starting async job submit for node 69bd08f605e4bbd6ba63556c 2026-03-20 08:45:10,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:10,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08f605e4bbd6ba63556c HTTP/1.1" 200 None 2026-03-20 08:45:10,052 - lava_callback - DEBUG - Processing node 69bd08f605e4bbd6ba63556c: baseline-arm64 2026-03-20 08:45:10,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:45:10,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:45:10,487 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08f605e4bbd6ba63556c/log.txt.gz 2026-03-20 08:45:10,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:45:10,981 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:45:10,983 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08f605e4bbd6ba63556c/lava-logs.yaml 2026-03-20 08:45:10,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:45:11,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:45:11,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08f605e4bbd6ba63556c/lava_callback.json.gz 2026-03-20 08:45:11,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:11,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08f605e4bbd6ba63556c HTTP/1.1" 200 None 2026-03-20 08:45:11,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:11,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:45:11,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:11,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd08f605e4bbd6ba63556c HTTP/1.1" 200 None 2026-03-20 08:45:11,367 - lava_callback - INFO - Completed processing callback for node 69bd08f605e4bbd6ba63556c INFO: 172.21.0.1:42400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58878 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:45:31,631 - lava_callback - INFO - Received callback for node 69bd091a05e4bbd6ba635602 INFO: 172.21.0.1:52022 - "POST /node/69bd091a05e4bbd6ba635602 HTTP/1.0" 202 Accepted 2026-03-20 08:45:31,640 - lava_callback - INFO - Starting async job submit for node 69bd091a05e4bbd6ba635602 2026-03-20 08:45:31,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:31,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091a05e4bbd6ba635602 HTTP/1.1" 200 None 2026-03-20 08:45:31,681 - lava_callback - DEBUG - Processing node 69bd091a05e4bbd6ba635602: baseline-nfs-arm64 2026-03-20 08:45:31,683 - lava_callback - WARNING - Failed to upload log 2026-03-20 08:45:31,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:45:31,922 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:45:31,924 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091a05e4bbd6ba635602/lava-logs.yaml 2026-03-20 08:45:31,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:45:32,065 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:45:32,066 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091a05e4bbd6ba635602/lava_callback.json.gz 2026-03-20 08:45:32,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:32,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091a05e4bbd6ba635602 HTTP/1.1" 200 None 2026-03-20 08:45:32,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:32,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:45:32,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:32,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd091a05e4bbd6ba635602 HTTP/1.1" 200 None 2026-03-20 08:45:32,143 - lava_callback - INFO - Completed processing callback for node 69bd091a05e4bbd6ba635602 2026-03-20 08:45:32,813 - lava_callback - INFO - Received callback for node 69bd090605e4bbd6ba63558d INFO: 172.21.0.1:52032 - "POST /node/69bd090605e4bbd6ba63558d HTTP/1.0" 202 Accepted 2026-03-20 08:45:32,820 - lava_callback - INFO - Starting async job submit for node 69bd090605e4bbd6ba63558d 2026-03-20 08:45:32,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:32,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090605e4bbd6ba63558d HTTP/1.1" 200 None 2026-03-20 08:45:32,857 - lava_callback - DEBUG - Processing node 69bd090605e4bbd6ba63558d: baseline-arm64 2026-03-20 08:45:33,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:45:33,609 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:45:33,611 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090605e4bbd6ba63558d/log.txt.gz 2026-03-20 08:45:33,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:45:34,282 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:45:34,284 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090605e4bbd6ba63558d/lava-logs.yaml 2026-03-20 08:45:34,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:45:34,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:45:34,471 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090605e4bbd6ba63558d/lava_callback.json.gz 2026-03-20 08:45:34,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:34,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090605e4bbd6ba63558d HTTP/1.1" 200 None 2026-03-20 08:45:34,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:34,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:45:34,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:34,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd090605e4bbd6ba63558d HTTP/1.1" 200 None 2026-03-20 08:45:34,613 - lava_callback - INFO - Completed processing callback for node 69bd090605e4bbd6ba63558d INFO: 172.21.0.1:52042 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:45:38,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:38,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42372 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:45:50,170 - lava_callback - INFO - Received callback for node 69bd08f805e4bbd6ba635572 INFO: 172.21.0.1:47128 - "POST /node/69bd08f805e4bbd6ba635572 HTTP/1.0" 202 Accepted 2026-03-20 08:45:50,179 - lava_callback - INFO - Starting async job submit for node 69bd08f805e4bbd6ba635572 2026-03-20 08:45:50,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:50,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08f805e4bbd6ba635572 HTTP/1.1" 200 None 2026-03-20 08:45:50,229 - lava_callback - DEBUG - Processing node 69bd08f805e4bbd6ba635572: baseline-arm64 2026-03-20 08:45:50,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:45:50,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:45:50,847 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08f805e4bbd6ba635572/log.txt.gz 2026-03-20 08:45:51,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:45:51,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:45:51,640 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08f805e4bbd6ba635572/lava-logs.yaml 2026-03-20 08:45:51,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:45:51,830 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:45:51,832 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08f805e4bbd6ba635572/lava_callback.json.gz 2026-03-20 08:45:51,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:51,889 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08f805e4bbd6ba635572 HTTP/1.1" 200 None 2026-03-20 08:45:51,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:51,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:45:51,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:51,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd08f805e4bbd6ba635572 HTTP/1.1" 200 None 2026-03-20 08:45:51,960 - lava_callback - INFO - Completed processing callback for node 69bd08f805e4bbd6ba635572 INFO: 172.21.0.1:47144 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:45:59,624 - lava_callback - INFO - Received callback for node 69bd090305e4bbd6ba635587 INFO: 172.21.0.1:47156 - "POST /node/69bd090305e4bbd6ba635587 HTTP/1.0" 202 Accepted 2026-03-20 08:45:59,634 - lava_callback - INFO - Starting async job submit for node 69bd090305e4bbd6ba635587 2026-03-20 08:45:59,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:45:59,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090305e4bbd6ba635587 HTTP/1.1" 200 None 2026-03-20 08:45:59,717 - lava_callback - DEBUG - Processing node 69bd090305e4bbd6ba635587: baseline-arm64 2026-03-20 08:46:00,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:00,703 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:00,705 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090305e4bbd6ba635587/log.txt.gz 2026-03-20 08:46:00,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:01,043 - lava_callback - INFO - Received callback for node 69bd090205e4bbd6ba635584 INFO: 172.21.0.1:58208 - "POST /node/69bd090205e4bbd6ba635584 HTTP/1.0" 202 Accepted 2026-03-20 08:46:01,049 - lava_callback - INFO - Starting async job submit for node 69bd090205e4bbd6ba635584 2026-03-20 08:46:01,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:01,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090205e4bbd6ba635584 HTTP/1.1" 200 None 2026-03-20 08:46:01,090 - lava_callback - DEBUG - Processing node 69bd090205e4bbd6ba635584: baseline-arm64 2026-03-20 08:46:01,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:01,693 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090305e4bbd6ba635587/lava-logs.yaml 2026-03-20 08:46:01,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:01,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:01,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:01,850 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090205e4bbd6ba635584/log.txt.gz 2026-03-20 08:46:01,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:01,933 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090305e4bbd6ba635587/lava_callback.json.gz 2026-03-20 08:46:02,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:02,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090305e4bbd6ba635587 HTTP/1.1" 200 None 2026-03-20 08:46:02,081 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:02,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:02,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:02,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:02,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd090305e4bbd6ba635587 HTTP/1.1" 200 None 2026-03-20 08:46:02,230 - lava_callback - INFO - Completed processing callback for node 69bd090305e4bbd6ba635587 2026-03-20 08:46:02,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:02,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090205e4bbd6ba635584/lava-logs.yaml 2026-03-20 08:46:02,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:02,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:02,975 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090205e4bbd6ba635584/lava_callback.json.gz 2026-03-20 08:46:03,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:03,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090205e4bbd6ba635584 HTTP/1.1" 200 None 2026-03-20 08:46:03,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:03,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:03,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:03,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd090205e4bbd6ba635584 HTTP/1.1" 200 None 2026-03-20 08:46:03,129 - lava_callback - INFO - Completed processing callback for node 69bd090205e4bbd6ba635584 INFO: 172.21.0.1:58212 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:46:08,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:08,429 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-20 08:46:08,731 - lava_callback - INFO - Received callback for node 69bd090805e4bbd6ba635590 INFO: 172.21.0.1:58218 - "POST /node/69bd090805e4bbd6ba635590 HTTP/1.0" 202 Accepted 2026-03-20 08:46:08,740 - lava_callback - INFO - Starting async job submit for node 69bd090805e4bbd6ba635590 2026-03-20 08:46:08,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:08,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090805e4bbd6ba635590 HTTP/1.1" 200 None 2026-03-20 08:46:08,814 - lava_callback - DEBUG - Processing node 69bd090805e4bbd6ba635590: baseline-arm64 2026-03-20 08:46:09,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:09,375 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:09,377 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090805e4bbd6ba635590/log.txt.gz 2026-03-20 08:46:09,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:10,020 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:10,022 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090805e4bbd6ba635590/lava-logs.yaml 2026-03-20 08:46:10,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:10,157 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:10,159 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090805e4bbd6ba635590/lava_callback.json.gz 2026-03-20 08:46:10,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:10,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090805e4bbd6ba635590 HTTP/1.1" 200 None 2026-03-20 08:46:10,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:10,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:10,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:10,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd090805e4bbd6ba635590 HTTP/1.1" 200 None 2026-03-20 08:46:10,331 - lava_callback - INFO - Completed processing callback for node 69bd090805e4bbd6ba635590 2026-03-20 08:46:14,127 - lava_callback - INFO - Received callback for node 69bd08f705e4bbd6ba63556f INFO: 172.21.0.1:57924 - "POST /node/69bd08f705e4bbd6ba63556f HTTP/1.0" 202 Accepted 2026-03-20 08:46:14,137 - lava_callback - INFO - Starting async job submit for node 69bd08f705e4bbd6ba63556f 2026-03-20 08:46:14,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:14,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08f705e4bbd6ba63556f HTTP/1.1" 200 None 2026-03-20 08:46:14,215 - lava_callback - DEBUG - Processing node 69bd08f705e4bbd6ba63556f: baseline-arm64 2026-03-20 08:46:14,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:14,734 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:14,736 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08f705e4bbd6ba63556f/log.txt.gz 2026-03-20 08:46:14,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:57938 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-20 08:46:15,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:15,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08f705e4bbd6ba63556f/lava-logs.yaml 2026-03-20 08:46:15,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:15,470 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:15,472 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08f705e4bbd6ba63556f/lava_callback.json.gz 2026-03-20 08:46:15,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:15,509 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08f705e4bbd6ba63556f HTTP/1.1" 200 None 2026-03-20 08:46:15,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:15,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:15,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:15,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd08f705e4bbd6ba63556f HTTP/1.1" 200 None 2026-03-20 08:46:15,565 - lava_callback - INFO - Completed processing callback for node 69bd08f705e4bbd6ba63556f 2026-03-20 08:46:15,746 - lava_callback - INFO - Received callback for node 69bd08fb05e4bbd6ba635578 INFO: 172.21.0.1:57944 - "POST /node/69bd08fb05e4bbd6ba635578 HTTP/1.0" 202 Accepted 2026-03-20 08:46:15,761 - lava_callback - INFO - Starting async job submit for node 69bd08fb05e4bbd6ba635578 2026-03-20 08:46:15,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:15,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08fb05e4bbd6ba635578 HTTP/1.1" 200 None 2026-03-20 08:46:15,866 - lava_callback - DEBUG - Processing node 69bd08fb05e4bbd6ba635578: baseline-arm64 2026-03-20 08:46:16,110 - lava_callback - WARNING - Failed to upload log 2026-03-20 08:46:16,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:46:16,670 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:16,672 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08fb05e4bbd6ba635578/lava-logs.yaml 2026-03-20 08:46:16,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:16,818 - lava_callback - INFO - Received callback for node 69bd08fd05e4bbd6ba63557b INFO: 172.21.0.1:57950 - "POST /node/69bd08fd05e4bbd6ba63557b HTTP/1.0" 202 Accepted 2026-03-20 08:46:16,830 - lava_callback - INFO - Starting async job submit for node 69bd08fd05e4bbd6ba63557b 2026-03-20 08:46:16,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:16,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08fd05e4bbd6ba63557b HTTP/1.1" 200 None 2026-03-20 08:46:16,946 - lava_callback - DEBUG - Processing node 69bd08fd05e4bbd6ba63557b: baseline-arm64 2026-03-20 08:46:17,217 - lava_callback - WARNING - Failed to upload log 2026-03-20 08:46:17,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:17,414 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:17,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08fb05e4bbd6ba635578/lava_callback.json.gz 2026-03-20 08:46:17,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:17,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08fb05e4bbd6ba635578 HTTP/1.1" 200 None 2026-03-20 08:46:17,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:17,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:17,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:17,603 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd08fb05e4bbd6ba635578 HTTP/1.1" 200 None 2026-03-20 08:46:17,693 - lava_callback - INFO - Completed processing callback for node 69bd08fb05e4bbd6ba635578 2026-03-20 08:46:18,067 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:18,069 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08fd05e4bbd6ba63557b/lava-logs.yaml 2026-03-20 08:46:18,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:18,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:18,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08fd05e4bbd6ba63557b/lava_callback.json.gz 2026-03-20 08:46:18,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:18,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08fd05e4bbd6ba63557b HTTP/1.1" 200 None 2026-03-20 08:46:18,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:18,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:18,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:18,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd08fd05e4bbd6ba63557b HTTP/1.1" 200 None 2026-03-20 08:46:18,690 - lava_callback - INFO - Completed processing callback for node 69bd08fd05e4bbd6ba63557b 2026-03-20 08:46:19,503 - lava_callback - INFO - Received callback for node 69bd090005e4bbd6ba635581 INFO: 172.21.0.1:57954 - "POST /node/69bd090005e4bbd6ba635581 HTTP/1.0" 202 Accepted 2026-03-20 08:46:19,511 - lava_callback - INFO - Starting async job submit for node 69bd090005e4bbd6ba635581 2026-03-20 08:46:19,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:19,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090005e4bbd6ba635581 HTTP/1.1" 200 None 2026-03-20 08:46:19,562 - lava_callback - DEBUG - Processing node 69bd090005e4bbd6ba635581: baseline-arm64 2026-03-20 08:46:19,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:20,494 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:20,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090005e4bbd6ba635581/log.txt.gz 2026-03-20 08:46:20,685 - lava_callback - INFO - Received callback for node 69bd090b05e4bbd6ba6355cd INFO: 172.21.0.1:60024 - "POST /node/69bd090b05e4bbd6ba6355cd HTTP/1.0" 202 Accepted 2026-03-20 08:46:20,692 - lava_callback - INFO - Starting async job submit for node 69bd090b05e4bbd6ba6355cd 2026-03-20 08:46:20,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:20,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:20,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090b05e4bbd6ba6355cd HTTP/1.1" 200 None 2026-03-20 08:46:20,756 - lava_callback - DEBUG - Processing node 69bd090b05e4bbd6ba6355cd: baseline-arm64 2026-03-20 08:46:21,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:21,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:21,613 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090b05e4bbd6ba6355cd/log.txt.gz 2026-03-20 08:46:21,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:21,753 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090005e4bbd6ba635581/lava-logs.yaml 2026-03-20 08:46:21,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:21,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:22,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:22,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090005e4bbd6ba635581/lava_callback.json.gz 2026-03-20 08:46:22,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:22,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090005e4bbd6ba635581 HTTP/1.1" 200 None 2026-03-20 08:46:22,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:22,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:22,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:22,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:22,802 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090b05e4bbd6ba6355cd/lava-logs.yaml 2026-03-20 08:46:22,810 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:22,834 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd090005e4bbd6ba635581 HTTP/1.1" 200 None 2026-03-20 08:46:22,836 - lava_callback - INFO - Completed processing callback for node 69bd090005e4bbd6ba635581 2026-03-20 08:46:23,766 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:23,768 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090b05e4bbd6ba6355cd/lava_callback.json.gz 2026-03-20 08:46:23,792 - lava_callback - INFO - Received callback for node 69bd08fa05e4bbd6ba635575 INFO: 172.21.0.1:60034 - "POST /node/69bd08fa05e4bbd6ba635575 HTTP/1.0" 202 Accepted 2026-03-20 08:46:23,818 - lava_callback - INFO - Starting async job submit for node 69bd08fa05e4bbd6ba635575 2026-03-20 08:46:23,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:23,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:23,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090b05e4bbd6ba6355cd HTTP/1.1" 200 None 2026-03-20 08:46:23,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:23,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08fa05e4bbd6ba635575 HTTP/1.1" 200 None 2026-03-20 08:46:23,905 - lava_callback - DEBUG - Processing node 69bd08fa05e4bbd6ba635575: baseline-arm64 2026-03-20 08:46:23,942 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:23,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:24,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd090b05e4bbd6ba6355cd HTTP/1.1" 200 None 2026-03-20 08:46:24,046 - lava_callback - INFO - Completed processing callback for node 69bd090b05e4bbd6ba6355cd 2026-03-20 08:46:24,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:25,086 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:25,088 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08fa05e4bbd6ba635575/log.txt.gz 2026-03-20 08:46:25,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:25,700 - lava_callback - INFO - Received callback for node 69bd084c05e4bbd6ba6353c5 INFO: 172.21.0.1:60046 - "POST /node/69bd084c05e4bbd6ba6353c5 HTTP/1.0" 202 Accepted 2026-03-20 08:46:25,709 - lava_callback - INFO - Starting async job submit for node 69bd084c05e4bbd6ba6353c5 2026-03-20 08:46:25,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:25,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084c05e4bbd6ba6353c5 HTTP/1.1" 200 None 2026-03-20 08:46:25,783 - lava_callback - DEBUG - Processing node 69bd084c05e4bbd6ba6353c5: baseline-arm-clabbe 2026-03-20 08:46:26,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:26,197 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:26,199 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08fa05e4bbd6ba635575/lava-logs.yaml 2026-03-20 08:46:26,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:26,443 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:26,445 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084c05e4bbd6ba6353c5/log.txt.gz INFO: 172.21.0.1:60052 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:46:26,523 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:26,530 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08fa05e4bbd6ba635575/lava_callback.json.gz 2026-03-20 08:46:26,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:26,676 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08fa05e4bbd6ba635575 HTTP/1.1" 200 None 2026-03-20 08:46:26,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:26,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:26,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:26,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:26,749 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd08fa05e4bbd6ba635575 HTTP/1.1" 200 None 2026-03-20 08:46:26,751 - lava_callback - INFO - Completed processing callback for node 69bd08fa05e4bbd6ba635575 2026-03-20 08:46:27,841 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:27,843 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084c05e4bbd6ba6353c5/lava-logs.yaml 2026-03-20 08:46:27,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:28,617 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:28,620 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084c05e4bbd6ba6353c5/lava_callback.json.gz 2026-03-20 08:46:28,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:28,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084c05e4bbd6ba6353c5 HTTP/1.1" 200 None 2026-03-20 08:46:28,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:28,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:46:28,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:28,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd084c05e4bbd6ba6353c5 HTTP/1.1" 200 None 2026-03-20 08:46:28,778 - lava_callback - INFO - Completed processing callback for node 69bd084c05e4bbd6ba6353c5 2026-03-20 08:46:31,120 - lava_callback - INFO - Received callback for node 69bd091705e4bbd6ba6355fb INFO: 172.21.0.1:38958 - "POST /node/69bd091705e4bbd6ba6355fb HTTP/1.0" 202 Accepted 2026-03-20 08:46:31,135 - lava_callback - INFO - Starting async job submit for node 69bd091705e4bbd6ba6355fb 2026-03-20 08:46:31,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:31,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091705e4bbd6ba6355fb HTTP/1.1" 200 None 2026-03-20 08:46:31,181 - lava_callback - DEBUG - Processing node 69bd091705e4bbd6ba6355fb: baseline-nfs-arm64 2026-03-20 08:46:31,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:32,268 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:32,270 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091705e4bbd6ba6355fb/log.txt.gz 2026-03-20 08:46:32,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:33,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:33,423 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091705e4bbd6ba6355fb/lava-logs.yaml 2026-03-20 08:46:33,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:33,579 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:33,581 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091705e4bbd6ba6355fb/lava_callback.json.gz 2026-03-20 08:46:33,605 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:33,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091705e4bbd6ba6355fb HTTP/1.1" 200 None 2026-03-20 08:46:33,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:33,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:33,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:33,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd091705e4bbd6ba6355fb HTTP/1.1" 200 None 2026-03-20 08:46:33,704 - lava_callback - INFO - Completed processing callback for node 69bd091705e4bbd6ba6355fb INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:46:38,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:38,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-20 08:46:38,920 - lava_callback - INFO - Received callback for node 69bd091905e4bbd6ba6355ff INFO: 172.21.0.1:38990 - "POST /node/69bd091905e4bbd6ba6355ff HTTP/1.0" 202 Accepted 2026-03-20 08:46:38,928 - lava_callback - INFO - Starting async job submit for node 69bd091905e4bbd6ba6355ff 2026-03-20 08:46:38,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:38,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091905e4bbd6ba6355ff HTTP/1.1" 200 None 2026-03-20 08:46:38,974 - lava_callback - DEBUG - Processing node 69bd091905e4bbd6ba6355ff: baseline-nfs-arm64 2026-03-20 08:46:39,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:40,225 - lava_callback - INFO - Received callback for node 69bd092005e4bbd6ba635612 INFO: 172.21.0.1:44648 - "POST /node/69bd092005e4bbd6ba635612 HTTP/1.0" 202 Accepted 2026-03-20 08:46:40,236 - lava_callback - INFO - Starting async job submit for node 69bd092005e4bbd6ba635612 2026-03-20 08:46:40,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:40,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092005e4bbd6ba635612 HTTP/1.1" 200 None 2026-03-20 08:46:40,299 - lava_callback - DEBUG - Processing node 69bd092005e4bbd6ba635612: baseline-nfs-arm64 2026-03-20 08:46:40,601 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:40,618 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091905e4bbd6ba6355ff/log.txt.gz 2026-03-20 08:46:41,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:41,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:41,380 - lava_callback - INFO - Received callback for node 69bd090e05e4bbd6ba6355de INFO: 172.21.0.1:44664 - "POST /node/69bd090e05e4bbd6ba6355de HTTP/1.0" 202 Accepted 2026-03-20 08:46:41,391 - lava_callback - INFO - Starting async job submit for node 69bd090e05e4bbd6ba6355de 2026-03-20 08:46:41,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:41,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090e05e4bbd6ba6355de HTTP/1.1" 200 None 2026-03-20 08:46:41,443 - lava_callback - DEBUG - Processing node 69bd090e05e4bbd6ba6355de: baseline-arm64 2026-03-20 08:46:41,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:42,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:42,090 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd092005e4bbd6ba635612/log.txt.gz 2026-03-20 08:46:42,244 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:42,290 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091905e4bbd6ba6355ff/lava-logs.yaml 2026-03-20 08:46:42,330 - lava_callback - INFO - Received callback for node 69bd087105e4bbd6ba63546d 2026-03-20 08:46:42,372 - lava_callback - INFO - Starting async job submit for node 69bd087105e4bbd6ba63546d INFO: 172.21.0.1:44674 - "POST /node/69bd087105e4bbd6ba63546d HTTP/1.0" 202 Accepted 2026-03-20 08:46:42,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:42,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:42,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:42,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd087105e4bbd6ba63546d HTTP/1.1" 200 None 2026-03-20 08:46:42,499 - lava_callback - DEBUG - Processing node 69bd087105e4bbd6ba63546d: ltp-syscalls 2026-03-20 08:46:42,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:42,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090e05e4bbd6ba6355de/log.txt.gz 2026-03-20 08:46:43,303 - lava_callback - INFO - Received callback for node 69bd094205e4bbd6ba635691 2026-03-20 08:46:43,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:43,330 - lava_callback - INFO - Starting async job submit for node 69bd094205e4bbd6ba635691 INFO: 172.21.0.1:44682 - "POST /node/69bd094205e4bbd6ba635691 HTTP/1.0" 202 Accepted 2026-03-20 08:46:43,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:43,453 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:43,460 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091905e4bbd6ba6355ff/lava_callback.json.gz 2026-03-20 08:46:43,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd094205e4bbd6ba635691 HTTP/1.1" 200 None 2026-03-20 08:46:43,561 - lava_callback - DEBUG - Processing node 69bd094205e4bbd6ba635691: baseline-arm64-pengutronix 2026-03-20 08:46:43,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:43,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091905e4bbd6ba6355ff HTTP/1.1" 200 None 2026-03-20 08:46:43,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:43,814 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:43,827 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd092005e4bbd6ba635612/lava-logs.yaml 2026-03-20 08:46:43,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:43,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:43,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:44,199 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd091905e4bbd6ba6355ff HTTP/1.1" 200 None 2026-03-20 08:46:44,202 - lava_callback - INFO - Completed processing callback for node 69bd091905e4bbd6ba6355ff 2026-03-20 08:46:44,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:44,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:44,576 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:44,579 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090e05e4bbd6ba6355de/lava-logs.yaml 2026-03-20 08:46:44,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:45,030 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:45,033 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd092005e4bbd6ba635612/lava_callback.json.gz 2026-03-20 08:46:45,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:45,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092005e4bbd6ba635612 HTTP/1.1" 200 None 2026-03-20 08:46:45,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:45,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:45,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:45,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd092005e4bbd6ba635612 HTTP/1.1" 200 None 2026-03-20 08:46:45,150 - lava_callback - INFO - Completed processing callback for node 69bd092005e4bbd6ba635612 2026-03-20 08:46:45,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:45,408 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd094205e4bbd6ba635691/log.txt.gz 2026-03-20 08:46:45,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:45,597 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:45,599 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69bd087105e4bbd6ba63546d/log.txt.gz 2026-03-20 08:46:45,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:45,849 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090e05e4bbd6ba6355de/lava_callback.json.gz 2026-03-20 08:46:46,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:46,078 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090e05e4bbd6ba6355de HTTP/1.1" 200 None 2026-03-20 08:46:46,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:46,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:46,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:46,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd090e05e4bbd6ba6355de HTTP/1.1" 200 None 2026-03-20 08:46:46,395 - lava_callback - INFO - Completed processing callback for node 69bd090e05e4bbd6ba6355de 2026-03-20 08:46:46,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44692 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:46:46,835 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:46,837 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd094205e4bbd6ba635691/lava-logs.yaml 2026-03-20 08:46:46,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:47,441 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:47,443 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69bd087105e4bbd6ba63546d/lava-logs.yaml 2026-03-20 08:46:47,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:47,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:47,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd094205e4bbd6ba635691/lava_callback.json.gz 2026-03-20 08:46:47,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:47,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd094205e4bbd6ba635691 HTTP/1.1" 200 None 2026-03-20 08:46:47,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:47,769 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:47,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:47,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd094205e4bbd6ba635691 HTTP/1.1" 200 None 2026-03-20 08:46:47,825 - lava_callback - INFO - Completed processing callback for node 69bd094205e4bbd6ba635691 2026-03-20 08:46:48,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:48,516 - lava_callback - INFO - Received callback for node 69bd091405e4bbd6ba6355ef INFO: 172.21.0.1:44700 - "POST /node/69bd091405e4bbd6ba6355ef HTTP/1.0" 202 Accepted 2026-03-20 08:46:48,526 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69bd087105e4bbd6ba63546d/lava_callback.json.gz 2026-03-20 08:46:48,526 - lava_callback - INFO - Starting async job submit for node 69bd091405e4bbd6ba6355ef 2026-03-20 08:46:48,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:48,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:48,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd087105e4bbd6ba63546d HTTP/1.1" 200 None 2026-03-20 08:46:48,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091405e4bbd6ba6355ef HTTP/1.1" 200 None 2026-03-20 08:46:48,622 - lava_callback - DEBUG - Processing node 69bd091405e4bbd6ba6355ef: baseline-nfs-arm64 2026-03-20 08:46:48,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:48,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:46:48,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:48,853 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd087105e4bbd6ba63546d HTTP/1.1" 200 None 2026-03-20 08:46:48,858 - lava_callback - INFO - Completed processing callback for node 69bd087105e4bbd6ba63546d 2026-03-20 08:46:49,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44708 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:46:50,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:50,130 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091405e4bbd6ba6355ef/log.txt.gz 2026-03-20 08:46:50,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:51,397 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:51,400 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091405e4bbd6ba6355ef/lava-logs.yaml 2026-03-20 08:46:51,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:51,797 - lava_callback - INFO - Received callback for node 69bd094805e4bbd6ba63569d INFO: 172.21.0.1:49086 - "POST /node/69bd094805e4bbd6ba63569d HTTP/1.0" 202 Accepted 2026-03-20 08:46:51,806 - lava_callback - INFO - Starting async job submit for node 69bd094805e4bbd6ba63569d 2026-03-20 08:46:51,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:51,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd094805e4bbd6ba63569d HTTP/1.1" 200 None 2026-03-20 08:46:51,856 - lava_callback - DEBUG - Processing node 69bd094805e4bbd6ba63569d: baseline-arm64-foundriesio 2026-03-20 08:46:52,259 - lava_callback - INFO - Received callback for node 69bd094705e4bbd6ba63569a INFO: 172.21.0.1:49088 - "POST /node/69bd094705e4bbd6ba63569a HTTP/1.0" 202 Accepted 2026-03-20 08:46:52,283 - lava_callback - INFO - Starting async job submit for node 69bd094705e4bbd6ba63569a 2026-03-20 08:46:52,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:52,340 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091405e4bbd6ba6355ef/lava_callback.json.gz 2026-03-20 08:46:52,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:52,432 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:52,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd094705e4bbd6ba63569a HTTP/1.1" 200 None 2026-03-20 08:46:52,472 - lava_callback - DEBUG - Processing node 69bd094705e4bbd6ba63569a: baseline-arm64-foundriesio 2026-03-20 08:46:52,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:52,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091405e4bbd6ba6355ef HTTP/1.1" 200 None 2026-03-20 08:46:52,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:52,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:52,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:52,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd091405e4bbd6ba6355ef HTTP/1.1" 200 None 2026-03-20 08:46:52,758 - lava_callback - INFO - Completed processing callback for node 69bd091405e4bbd6ba6355ef 2026-03-20 08:46:52,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:53,687 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:53,690 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd094805e4bbd6ba63569d/log.txt.gz 2026-03-20 08:46:54,056 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:54,058 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd094705e4bbd6ba63569a/log.txt.gz 2026-03-20 08:46:54,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:54,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:55,203 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:55,206 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd094805e4bbd6ba63569d/lava-logs.yaml 2026-03-20 08:46:55,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:55,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:55,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd094705e4bbd6ba63569a/lava-logs.yaml 2026-03-20 08:46:55,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:46:56,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:56,177 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd094805e4bbd6ba63569d/lava_callback.json.gz 2026-03-20 08:46:56,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:56,225 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:46:56,227 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bd094705e4bbd6ba63569a/lava_callback.json.gz 2026-03-20 08:46:56,255 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:56,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd094805e4bbd6ba63569d HTTP/1.1" 200 None 2026-03-20 08:46:56,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:56,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd094705e4bbd6ba63569a HTTP/1.1" 200 None 2026-03-20 08:46:56,279 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:56,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:56,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:56,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:46:56,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:46:56,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd094805e4bbd6ba63569d HTTP/1.1" 200 None 2026-03-20 08:46:56,353 - lava_callback - INFO - Completed processing callback for node 69bd094805e4bbd6ba63569d 2026-03-20 08:46:56,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd094705e4bbd6ba63569a HTTP/1.1" 200 None 2026-03-20 08:46:56,390 - lava_callback - INFO - Completed processing callback for node 69bd094705e4bbd6ba63569a INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:47:00,264 - lava_callback - INFO - Received callback for node 69bd096a05e4bbd6ba635701 INFO: 172.21.0.1:39948 - "POST /node/69bd096a05e4bbd6ba635701 HTTP/1.0" 202 Accepted 2026-03-20 08:47:00,273 - lava_callback - INFO - Starting async job submit for node 69bd096a05e4bbd6ba635701 2026-03-20 08:47:00,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:00,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd096a05e4bbd6ba635701 HTTP/1.1" 200 None 2026-03-20 08:47:00,301 - lava_callback - DEBUG - Processing node 69bd096a05e4bbd6ba635701: baseline-arm 2026-03-20 08:47:00,310 - lava_callback - WARNING - Failed to upload log 2026-03-20 08:47:00,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:00,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:00,701 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd096a05e4bbd6ba635701/lava-logs.yaml 2026-03-20 08:47:00,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:00,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:00,945 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd096a05e4bbd6ba635701/lava_callback.json.gz 2026-03-20 08:47:00,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:00,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd096a05e4bbd6ba635701 HTTP/1.1" 200 None 2026-03-20 08:47:00,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:00,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:47:00,999 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:01,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd096a05e4bbd6ba635701 HTTP/1.1" 200 None 2026-03-20 08:47:01,053 - lava_callback - INFO - Completed processing callback for node 69bd096a05e4bbd6ba635701 2026-03-20 08:47:02,967 - lava_callback - INFO - Received callback for node 69bd091e05e4bbd6ba63560b INFO: 172.21.0.1:39962 - "POST /node/69bd091e05e4bbd6ba63560b HTTP/1.0" 202 Accepted 2026-03-20 08:47:02,977 - lava_callback - INFO - Starting async job submit for node 69bd091e05e4bbd6ba63560b 2026-03-20 08:47:03,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:03,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091e05e4bbd6ba63560b HTTP/1.1" 200 None 2026-03-20 08:47:03,035 - lava_callback - DEBUG - Processing node 69bd091e05e4bbd6ba63560b: baseline-nfs-arm64 2026-03-20 08:47:03,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:03,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:03,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091e05e4bbd6ba63560b/log.txt.gz 2026-03-20 08:47:04,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:04,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:04,539 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091e05e4bbd6ba63560b/lava-logs.yaml 2026-03-20 08:47:04,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:04,601 - lava_callback - INFO - Received callback for node 69bd091b05e4bbd6ba635605 INFO: 172.21.0.1:39968 - "POST /node/69bd091b05e4bbd6ba635605 HTTP/1.0" 202 Accepted 2026-03-20 08:47:04,609 - lava_callback - INFO - Starting async job submit for node 69bd091b05e4bbd6ba635605 2026-03-20 08:47:04,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:04,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091b05e4bbd6ba635605 HTTP/1.1" 200 None 2026-03-20 08:47:04,650 - lava_callback - DEBUG - Processing node 69bd091b05e4bbd6ba635605: baseline-nfs-arm64 2026-03-20 08:47:04,718 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:04,771 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091e05e4bbd6ba63560b/lava_callback.json.gz 2026-03-20 08:47:04,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:04,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091e05e4bbd6ba63560b HTTP/1.1" 200 None 2026-03-20 08:47:04,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:04,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:47:05,004 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:05,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd091e05e4bbd6ba63560b HTTP/1.1" 200 None 2026-03-20 08:47:05,129 - lava_callback - INFO - Completed processing callback for node 69bd091e05e4bbd6ba63560b 2026-03-20 08:47:05,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:05,500 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:05,502 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091b05e4bbd6ba635605/log.txt.gz 2026-03-20 08:47:05,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:06,242 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:06,244 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091b05e4bbd6ba635605/lava-logs.yaml 2026-03-20 08:47:06,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:06,380 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:06,382 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091b05e4bbd6ba635605/lava_callback.json.gz 2026-03-20 08:47:06,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:06,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091b05e4bbd6ba635605 HTTP/1.1" 200 None 2026-03-20 08:47:06,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:06,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:47:06,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:39978 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:47:06,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd091b05e4bbd6ba635605 HTTP/1.1" 200 None 2026-03-20 08:47:06,480 - lava_callback - INFO - Completed processing callback for node 69bd091b05e4bbd6ba635605 2026-03-20 08:47:07,195 - lava_callback - INFO - Received callback for node 69bd092905e4bbd6ba63561c INFO: 172.21.0.1:39988 - "POST /node/69bd092905e4bbd6ba63561c HTTP/1.0" 202 Accepted 2026-03-20 08:47:07,202 - lava_callback - INFO - Starting async job submit for node 69bd092905e4bbd6ba63561c 2026-03-20 08:47:07,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:07,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092905e4bbd6ba63561c HTTP/1.1" 200 None 2026-03-20 08:47:07,257 - lava_callback - DEBUG - Processing node 69bd092905e4bbd6ba63561c: baseline-arm64-broonie 2026-03-20 08:47:07,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:07,811 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:07,813 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092905e4bbd6ba63561c/log.txt.gz 2026-03-20 08:47:07,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:08,422 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:08,424 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092905e4bbd6ba63561c/lava-logs.yaml 2026-03-20 08:47:08,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:08,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:08,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-20 08:47:08,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:08,561 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092905e4bbd6ba63561c/lava_callback.json.gz 2026-03-20 08:47:08,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:08,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092905e4bbd6ba63561c HTTP/1.1" 200 None 2026-03-20 08:47:08,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:08,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:47:08,635 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:08,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd092905e4bbd6ba63561c HTTP/1.1" 200 None 2026-03-20 08:47:08,665 - lava_callback - INFO - Completed processing callback for node 69bd092905e4bbd6ba63561c 2026-03-20 08:47:08,735 - lava_callback - INFO - Received callback for node 69bd093205e4bbd6ba635661 INFO: 172.21.0.1:40002 - "POST /node/69bd093205e4bbd6ba635661 HTTP/1.0" 202 Accepted 2026-03-20 08:47:08,755 - lava_callback - INFO - Starting async job submit for node 69bd093205e4bbd6ba635661 2026-03-20 08:47:08,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:08,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093205e4bbd6ba635661 HTTP/1.1" 200 None 2026-03-20 08:47:08,891 - lava_callback - DEBUG - Processing node 69bd093205e4bbd6ba635661: baseline-arm64-broonie 2026-03-20 08:47:09,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:09,479 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:09,481 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093205e4bbd6ba635661/log.txt.gz 2026-03-20 08:47:09,709 - lava_callback - INFO - Received callback for node 69bd094405e4bbd6ba635694 INFO: 172.21.0.1:55692 - "POST /node/69bd094405e4bbd6ba635694 HTTP/1.0" 202 Accepted 2026-03-20 08:47:09,718 - lava_callback - INFO - Starting async job submit for node 69bd094405e4bbd6ba635694 2026-03-20 08:47:09,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:09,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:09,803 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd094405e4bbd6ba635694 HTTP/1.1" 200 None 2026-03-20 08:47:09,805 - lava_callback - DEBUG - Processing node 69bd094405e4bbd6ba635694: baseline-arm64-pengutronix 2026-03-20 08:47:10,097 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:10,126 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093205e4bbd6ba635661/lava-logs.yaml 2026-03-20 08:47:10,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:10,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:10,264 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:10,266 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd094405e4bbd6ba635694/log.txt.gz 2026-03-20 08:47:10,295 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:10,297 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093205e4bbd6ba635661/lava_callback.json.gz 2026-03-20 08:47:10,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:10,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093205e4bbd6ba635661 HTTP/1.1" 200 None 2026-03-20 08:47:10,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:10,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:47:10,539 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:10,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:10,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd093205e4bbd6ba635661 HTTP/1.1" 200 None 2026-03-20 08:47:10,618 - lava_callback - INFO - Completed processing callback for node 69bd093205e4bbd6ba635661 2026-03-20 08:47:10,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:10,931 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd094405e4bbd6ba635694/lava-logs.yaml 2026-03-20 08:47:10,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:11,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:11,486 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd094405e4bbd6ba635694/lava_callback.json.gz 2026-03-20 08:47:11,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:11,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd094405e4bbd6ba635694 HTTP/1.1" 200 None 2026-03-20 08:47:11,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:11,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:47:11,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:11,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd094405e4bbd6ba635694 HTTP/1.1" 200 None 2026-03-20 08:47:11,669 - lava_callback - INFO - Completed processing callback for node 69bd094405e4bbd6ba635694 2026-03-20 08:47:12,304 - lava_callback - INFO - Received callback for node 69bd094505e4bbd6ba635697 INFO: 172.21.0.1:55708 - "POST /node/69bd094505e4bbd6ba635697 HTTP/1.0" 202 Accepted 2026-03-20 08:47:12,313 - lava_callback - INFO - Starting async job submit for node 69bd094505e4bbd6ba635697 2026-03-20 08:47:12,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:12,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd094505e4bbd6ba635697 HTTP/1.1" 200 None 2026-03-20 08:47:12,358 - lava_callback - DEBUG - Processing node 69bd094505e4bbd6ba635697: baseline-arm64-pengutronix 2026-03-20 08:47:12,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:13,101 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:13,103 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd094505e4bbd6ba635697/log.txt.gz 2026-03-20 08:47:13,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:13,716 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:13,718 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd094505e4bbd6ba635697/lava-logs.yaml 2026-03-20 08:47:13,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:13,901 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:13,903 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bd094505e4bbd6ba635697/lava_callback.json.gz 2026-03-20 08:47:13,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:13,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd094505e4bbd6ba635697 HTTP/1.1" 200 None 2026-03-20 08:47:13,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:13,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:47:13,955 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:13,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd094505e4bbd6ba635697 HTTP/1.1" 200 None 2026-03-20 08:47:13,984 - lava_callback - INFO - Completed processing callback for node 69bd094505e4bbd6ba635697 INFO: 172.21.0.1:55720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:47:17,872 - lava_callback - INFO - Received callback for node 69bd091205e4bbd6ba6355e6 INFO: 172.21.0.1:55738 - "POST /node/69bd091205e4bbd6ba6355e6 HTTP/1.0" 202 Accepted 2026-03-20 08:47:17,879 - lava_callback - INFO - Starting async job submit for node 69bd091205e4bbd6ba6355e6 2026-03-20 08:47:17,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:17,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091205e4bbd6ba6355e6 HTTP/1.1" 200 None 2026-03-20 08:47:17,918 - lava_callback - DEBUG - Processing node 69bd091205e4bbd6ba6355e6: baseline-nfs-arm64 2026-03-20 08:47:18,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:18,636 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:18,638 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091205e4bbd6ba6355e6/log.txt.gz 2026-03-20 08:47:18,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:19,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:19,332 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091205e4bbd6ba6355e6/lava-logs.yaml 2026-03-20 08:47:19,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:19,465 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:19,467 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091205e4bbd6ba6355e6/lava_callback.json.gz 2026-03-20 08:47:19,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:19,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091205e4bbd6ba6355e6 HTTP/1.1" 200 None 2026-03-20 08:47:19,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:19,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:47:19,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:19,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd091205e4bbd6ba6355e6 HTTP/1.1" 200 None 2026-03-20 08:47:19,556 - lava_callback - INFO - Completed processing callback for node 69bd091205e4bbd6ba6355e6 INFO: 172.21.0.1:50992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59502 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:47:38,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:38,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-20 08:47:42,140 - lava_callback - INFO - Received callback for node 69bd092d05e4bbd6ba635654 INFO: 172.21.0.1:48380 - "POST /node/69bd092d05e4bbd6ba635654 HTTP/1.0" 202 Accepted 2026-03-20 08:47:42,150 - lava_callback - INFO - Starting async job submit for node 69bd092d05e4bbd6ba635654 2026-03-20 08:47:42,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:42,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092d05e4bbd6ba635654 HTTP/1.1" 200 None 2026-03-20 08:47:42,225 - lava_callback - DEBUG - Processing node 69bd092d05e4bbd6ba635654: baseline-arm64-broonie 2026-03-20 08:47:42,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:42,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:42,923 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092d05e4bbd6ba635654/log.txt.gz 2026-03-20 08:47:43,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:43,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:43,628 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092d05e4bbd6ba635654/lava-logs.yaml 2026-03-20 08:47:43,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:43,647 - lava_callback - INFO - Received callback for node 69bd092f05e4bbd6ba63565b INFO: 172.21.0.1:48392 - "POST /node/69bd092f05e4bbd6ba63565b HTTP/1.0" 202 Accepted 2026-03-20 08:47:43,657 - lava_callback - INFO - Starting async job submit for node 69bd092f05e4bbd6ba63565b 2026-03-20 08:47:43,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:43,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092f05e4bbd6ba63565b HTTP/1.1" 200 None 2026-03-20 08:47:43,712 - lava_callback - DEBUG - Processing node 69bd092f05e4bbd6ba63565b: baseline-arm64-broonie 2026-03-20 08:47:43,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:43,874 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092d05e4bbd6ba635654/lava_callback.json.gz 2026-03-20 08:47:43,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:44,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092d05e4bbd6ba635654 HTTP/1.1" 200 None 2026-03-20 08:47:44,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:44,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:47:44,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:44,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd092d05e4bbd6ba635654 HTTP/1.1" 200 None 2026-03-20 08:47:44,205 - lava_callback - INFO - Completed processing callback for node 69bd092d05e4bbd6ba635654 2026-03-20 08:47:44,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:44,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:44,530 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092f05e4bbd6ba63565b/log.txt.gz 2026-03-20 08:47:44,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:45,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:45,245 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092f05e4bbd6ba63565b/lava-logs.yaml 2026-03-20 08:47:45,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:47:45,405 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:47:45,407 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092f05e4bbd6ba63565b/lava_callback.json.gz 2026-03-20 08:47:45,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:45,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092f05e4bbd6ba63565b HTTP/1.1" 200 None 2026-03-20 08:47:45,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:45,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:47:45,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:47:45,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd092f05e4bbd6ba63565b HTTP/1.1" 200 None 2026-03-20 08:47:45,524 - lava_callback - INFO - Completed processing callback for node 69bd092f05e4bbd6ba63565b INFO: 172.21.0.1:48396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47894 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:48:08,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:08,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-20 08:48:12,936 - lava_callback - INFO - Received callback for node 69bd093d05e4bbd6ba635684 INFO: 172.21.0.1:42514 - "POST /node/69bd093d05e4bbd6ba635684 HTTP/1.0" 202 Accepted 2026-03-20 08:48:12,946 - lava_callback - INFO - Starting async job submit for node 69bd093d05e4bbd6ba635684 2026-03-20 08:48:12,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:13,013 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093d05e4bbd6ba635684 HTTP/1.1" 200 None 2026-03-20 08:48:13,014 - lava_callback - DEBUG - Processing node 69bd093d05e4bbd6ba635684: baseline-arm64-clabbe 2026-03-20 08:48:13,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:48:13,537 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:13,539 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69bd093d05e4bbd6ba635684/log.txt.gz 2026-03-20 08:48:13,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:48:13,765 - lava_callback - INFO - Received callback for node 69bd08ff05e4bbd6ba63557e INFO: 172.21.0.1:42526 - "POST /node/69bd08ff05e4bbd6ba63557e HTTP/1.0" 202 Accepted 2026-03-20 08:48:13,776 - lava_callback - INFO - Starting async job submit for node 69bd08ff05e4bbd6ba63557e 2026-03-20 08:48:13,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:13,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08ff05e4bbd6ba63557e HTTP/1.1" 200 None 2026-03-20 08:48:13,844 - lava_callback - DEBUG - Processing node 69bd08ff05e4bbd6ba63557e: baseline-arm64 2026-03-20 08:48:14,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:48:14,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:14,551 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69bd093d05e4bbd6ba635684/lava-logs.yaml 2026-03-20 08:48:14,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:48:14,654 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:14,656 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08ff05e4bbd6ba63557e/log.txt.gz 2026-03-20 08:48:14,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:14,785 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69bd093d05e4bbd6ba635684/lava_callback.json.gz 2026-03-20 08:48:14,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:14,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093d05e4bbd6ba635684 HTTP/1.1" 200 None 2026-03-20 08:48:14,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:14,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:48:14,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:14,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:48:15,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd093d05e4bbd6ba635684 HTTP/1.1" 200 None 2026-03-20 08:48:15,053 - lava_callback - INFO - Completed processing callback for node 69bd093d05e4bbd6ba635684 INFO: 172.21.0.1:42528 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-20 08:48:15,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:15,923 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08ff05e4bbd6ba63557e/lava-logs.yaml 2026-03-20 08:48:15,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:48:16,079 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:16,082 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd08ff05e4bbd6ba63557e/lava_callback.json.gz 2026-03-20 08:48:16,108 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:16,132 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd08ff05e4bbd6ba63557e HTTP/1.1" 200 None 2026-03-20 08:48:16,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:16,154 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:48:16,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:16,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd08ff05e4bbd6ba63557e HTTP/1.1" 200 None 2026-03-20 08:48:16,202 - lava_callback - INFO - Completed processing callback for node 69bd08ff05e4bbd6ba63557e INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48256 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:48:27,388 - lava_callback - INFO - Received callback for node 69bd092a05e4bbd6ba63561f INFO: 172.21.0.1:48266 - "POST /node/69bd092a05e4bbd6ba63561f HTTP/1.0" 202 Accepted 2026-03-20 08:48:27,400 - lava_callback - INFO - Starting async job submit for node 69bd092a05e4bbd6ba63561f 2026-03-20 08:48:27,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:27,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092a05e4bbd6ba63561f HTTP/1.1" 200 None 2026-03-20 08:48:27,464 - lava_callback - DEBUG - Processing node 69bd092a05e4bbd6ba63561f: baseline-arm64-broonie 2026-03-20 08:48:27,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:48:28,136 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:28,138 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092a05e4bbd6ba63561f/log.txt.gz 2026-03-20 08:48:28,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:48:28,973 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:28,976 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092a05e4bbd6ba63561f/lava-logs.yaml 2026-03-20 08:48:28,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:48:29,141 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:29,143 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092a05e4bbd6ba63561f/lava_callback.json.gz 2026-03-20 08:48:29,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:29,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092a05e4bbd6ba63561f HTTP/1.1" 200 None 2026-03-20 08:48:29,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:29,231 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:48:29,233 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:29,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd092a05e4bbd6ba63561f HTTP/1.1" 200 None 2026-03-20 08:48:29,286 - lava_callback - INFO - Completed processing callback for node 69bd092a05e4bbd6ba63561f INFO: 172.21.0.1:38186 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:48:38,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:38,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35926 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:48:47,704 - lava_callback - INFO - Received callback for node 69bd055305e4bbd6ba635253 INFO: 172.21.0.1:35936 - "POST /node/69bd055305e4bbd6ba635253 HTTP/1.0" 202 Accepted 2026-03-20 08:48:47,716 - lava_callback - INFO - Starting async job submit for node 69bd055305e4bbd6ba635253 2026-03-20 08:48:47,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:47,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd055305e4bbd6ba635253 HTTP/1.1" 200 None 2026-03-20 08:48:47,844 - lava_callback - DEBUG - Processing node 69bd055305e4bbd6ba635253: ltp-smoke 2026-03-20 08:48:48,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:48:48,886 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:48,888 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd055305e4bbd6ba635253/log.txt.gz 2026-03-20 08:48:49,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:35952 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:48:49,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:49,780 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd055305e4bbd6ba635253/lava-logs.yaml 2026-03-20 08:48:49,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:48:50,344 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:48:50,347 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd055305e4bbd6ba635253/lava_callback.json.gz 2026-03-20 08:48:50,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:50,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd055305e4bbd6ba635253 HTTP/1.1" 200 None 2026-03-20 08:48:50,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:50,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027205e4bbd6ba634c5d HTTP/1.1" 200 None 2026-03-20 08:48:50,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:48:50,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd055305e4bbd6ba635253 HTTP/1.1" 200 None 2026-03-20 08:48:50,850 - lava_callback - INFO - Completed processing callback for node 69bd055305e4bbd6ba635253 INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32834 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:49:08,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:08,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:36750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:49:27,295 - lava_callback - INFO - Received callback for node 69bd093005e4bbd6ba63565e INFO: 172.21.0.1:36514 - "POST /node/69bd093005e4bbd6ba63565e HTTP/1.0" 202 Accepted 2026-03-20 08:49:27,307 - lava_callback - INFO - Starting async job submit for node 69bd093005e4bbd6ba63565e 2026-03-20 08:49:27,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:27,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093005e4bbd6ba63565e HTTP/1.1" 200 None 2026-03-20 08:49:27,385 - lava_callback - DEBUG - Processing node 69bd093005e4bbd6ba63565e: baseline-arm64-broonie 2026-03-20 08:49:27,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:49:28,427 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:49:28,429 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093005e4bbd6ba63565e/log.txt.gz 2026-03-20 08:49:28,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:49:29,095 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:49:29,097 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093005e4bbd6ba63565e/lava-logs.yaml 2026-03-20 08:49:29,106 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:49:29,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:49:29,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093005e4bbd6ba63565e/lava_callback.json.gz 2026-03-20 08:49:29,922 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:29,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093005e4bbd6ba63565e HTTP/1.1" 200 None 2026-03-20 08:49:29,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:29,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:49:29,989 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:30,028 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd093005e4bbd6ba63565e HTTP/1.1" 200 None 2026-03-20 08:49:30,029 - lava_callback - INFO - Completed processing callback for node 69bd093005e4bbd6ba63565e 2026-03-20 08:49:31,459 - lava_callback - INFO - Received callback for node 69bd091305e4bbd6ba6355e9 INFO: 172.21.0.1:44028 - "POST /node/69bd091305e4bbd6ba6355e9 HTTP/1.0" 202 Accepted 2026-03-20 08:49:31,469 - lava_callback - INFO - Starting async job submit for node 69bd091305e4bbd6ba6355e9 2026-03-20 08:49:31,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:31,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091305e4bbd6ba6355e9 HTTP/1.1" 200 None 2026-03-20 08:49:31,523 - lava_callback - DEBUG - Processing node 69bd091305e4bbd6ba6355e9: baseline-nfs-arm64 2026-03-20 08:49:32,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:49:32,541 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:49:32,543 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091305e4bbd6ba6355e9/log.txt.gz 2026-03-20 08:49:32,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:49:33,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:49:33,877 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091305e4bbd6ba6355e9/lava-logs.yaml 2026-03-20 08:49:33,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:49:34,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:49:34,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091305e4bbd6ba6355e9/lava_callback.json.gz 2026-03-20 08:49:34,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:34,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091305e4bbd6ba6355e9 HTTP/1.1" 200 None 2026-03-20 08:49:34,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:34,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:49:34,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:34,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd091305e4bbd6ba6355e9 HTTP/1.1" 200 None 2026-03-20 08:49:34,239 - lava_callback - INFO - Completed processing callback for node 69bd091305e4bbd6ba6355e9 INFO: 172.21.0.1:44044 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:49:38,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:38,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-20 08:49:39,962 - lava_callback - INFO - Received callback for node 69bd084d05e4bbd6ba6353c8 INFO: 172.21.0.1:46926 - "POST /node/69bd084d05e4bbd6ba6353c8 HTTP/1.0" 202 Accepted 2026-03-20 08:49:39,971 - lava_callback - INFO - Starting async job submit for node 69bd084d05e4bbd6ba6353c8 2026-03-20 08:49:39,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:40,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084d05e4bbd6ba6353c8 HTTP/1.1" 200 None 2026-03-20 08:49:40,018 - lava_callback - DEBUG - Processing node 69bd084d05e4bbd6ba6353c8: baseline-arm-clabbe 2026-03-20 08:49:40,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:49:40,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:49:40,822 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084d05e4bbd6ba6353c8/log.txt.gz 2026-03-20 08:49:40,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:49:41,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:49:41,432 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084d05e4bbd6ba6353c8/lava-logs.yaml 2026-03-20 08:49:41,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:49:42,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:49:42,201 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bd084d05e4bbd6ba6353c8/lava_callback.json.gz 2026-03-20 08:49:42,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:42,259 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd084d05e4bbd6ba6353c8 HTTP/1.1" 200 None 2026-03-20 08:49:42,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:42,292 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:49:42,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:49:42,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd084d05e4bbd6ba6353c8 HTTP/1.1" 200 None 2026-03-20 08:49:42,336 - lava_callback - INFO - Completed processing callback for node 69bd084d05e4bbd6ba6353c8 INFO: 172.21.0.1:46930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56964 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:50:08,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:50:08,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43076 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:50:24,530 - lava_callback - INFO - Received callback for node 69ba674a537ae4d3c82376f3 INFO: 172.21.0.1:38978 - "POST /node/69ba674a537ae4d3c82376f3 HTTP/1.0" 202 Accepted 2026-03-20 08:50:24,540 - lava_callback - INFO - Starting async job submit for node 69ba674a537ae4d3c82376f3 2026-03-20 08:50:24,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:50:24,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba674a537ae4d3c82376f3 HTTP/1.1" 200 None 2026-03-20 08:50:24,567 - lava_callback - DEBUG - Processing node 69ba674a537ae4d3c82376f3: baseline-arm-baylibre 2026-03-20 08:50:24,568 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba674a537ae4d3c82376f3 2026-03-20 08:50:24,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:50:24,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba674a537ae4d3c82376f3 HTTP/1.1" 200 None 2026-03-20 08:50:24,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:50:24,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-20 08:50:24,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:50:24,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba674a537ae4d3c82376f3 HTTP/1.1" 200 None 2026-03-20 08:50:24,680 - lava_callback - ERROR - Error processing callback for node 69ba674a537ae4d3c82376f3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47854 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45484 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:52:03,866 - lava_callback - INFO - Received callback for node 69ba679b537ae4d3c823771f INFO: 172.21.0.1:38456 - "POST /node/69ba679b537ae4d3c823771f HTTP/1.0" 202 Accepted 2026-03-20 08:52:03,872 - lava_callback - INFO - Starting async job submit for node 69ba679b537ae4d3c823771f 2026-03-20 08:52:03,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:03,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba679b537ae4d3c823771f HTTP/1.1" 200 None 2026-03-20 08:52:03,901 - lava_callback - DEBUG - Processing node 69ba679b537ae4d3c823771f: baseline-arm-clabbe 2026-03-20 08:52:03,901 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba679b537ae4d3c823771f 2026-03-20 08:52:03,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:03,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba679b537ae4d3c823771f HTTP/1.1" 200 None 2026-03-20 08:52:03,917 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:03,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-20 08:52:03,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:03,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba679b537ae4d3c823771f HTTP/1.1" 200 None 2026-03-20 08:52:03,958 - lava_callback - ERROR - Error processing callback for node 69ba679b537ae4d3c823771f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37664 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35834 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:52:46,685 - lava_callback - INFO - Received callback for node 69bd091005e4bbd6ba6355e1 INFO: 172.21.0.1:35850 - "POST /node/69bd091005e4bbd6ba6355e1 HTTP/1.0" 202 Accepted 2026-03-20 08:52:46,693 - lava_callback - INFO - Starting async job submit for node 69bd091005e4bbd6ba6355e1 2026-03-20 08:52:46,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:46,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091005e4bbd6ba6355e1 HTTP/1.1" 200 None 2026-03-20 08:52:46,744 - lava_callback - DEBUG - Processing node 69bd091005e4bbd6ba6355e1: baseline-arm64 2026-03-20 08:52:47,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:52:47,324 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:52:47,326 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd091005e4bbd6ba6355e1/log.txt.gz 2026-03-20 08:52:47,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:52:47,745 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:52:47,747 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd091005e4bbd6ba6355e1/lava-logs.yaml 2026-03-20 08:52:47,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:52:47,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:52:47,930 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd091005e4bbd6ba6355e1/lava_callback.json.gz DEBUG: Setup failed for 69bd091005e4bbd6ba6355e1. Transitting job node result: incomplete -> fail 2026-03-20 08:52:48,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:48,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091005e4bbd6ba6355e1 HTTP/1.1" 200 None 2026-03-20 08:52:48,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:48,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:52:48,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:48,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd091005e4bbd6ba6355e1 HTTP/1.1" 200 None 2026-03-20 08:52:48,147 - lava_callback - INFO - Completed processing callback for node 69bd091005e4bbd6ba6355e1 INFO: 172.21.0.1:35856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37736 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:52:57,548 - lava_callback - INFO - Received callback for node 69bd0ae105e4bbd6ba635859 INFO: 172.21.0.1:37738 - "POST /node/69bd0ae105e4bbd6ba635859 HTTP/1.0" 202 Accepted 2026-03-20 08:52:57,555 - lava_callback - INFO - Starting async job submit for node 69bd0ae105e4bbd6ba635859 2026-03-20 08:52:57,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:57,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae105e4bbd6ba635859 HTTP/1.1" 200 None 2026-03-20 08:52:57,579 - lava_callback - DEBUG - Processing node 69bd0ae105e4bbd6ba635859: baseline-x86 2026-03-20 08:52:57,586 - lava_callback - WARNING - Failed to upload log 2026-03-20 08:52:57,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:52:57,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:52:57,740 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae105e4bbd6ba635859/lava-logs.yaml 2026-03-20 08:52:57,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:52:57,889 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:52:57,891 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae105e4bbd6ba635859/lava_callback.json.gz 2026-03-20 08:52:57,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:57,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae105e4bbd6ba635859 HTTP/1.1" 200 None 2026-03-20 08:52:57,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:57,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd028c05e4bbd6ba634c81 HTTP/1.1" 200 None 2026-03-20 08:52:57,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:52:57,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0ae105e4bbd6ba635859 HTTP/1.1" 200 None 2026-03-20 08:52:57,958 - lava_callback - INFO - Completed processing callback for node 69bd0ae105e4bbd6ba635859 INFO: 172.21.0.1:38970 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:53:08,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:08,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-20 08:53:11,838 - lava_callback - INFO - Received callback for node 69bd0ae405e4bbd6ba635862 INFO: 172.21.0.1:49036 - "POST /node/69bd0ae405e4bbd6ba635862 HTTP/1.0" 202 Accepted 2026-03-20 08:53:11,846 - lava_callback - INFO - Starting async job submit for node 69bd0ae405e4bbd6ba635862 2026-03-20 08:53:11,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:11,867 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae405e4bbd6ba635862 HTTP/1.1" 200 None 2026-03-20 08:53:11,868 - lava_callback - DEBUG - Processing node 69bd0ae405e4bbd6ba635862: baseline-nfs-arm64 2026-03-20 08:53:11,869 - lava_callback - WARNING - Failed to upload log 2026-03-20 08:53:11,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:53:12,177 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:53:12,179 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd0ae405e4bbd6ba635862/lava-logs.yaml 2026-03-20 08:53:12,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:53:12,318 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:53:12,320 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd0ae405e4bbd6ba635862/lava_callback.json.gz 2026-03-20 08:53:12,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:12,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae405e4bbd6ba635862 HTTP/1.1" 200 None 2026-03-20 08:53:12,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:12,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:53:12,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:12,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0ae405e4bbd6ba635862 HTTP/1.1" 200 None 2026-03-20 08:53:12,377 - lava_callback - INFO - Completed processing callback for node 69bd0ae405e4bbd6ba635862 INFO: 172.21.0.1:49038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:53:23,919 - lava_callback - INFO - Received callback for node 69ba67f9537ae4d3c8237750 INFO: 172.21.0.1:47594 - "POST /node/69ba67f9537ae4d3c8237750 HTTP/1.0" 202 Accepted 2026-03-20 08:53:23,925 - lava_callback - INFO - Starting async job submit for node 69ba67f9537ae4d3c8237750 2026-03-20 08:53:23,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:23,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba67f9537ae4d3c8237750 HTTP/1.1" 200 None 2026-03-20 08:53:23,941 - lava_callback - DEBUG - Processing node 69ba67f9537ae4d3c8237750: baseline-arm-clabbe 2026-03-20 08:53:23,942 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba67f9537ae4d3c8237750 2026-03-20 08:53:23,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:23,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba67f9537ae4d3c8237750 HTTP/1.1" 200 None 2026-03-20 08:53:23,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:23,973 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-20 08:53:23,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:23,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba67f9537ae4d3c8237750 HTTP/1.1" 200 None 2026-03-20 08:53:23,998 - lava_callback - ERROR - Error processing callback for node 69ba67f9537ae4d3c8237750: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47600 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:53:32,199 - lava_callback - INFO - Received callback for node 69bd0ae405e4bbd6ba635864 INFO: 172.21.0.1:46090 - "POST /node/69bd0ae405e4bbd6ba635864 HTTP/1.0" 202 Accepted 2026-03-20 08:53:32,205 - lava_callback - INFO - Starting async job submit for node 69bd0ae405e4bbd6ba635864 2026-03-20 08:53:32,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:32,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae405e4bbd6ba635864 HTTP/1.1" 200 None 2026-03-20 08:53:32,238 - lava_callback - DEBUG - Processing node 69bd0ae405e4bbd6ba635864: baseline-x86 2026-03-20 08:53:32,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:53:32,592 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:53:32,594 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae405e4bbd6ba635864/log.txt.gz 2026-03-20 08:53:32,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:53:32,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:53:32,902 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae405e4bbd6ba635864/lava-logs.yaml 2026-03-20 08:53:32,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:53:33,043 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:53:33,045 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae405e4bbd6ba635864/lava_callback.json.gz 2026-03-20 08:53:33,062 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:33,104 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae405e4bbd6ba635864 HTTP/1.1" 200 None 2026-03-20 08:53:33,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:33,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd028c05e4bbd6ba634c81 HTTP/1.1" 200 None 2026-03-20 08:53:33,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:33,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0ae405e4bbd6ba635864 HTTP/1.1" 200 None 2026-03-20 08:53:33,146 - lava_callback - INFO - Completed processing callback for node 69bd0ae405e4bbd6ba635864 INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:53:38,677 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:38,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:38016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38024 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:53:50,571 - lava_callback - INFO - Received callback for node 69bc673d17e5cb936602f609 INFO: 172.21.0.1:59158 - "POST /node/69bc673d17e5cb936602f609 HTTP/1.0" 202 Accepted 2026-03-20 08:53:50,580 - lava_callback - INFO - Starting async job submit for node 69bc673d17e5cb936602f609 2026-03-20 08:53:50,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:50,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc673d17e5cb936602f609 HTTP/1.1" 200 None 2026-03-20 08:53:50,637 - lava_callback - DEBUG - Processing node 69bc673d17e5cb936602f609: baseline-arm64 2026-03-20 08:53:51,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:53:51,462 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:53:51,464 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bc673d17e5cb936602f609/log.txt.gz 2026-03-20 08:53:51,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:53:51,999 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:53:52,001 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bc673d17e5cb936602f609/lava-logs.yaml 2026-03-20 08:53:52,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:53:52,232 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:53:52,234 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bc673d17e5cb936602f609/lava_callback.json.gz 2026-03-20 08:53:52,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:52,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc673d17e5cb936602f609 HTTP/1.1" 200 None 2026-03-20 08:53:52,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:52,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-20 08:53:52,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:53:52,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bc673d17e5cb936602f609 HTTP/1.1" 200 None 2026-03-20 08:53:52,378 - lava_callback - INFO - Completed processing callback for node 69bc673d17e5cb936602f609 INFO: 172.21.0.1:59166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53086 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:54:08,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:08,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:51812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51816 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:54:18,658 - lava_callback - INFO - Received callback for node 69bd0ae205e4bbd6ba63585c INFO: 172.21.0.1:51830 - "POST /node/69bd0ae205e4bbd6ba63585c HTTP/1.0" 202 Accepted 2026-03-20 08:54:18,665 - lava_callback - INFO - Starting async job submit for node 69bd0ae205e4bbd6ba63585c 2026-03-20 08:54:18,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:18,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae205e4bbd6ba63585c HTTP/1.1" 200 None 2026-03-20 08:54:18,704 - lava_callback - DEBUG - Processing node 69bd0ae205e4bbd6ba63585c: baseline-x86 2026-03-20 08:54:19,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:54:19,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:54:19,196 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae205e4bbd6ba63585c/log.txt.gz 2026-03-20 08:54:19,435 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:54:19,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:54:19,734 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae205e4bbd6ba63585c/lava-logs.yaml 2026-03-20 08:54:19,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:54:19,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:54:19,973 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae205e4bbd6ba63585c/lava_callback.json.gz 2026-03-20 08:54:19,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:20,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae205e4bbd6ba63585c HTTP/1.1" 200 None 2026-03-20 08:54:20,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:20,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd028c05e4bbd6ba634c81 HTTP/1.1" 200 None 2026-03-20 08:54:20,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:20,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0ae205e4bbd6ba63585c HTTP/1.1" 200 None 2026-03-20 08:54:20,065 - lava_callback - INFO - Completed processing callback for node 69bd0ae205e4bbd6ba63585c INFO: 172.21.0.1:38742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57970 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:54:38,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:38,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-20 08:54:42,880 - lava_callback - INFO - Received callback for node 69bd0ae305e4bbd6ba63585f INFO: 172.21.0.1:39784 - "POST /node/69bd0ae305e4bbd6ba63585f HTTP/1.0" 202 Accepted 2026-03-20 08:54:42,886 - lava_callback - INFO - Starting async job submit for node 69bd0ae305e4bbd6ba63585f 2026-03-20 08:54:42,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:42,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae305e4bbd6ba63585f HTTP/1.1" 200 None 2026-03-20 08:54:42,924 - lava_callback - DEBUG - Processing node 69bd0ae305e4bbd6ba63585f: baseline-x86 2026-03-20 08:54:43,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:54:43,440 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:54:43,442 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae305e4bbd6ba63585f/log.txt.gz 2026-03-20 08:54:43,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:54:43,831 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:54:43,833 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae305e4bbd6ba63585f/lava-logs.yaml 2026-03-20 08:54:43,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:54:43,967 - lava_callback - INFO - Received callback for node 69ba6841537ae4d3c8237764 INFO: 172.21.0.1:39794 - "POST /node/69ba6841537ae4d3c8237764 HTTP/1.0" 202 Accepted 2026-03-20 08:54:43,975 - lava_callback - INFO - Starting async job submit for node 69ba6841537ae4d3c8237764 2026-03-20 08:54:43,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:43,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6841537ae4d3c8237764 HTTP/1.1" 200 None 2026-03-20 08:54:43,994 - lava_callback - DEBUG - Processing node 69ba6841537ae4d3c8237764: baseline-arm-clabbe 2026-03-20 08:54:43,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6841537ae4d3c8237764 2026-03-20 08:54:43,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:44,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6841537ae4d3c8237764 HTTP/1.1" 200 None 2026-03-20 08:54:44,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:44,017 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:54:44,019 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0ae305e4bbd6ba63585f/lava_callback.json.gz 2026-03-20 08:54:44,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:44,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-20 08:54:44,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:44,093 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ae305e4bbd6ba63585f HTTP/1.1" 200 None 2026-03-20 08:54:44,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:44,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6841537ae4d3c8237764 HTTP/1.1" 200 None 2026-03-20 08:54:44,140 - lava_callback - ERROR - Error processing callback for node 69ba6841537ae4d3c8237764: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 08:54:44,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd028c05e4bbd6ba634c81 HTTP/1.1" 200 None 2026-03-20 08:54:44,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:54:44,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0ae305e4bbd6ba63585f HTTP/1.1" 200 None 2026-03-20 08:54:44,237 - lava_callback - INFO - Completed processing callback for node 69bd0ae305e4bbd6ba63585f INFO: 172.21.0.1:39808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48600 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:55:08,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:55:08,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:43924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43928 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:55:23,952 - lava_callback - INFO - Received callback for node 69ba6867537ae4d3c8237776 INFO: 172.21.0.1:42758 - "POST /node/69ba6867537ae4d3c8237776 HTTP/1.0" 202 Accepted 2026-03-20 08:55:23,958 - lava_callback - INFO - Starting async job submit for node 69ba6867537ae4d3c8237776 2026-03-20 08:55:23,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:55:23,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6867537ae4d3c8237776 HTTP/1.1" 200 None 2026-03-20 08:55:23,985 - lava_callback - DEBUG - Processing node 69ba6867537ae4d3c8237776: baseline-arm-clabbe 2026-03-20 08:55:23,985 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6867537ae4d3c8237776 2026-03-20 08:55:23,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:55:24,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6867537ae4d3c8237776 HTTP/1.1" 200 None 2026-03-20 08:55:24,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:55:24,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-20 08:55:24,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:55:24,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6867537ae4d3c8237776 HTTP/1.1" 200 None 2026-03-20 08:55:24,055 - lava_callback - ERROR - Error processing callback for node 69ba6867537ae4d3c8237776: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:55:47,164 - lava_callback - INFO - Received callback for node 69bd0b5d05e4bbd6ba6358b9 INFO: 172.21.0.1:46270 - "POST /node/69bd0b5d05e4bbd6ba6358b9 HTTP/1.0" 202 Accepted 2026-03-20 08:55:47,171 - lava_callback - INFO - Starting async job submit for node 69bd0b5d05e4bbd6ba6358b9 2026-03-20 08:55:47,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:55:47,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0b5d05e4bbd6ba6358b9 HTTP/1.1" 200 None 2026-03-20 08:55:47,235 - lava_callback - DEBUG - Processing node 69bd0b5d05e4bbd6ba6358b9: baseline-arm64 2026-03-20 08:55:47,382 - lava_callback - WARNING - Failed to upload log 2026-03-20 08:55:47,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:55:47,695 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:55:47,698 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0b5d05e4bbd6ba6358b9/lava-logs.yaml 2026-03-20 08:55:47,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:55:47,929 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:55:47,931 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0b5d05e4bbd6ba6358b9/lava_callback.json.gz 2026-03-20 08:55:47,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:55:47,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0b5d05e4bbd6ba6358b9 HTTP/1.1" 200 None 2026-03-20 08:55:47,985 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:55:48,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:55:48,038 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:55:48,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0b5d05e4bbd6ba6358b9 HTTP/1.1" 200 None 2026-03-20 08:55:48,162 - lava_callback - INFO - Completed processing callback for node 69bd0b5d05e4bbd6ba6358b9 INFO: 172.21.0.1:46272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43904 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:56:00,926 - lava_callback - INFO - Received callback for node 69bd090905e4bbd6ba6355c9 INFO: 172.21.0.1:32848 - "POST /node/69bd090905e4bbd6ba6355c9 HTTP/1.0" 202 Accepted 2026-03-20 08:56:00,933 - lava_callback - INFO - Starting async job submit for node 69bd090905e4bbd6ba6355c9 2026-03-20 08:56:00,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:56:00,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090905e4bbd6ba6355c9 HTTP/1.1" 200 None 2026-03-20 08:56:00,976 - lava_callback - DEBUG - Processing node 69bd090905e4bbd6ba6355c9: baseline-arm64 2026-03-20 08:56:01,717 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:56:01,876 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:56:01,878 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090905e4bbd6ba6355c9/log.txt.gz 2026-03-20 08:56:02,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:56:02,330 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:56:02,332 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090905e4bbd6ba6355c9/lava-logs.yaml 2026-03-20 08:56:02,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:56:02,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:56:02,485 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090905e4bbd6ba6355c9/lava_callback.json.gz 2026-03-20 08:56:02,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:56:02,525 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090905e4bbd6ba6355c9 HTTP/1.1" 200 None 2026-03-20 08:56:02,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:56:02,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:56:02,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:56:02,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd090905e4bbd6ba6355c9 HTTP/1.1" 200 None 2026-03-20 08:56:02,645 - lava_callback - INFO - Completed processing callback for node 69bd090905e4bbd6ba6355c9 INFO: 172.21.0.1:32862 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:56:08,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:56:08,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54882 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:56:24,021 - lava_callback - INFO - Received callback for node 69ba68b0537ae4d3c8237789 INFO: 172.21.0.1:50288 - "POST /node/69ba68b0537ae4d3c8237789 HTTP/1.0" 202 Accepted 2026-03-20 08:56:24,027 - lava_callback - INFO - Starting async job submit for node 69ba68b0537ae4d3c8237789 2026-03-20 08:56:24,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:56:24,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba68b0537ae4d3c8237789 HTTP/1.1" 200 None 2026-03-20 08:56:24,051 - lava_callback - DEBUG - Processing node 69ba68b0537ae4d3c8237789: baseline-arm-clabbe 2026-03-20 08:56:24,051 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba68b0537ae4d3c8237789 2026-03-20 08:56:24,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:56:24,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba68b0537ae4d3c8237789 HTTP/1.1" 200 None 2026-03-20 08:56:24,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:56:24,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276654bce73bcf0233d14 HTTP/1.1" 200 None 2026-03-20 08:56:24,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:56:24,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba68b0537ae4d3c8237789 HTTP/1.1" 200 None 2026-03-20 08:56:24,108 - lava_callback - ERROR - Error processing callback for node 69ba68b0537ae4d3c8237789: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40690 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:57:20,171 - lava_callback - INFO - Received callback for node 69bd0baa05e4bbd6ba6358e1 INFO: 172.21.0.1:43230 - "POST /node/69bd0baa05e4bbd6ba6358e1 HTTP/1.0" 202 Accepted 2026-03-20 08:57:20,178 - lava_callback - INFO - Starting async job submit for node 69bd0baa05e4bbd6ba6358e1 2026-03-20 08:57:20,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:57:20,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0baa05e4bbd6ba6358e1 HTTP/1.1" 200 None 2026-03-20 08:57:20,229 - lava_callback - DEBUG - Processing node 69bd0baa05e4bbd6ba6358e1: baseline-arm64 2026-03-20 08:57:20,458 - lava_callback - WARNING - Failed to upload log 2026-03-20 08:57:20,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:57:20,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:57:20,797 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0baa05e4bbd6ba6358e1/lava-logs.yaml 2026-03-20 08:57:20,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:57:20,943 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:57:20,944 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0baa05e4bbd6ba6358e1/lava_callback.json.gz 2026-03-20 08:57:20,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:57:20,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0baa05e4bbd6ba6358e1 HTTP/1.1" 200 None 2026-03-20 08:57:20,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:57:21,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:57:21,008 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:57:21,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0baa05e4bbd6ba6358e1 HTTP/1.1" 200 None 2026-03-20 08:57:21,117 - lava_callback - INFO - Completed processing callback for node 69bd0baa05e4bbd6ba6358e1 INFO: 172.21.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53760 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:57:38,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:57:38,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50354 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:57:59,706 - lava_callback - INFO - Received callback for node 69bd083605e4bbd6ba63535a INFO: 172.21.0.1:50822 - "POST /node/69bd083605e4bbd6ba63535a HTTP/1.0" 202 Accepted 2026-03-20 08:57:59,713 - lava_callback - INFO - Starting async job submit for node 69bd083605e4bbd6ba63535a 2026-03-20 08:57:59,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:57:59,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083605e4bbd6ba63535a HTTP/1.1" 200 None 2026-03-20 08:57:59,784 - lava_callback - DEBUG - Processing node 69bd083605e4bbd6ba63535a: baseline-arm 2026-03-20 08:58:00,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:58:00,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:58:00,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083605e4bbd6ba63535a/log.txt.gz 2026-03-20 08:58:00,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:58:01,237 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:58:01,239 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083605e4bbd6ba63535a/lava-logs.yaml 2026-03-20 08:58:01,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:58:01,439 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:58:01,441 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd083605e4bbd6ba63535a/lava_callback.json.gz DEBUG: Setup failed for 69bd083605e4bbd6ba63535a. Transitting job node result: incomplete -> fail 2026-03-20 08:58:01,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:01,569 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd083605e4bbd6ba63535a HTTP/1.1" 200 None 2026-03-20 08:58:01,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:01,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:58:01,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:01,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd083605e4bbd6ba63535a HTTP/1.1" 200 None 2026-03-20 08:58:01,719 - lava_callback - INFO - Completed processing callback for node 69bd083605e4bbd6ba63535a INFO: 172.21.0.1:50834 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:58:08,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:08,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52558 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:58:47,496 - lava_callback - INFO - Received callback for node 69bd0bf805e4bbd6ba6358f4 INFO: 172.21.0.1:52560 - "POST /node/69bd0bf805e4bbd6ba6358f4 HTTP/1.0" 202 Accepted 2026-03-20 08:58:47,502 - lava_callback - INFO - Starting async job submit for node 69bd0bf805e4bbd6ba6358f4 2026-03-20 08:58:47,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:47,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0bf805e4bbd6ba6358f4 HTTP/1.1" 200 None 2026-03-20 08:58:47,540 - lava_callback - DEBUG - Processing node 69bd0bf805e4bbd6ba6358f4: baseline-arm64 2026-03-20 08:58:47,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:58:47,993 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:58:47,995 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0bf805e4bbd6ba6358f4/log.txt.gz 2026-03-20 08:58:48,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:58:48,407 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:58:48,410 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0bf805e4bbd6ba6358f4/lava-logs.yaml 2026-03-20 08:58:48,419 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:58:48,582 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:58:48,584 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0bf805e4bbd6ba6358f4/lava_callback.json.gz 2026-03-20 08:58:48,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:48,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0bf805e4bbd6ba6358f4 HTTP/1.1" 200 None 2026-03-20 08:58:48,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:48,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 08:58:48,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:48,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0bf805e4bbd6ba6358f4 HTTP/1.1" 200 None 2026-03-20 08:58:48,668 - lava_callback - INFO - Completed processing callback for node 69bd0bf805e4bbd6ba6358f4 INFO: 172.21.0.1:52570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:58:58,087 - lava_callback - INFO - Received callback for node 69bd0c3d05e4bbd6ba635910 INFO: 172.21.0.1:58572 - "POST /node/69bd0c3d05e4bbd6ba635910 HTTP/1.0" 202 Accepted 2026-03-20 08:58:58,093 - lava_callback - INFO - Starting async job submit for node 69bd0c3d05e4bbd6ba635910 2026-03-20 08:58:58,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:58,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0c3d05e4bbd6ba635910 HTTP/1.1" 200 None 2026-03-20 08:58:58,111 - lava_callback - DEBUG - Processing node 69bd0c3d05e4bbd6ba635910: baseline-arm 2026-03-20 08:58:58,116 - lava_callback - WARNING - Failed to upload log 2026-03-20 08:58:58,119 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:58:58,274 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:58:58,276 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd0c3d05e4bbd6ba635910/lava-logs.yaml 2026-03-20 08:58:58,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 08:58:58,396 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 08:58:58,398 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd0c3d05e4bbd6ba635910/lava_callback.json.gz 2026-03-20 08:58:58,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:58,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0c3d05e4bbd6ba635910 HTTP/1.1" 200 None 2026-03-20 08:58:58,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:58,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 08:58:58,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:58:58,454 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0c3d05e4bbd6ba635910 HTTP/1.1" 200 None 2026-03-20 08:58:58,463 - lava_callback - INFO - Completed processing callback for node 69bd0c3d05e4bbd6ba635910 INFO: 172.21.0.1:46178 - "GET / HTTP/1.0" 200 OK 2026-03-20 08:59:08,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 08:59:08,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52290 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:01:26,750 - lava_callback - INFO - Received callback for node 69bd085405e4bbd6ba635412 INFO: 172.21.0.1:52304 - "POST /node/69bd085405e4bbd6ba635412 HTTP/1.0" 202 Accepted 2026-03-20 09:01:26,797 - lava_callback - INFO - Starting async job submit for node 69bd085405e4bbd6ba635412 2026-03-20 09:01:26,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:01:26,836 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd085405e4bbd6ba635412 HTTP/1.1" 200 None 2026-03-20 09:01:26,837 - lava_callback - DEBUG - Processing node 69bd085405e4bbd6ba635412: baseline-arm-pengutronix 2026-03-20 09:01:26,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:01:27,113 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:01:27,115 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085405e4bbd6ba635412/log.txt.gz 2026-03-20 09:01:27,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:01:27,345 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:01:27,347 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085405e4bbd6ba635412/lava-logs.yaml 2026-03-20 09:01:27,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:01:27,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:01:27,479 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd085405e4bbd6ba635412/lava_callback.json.gz DEBUG: Setup failed for 69bd085405e4bbd6ba635412. Transitting job node result: incomplete -> fail 2026-03-20 09:01:27,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:01:27,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd085405e4bbd6ba635412 HTTP/1.1" 200 None 2026-03-20 09:01:27,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:01:27,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 09:01:27,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:01:27,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd085405e4bbd6ba635412 HTTP/1.1" 200 None 2026-03-20 09:01:27,653 - lava_callback - INFO - Completed processing callback for node 69bd085405e4bbd6ba635412 INFO: 172.21.0.1:33518 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:01:38,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:01:38,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:40982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48896 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:03:47,413 - lava_callback - INFO - Received callback for node 69bd091d05e4bbd6ba635608 INFO: 172.21.0.1:48908 - "POST /node/69bd091d05e4bbd6ba635608 HTTP/1.0" 202 Accepted 2026-03-20 09:03:47,420 - lava_callback - INFO - Starting async job submit for node 69bd091d05e4bbd6ba635608 2026-03-20 09:03:47,446 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:03:47,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091d05e4bbd6ba635608 HTTP/1.1" 200 None 2026-03-20 09:03:47,460 - lava_callback - DEBUG - Processing node 69bd091d05e4bbd6ba635608: baseline-nfs-arm64 2026-03-20 09:03:47,969 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:03:48,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:03:48,131 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091d05e4bbd6ba635608/log.txt.gz 2026-03-20 09:03:48,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:03:48,644 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:03:48,646 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091d05e4bbd6ba635608/lava-logs.yaml 2026-03-20 09:03:48,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:03:48,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:03:48,840 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091d05e4bbd6ba635608/lava_callback.json.gz 2026-03-20 09:03:48,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:03:48,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091d05e4bbd6ba635608 HTTP/1.1" 200 None 2026-03-20 09:03:48,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:03:48,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:03:48,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:03:48,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd091d05e4bbd6ba635608 HTTP/1.1" 200 None 2026-03-20 09:03:49,025 - lava_callback - INFO - Completed processing callback for node 69bd091d05e4bbd6ba635608 INFO: 172.21.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40702 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:04:08,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:04:08,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53490 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:05:06,596 - lava_callback - INFO - Received callback for node 69bd091605e4bbd6ba6355f4 INFO: 172.21.0.1:53498 - "POST /node/69bd091605e4bbd6ba6355f4 HTTP/1.0" 202 Accepted 2026-03-20 09:05:06,605 - lava_callback - INFO - Starting async job submit for node 69bd091605e4bbd6ba6355f4 2026-03-20 09:05:06,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:06,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091605e4bbd6ba6355f4 HTTP/1.1" 200 None 2026-03-20 09:05:06,681 - lava_callback - DEBUG - Processing node 69bd091605e4bbd6ba6355f4: baseline-nfs-arm64 2026-03-20 09:05:07,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:05:07,900 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:05:07,902 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091605e4bbd6ba6355f4/log.txt.gz 2026-03-20 09:05:08,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:05:08,720 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:05:08,723 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091605e4bbd6ba6355f4/lava-logs.yaml 2026-03-20 09:05:08,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:05:08,920 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:05:08,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd091605e4bbd6ba6355f4/lava_callback.json.gz DEBUG: Setup failed for 69bd091605e4bbd6ba6355f4. Transitting job node result: incomplete -> fail 2026-03-20 09:05:09,029 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:09,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd091605e4bbd6ba6355f4 HTTP/1.1" 200 None 2026-03-20 09:05:09,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:09,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:05:09,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:09,113 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd091605e4bbd6ba6355f4 HTTP/1.1" 200 None 2026-03-20 09:05:09,214 - lava_callback - INFO - Completed processing callback for node 69bd091605e4bbd6ba6355f4 INFO: 172.21.0.1:40988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41000 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:05:22,198 - lava_callback - INFO - Received callback for node 69ba6acf537ae4d3c82377d6 INFO: 172.21.0.1:35258 - "POST /node/69ba6acf537ae4d3c82377d6 HTTP/1.0" 202 Accepted 2026-03-20 09:05:22,203 - lava_callback - INFO - Starting async job submit for node 69ba6acf537ae4d3c82377d6 2026-03-20 09:05:22,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:22,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6acf537ae4d3c82377d6 HTTP/1.1" 200 None 2026-03-20 09:05:22,223 - lava_callback - DEBUG - Processing node 69ba6acf537ae4d3c82377d6: baseline-x86 2026-03-20 09:05:22,223 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6acf537ae4d3c82377d6 2026-03-20 09:05:22,224 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:22,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6acf537ae4d3c82377d6 HTTP/1.1" 200 None 2026-03-20 09:05:22,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:22,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None 2026-03-20 09:05:22,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:22,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6acf537ae4d3c82377d6 HTTP/1.1" 200 None 2026-03-20 09:05:22,274 - lava_callback - ERROR - Error processing callback for node 69ba6acf537ae4d3c82377d6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35266 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:05:36,030 - lava_callback - INFO - Received callback for node 69bd090505e4bbd6ba63558a INFO: 172.21.0.1:44290 - "POST /node/69bd090505e4bbd6ba63558a HTTP/1.0" 202 Accepted 2026-03-20 09:05:36,037 - lava_callback - INFO - Starting async job submit for node 69bd090505e4bbd6ba63558a 2026-03-20 09:05:36,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:36,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090505e4bbd6ba63558a HTTP/1.1" 200 None 2026-03-20 09:05:36,093 - lava_callback - DEBUG - Processing node 69bd090505e4bbd6ba63558a: baseline-arm64 INFO: 172.21.0.1:44294 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:05:36,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:05:36,863 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:05:36,865 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090505e4bbd6ba63558a/log.txt.gz 2026-03-20 09:05:37,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:05:37,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:05:37,488 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090505e4bbd6ba63558a/lava-logs.yaml 2026-03-20 09:05:37,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:05:37,669 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:05:37,671 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd090505e4bbd6ba63558a/lava_callback.json.gz DEBUG: Setup failed for 69bd090505e4bbd6ba63558a. Transitting job node result: incomplete -> fail 2026-03-20 09:05:37,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:37,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd090505e4bbd6ba63558a HTTP/1.1" 200 None 2026-03-20 09:05:37,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:37,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:05:37,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:37,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd090505e4bbd6ba63558a HTTP/1.1" 200 None 2026-03-20 09:05:37,864 - lava_callback - INFO - Completed processing callback for node 69bd090505e4bbd6ba63558a 2026-03-20 09:05:38,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:05:38,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36624 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35916 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:06:42,682 - lava_callback - INFO - Received callback for node 69bd093405e4bbd6ba63566b INFO: 172.21.0.1:37372 - "POST /node/69bd093405e4bbd6ba63566b HTTP/1.0" 202 Accepted 2026-03-20 09:06:42,688 - lava_callback - INFO - Starting async job submit for node 69bd093405e4bbd6ba63566b 2026-03-20 09:06:42,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:42,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093405e4bbd6ba63566b HTTP/1.1" 200 None 2026-03-20 09:06:42,725 - lava_callback - DEBUG - Processing node 69bd093405e4bbd6ba63566b: baseline-arm64-broonie 2026-03-20 09:06:42,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:06:42,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:06:42,963 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093405e4bbd6ba63566b/log.txt.gz 2026-03-20 09:06:43,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:06:43,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:06:43,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093405e4bbd6ba63566b/lava-logs.yaml 2026-03-20 09:06:43,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:06:43,381 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:06:43,382 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093405e4bbd6ba63566b/lava_callback.json.gz 2026-03-20 09:06:43,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:43,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093405e4bbd6ba63566b HTTP/1.1" 200 None 2026-03-20 09:06:43,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:43,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:06:43,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:43,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd093405e4bbd6ba63566b HTTP/1.1" 200 None 2026-03-20 09:06:43,530 - lava_callback - INFO - Completed processing callback for node 69bd093405e4bbd6ba63566b 2026-03-20 09:06:43,939 - lava_callback - INFO - Received callback for node 69bd093605e4bbd6ba635672 INFO: 172.21.0.1:37374 - "POST /node/69bd093605e4bbd6ba635672 HTTP/1.0" 202 Accepted 2026-03-20 09:06:43,945 - lava_callback - INFO - Starting async job submit for node 69bd093605e4bbd6ba635672 2026-03-20 09:06:43,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:43,983 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093605e4bbd6ba635672 HTTP/1.1" 200 None 2026-03-20 09:06:43,984 - lava_callback - DEBUG - Processing node 69bd093605e4bbd6ba635672: baseline-arm64-broonie 2026-03-20 09:06:44,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:06:44,256 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:06:44,258 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093605e4bbd6ba635672/log.txt.gz 2026-03-20 09:06:44,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:06:44,485 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:06:44,487 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093605e4bbd6ba635672/lava-logs.yaml 2026-03-20 09:06:44,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:06:44,611 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:06:44,613 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093605e4bbd6ba635672/lava_callback.json.gz 2026-03-20 09:06:44,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:44,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093605e4bbd6ba635672 HTTP/1.1" 200 None 2026-03-20 09:06:44,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:44,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:06:44,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:44,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd093605e4bbd6ba635672 HTTP/1.1" 200 None 2026-03-20 09:06:44,758 - lava_callback - INFO - Completed processing callback for node 69bd093605e4bbd6ba635672 2026-03-20 09:06:45,226 - lava_callback - INFO - Received callback for node 69bd093705e4bbd6ba635675 INFO: 172.21.0.1:37380 - "POST /node/69bd093705e4bbd6ba635675 HTTP/1.0" 202 Accepted 2026-03-20 09:06:45,233 - lava_callback - INFO - Starting async job submit for node 69bd093705e4bbd6ba635675 2026-03-20 09:06:45,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:45,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093705e4bbd6ba635675 HTTP/1.1" 200 None 2026-03-20 09:06:45,271 - lava_callback - DEBUG - Processing node 69bd093705e4bbd6ba635675: baseline-arm64-broonie 2026-03-20 09:06:45,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:06:45,484 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:06:45,486 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093705e4bbd6ba635675/log.txt.gz 2026-03-20 09:06:45,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:06:45,701 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:06:45,703 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093705e4bbd6ba635675/lava-logs.yaml 2026-03-20 09:06:45,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:06:45,846 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:06:45,848 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd093705e4bbd6ba635675/lava_callback.json.gz 2026-03-20 09:06:45,870 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:45,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd093705e4bbd6ba635675 HTTP/1.1" 200 None 2026-03-20 09:06:45,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:45,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:06:45,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:06:45,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd093705e4bbd6ba635675 HTTP/1.1" 200 None 2026-03-20 09:06:45,984 - lava_callback - INFO - Completed processing callback for node 69bd093705e4bbd6ba635675 INFO: 172.21.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39792 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:07:08,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:08,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:07:32,535 - lava_callback - INFO - Received callback for node 69bd0e4105e4bbd6ba6359e0 INFO: 172.21.0.1:47722 - "POST /node/69bd0e4105e4bbd6ba6359e0 HTTP/1.0" 202 Accepted 2026-03-20 09:07:32,541 - lava_callback - INFO - Starting async job submit for node 69bd0e4105e4bbd6ba6359e0 2026-03-20 09:07:32,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:32,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0e4105e4bbd6ba6359e0 HTTP/1.1" 200 None 2026-03-20 09:07:32,558 - lava_callback - DEBUG - Processing node 69bd0e4105e4bbd6ba6359e0: baseline-nfs-arm64 2026-03-20 09:07:32,560 - lava_callback - WARNING - Failed to upload log 2026-03-20 09:07:32,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:07:32,705 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:07:32,707 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd0e4105e4bbd6ba6359e0/lava-logs.yaml 2026-03-20 09:07:32,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:07:32,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:07:32,828 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd0e4105e4bbd6ba6359e0/lava_callback.json.gz 2026-03-20 09:07:32,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:32,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0e4105e4bbd6ba6359e0 HTTP/1.1" 200 None 2026-03-20 09:07:32,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:32,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:07:32,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:32,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0e4105e4bbd6ba6359e0 HTTP/1.1" 200 None 2026-03-20 09:07:32,900 - lava_callback - INFO - Completed processing callback for node 69bd0e4105e4bbd6ba6359e0 2026-03-20 09:07:33,675 - lava_callback - INFO - Received callback for node 69bd0e3405e4bbd6ba6359d8 INFO: 172.21.0.1:47732 - "POST /node/69bd0e3405e4bbd6ba6359d8 HTTP/1.0" 202 Accepted 2026-03-20 09:07:33,681 - lava_callback - INFO - Starting async job submit for node 69bd0e3405e4bbd6ba6359d8 2026-03-20 09:07:33,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:33,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0e3405e4bbd6ba6359d8 HTTP/1.1" 200 None 2026-03-20 09:07:33,714 - lava_callback - DEBUG - Processing node 69bd0e3405e4bbd6ba6359d8: baseline-x86 2026-03-20 09:07:33,890 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:07:34,008 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:07:34,010 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0e3405e4bbd6ba6359d8/log.txt.gz 2026-03-20 09:07:34,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:07:34,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:07:34,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0e3405e4bbd6ba6359d8/lava-logs.yaml 2026-03-20 09:07:34,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:07:34,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:07:34,458 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0e3405e4bbd6ba6359d8/lava_callback.json.gz 2026-03-20 09:07:34,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:34,493 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0e3405e4bbd6ba6359d8 HTTP/1.1" 200 None 2026-03-20 09:07:34,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:34,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd028c05e4bbd6ba634c81 HTTP/1.1" 200 None 2026-03-20 09:07:34,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:34,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0e3405e4bbd6ba6359d8 HTTP/1.1" 200 None 2026-03-20 09:07:34,542 - lava_callback - INFO - Completed processing callback for node 69bd0e3405e4bbd6ba6359d8 INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:07:38,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:38,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-20 09:07:42,003 - lava_callback - INFO - Received callback for node 69bd0e3305e4bbd6ba6359d4 INFO: 172.21.0.1:39970 - "POST /node/69bd0e3305e4bbd6ba6359d4 HTTP/1.0" 202 Accepted 2026-03-20 09:07:42,009 - lava_callback - INFO - Starting async job submit for node 69bd0e3305e4bbd6ba6359d4 2026-03-20 09:07:42,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:42,043 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0e3305e4bbd6ba6359d4 HTTP/1.1" 200 None 2026-03-20 09:07:42,044 - lava_callback - DEBUG - Processing node 69bd0e3305e4bbd6ba6359d4: baseline-x86 2026-03-20 09:07:42,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:07:42,349 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:07:42,351 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0e3305e4bbd6ba6359d4/log.txt.gz 2026-03-20 09:07:42,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:07:42,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:07:42,629 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0e3305e4bbd6ba6359d4/lava-logs.yaml 2026-03-20 09:07:42,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:07:42,767 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:07:42,768 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bd0e3305e4bbd6ba6359d4/lava_callback.json.gz 2026-03-20 09:07:42,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:42,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0e3305e4bbd6ba6359d4 HTTP/1.1" 200 None 2026-03-20 09:07:42,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:42,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd028c05e4bbd6ba634c81 HTTP/1.1" 200 None 2026-03-20 09:07:42,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:07:42,842 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0e3305e4bbd6ba6359d4 HTTP/1.1" 200 None 2026-03-20 09:07:42,848 - lava_callback - INFO - Completed processing callback for node 69bd0e3305e4bbd6ba6359d4 INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33056 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:08:08,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:08:08,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49338 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35830 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:11:34,274 - lava_callback - INFO - Received callback for node 69bd0f0005e4bbd6ba635a27 INFO: 172.21.0.1:35962 - "POST /node/69bd0f0005e4bbd6ba635a27 HTTP/1.0" 202 Accepted 2026-03-20 09:11:34,281 - lava_callback - INFO - Starting async job submit for node 69bd0f0005e4bbd6ba635a27 2026-03-20 09:11:34,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:11:34,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0f0005e4bbd6ba635a27 HTTP/1.1" 200 None 2026-03-20 09:11:34,327 - lava_callback - DEBUG - Processing node 69bd0f0005e4bbd6ba635a27: baseline-arm64 2026-03-20 09:11:34,463 - lava_callback - WARNING - Failed to upload log 2026-03-20 09:11:34,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:11:34,740 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:11:34,742 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0f0005e4bbd6ba635a27/lava-logs.yaml 2026-03-20 09:11:34,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:11:34,888 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:11:34,890 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0f0005e4bbd6ba635a27/lava_callback.json.gz 2026-03-20 09:11:34,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:11:34,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0f0005e4bbd6ba635a27 HTTP/1.1" 200 None 2026-03-20 09:11:34,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:11:34,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:11:34,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:11:35,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0f0005e4bbd6ba635a27 HTTP/1.1" 200 None 2026-03-20 09:11:35,068 - lava_callback - INFO - Completed processing callback for node 69bd0f0005e4bbd6ba635a27 INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:11:38,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:11:38,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46254 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37588 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:13:47,696 - lava_callback - INFO - Received callback for node 69bd0f8f05e4bbd6ba635a49 INFO: 172.21.0.1:37602 - "POST /node/69bd0f8f05e4bbd6ba635a49 HTTP/1.0" 202 Accepted 2026-03-20 09:13:47,704 - lava_callback - INFO - Starting async job submit for node 69bd0f8f05e4bbd6ba635a49 2026-03-20 09:13:47,743 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:13:47,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0f8f05e4bbd6ba635a49 HTTP/1.1" 200 None 2026-03-20 09:13:47,758 - lava_callback - DEBUG - Processing node 69bd0f8f05e4bbd6ba635a49: baseline-arm64 2026-03-20 09:13:47,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:13:48,046 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:13:48,047 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0f8f05e4bbd6ba635a49/log.txt.gz 2026-03-20 09:13:48,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:13:48,309 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:13:48,311 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0f8f05e4bbd6ba635a49/lava-logs.yaml 2026-03-20 09:13:48,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:13:48,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:13:48,454 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0f8f05e4bbd6ba635a49/lava_callback.json.gz 2026-03-20 09:13:48,484 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:13:48,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0f8f05e4bbd6ba635a49 HTTP/1.1" 200 None 2026-03-20 09:13:48,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:13:48,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:13:48,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:13:48,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0f8f05e4bbd6ba635a49 HTTP/1.1" 200 None 2026-03-20 09:13:48,621 - lava_callback - INFO - Completed processing callback for node 69bd0f8f05e4bbd6ba635a49 INFO: 172.21.0.1:36910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39098 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:14:08,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:14:09,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:44246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56824 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:14:38,635 - lava_callback - INFO - Received callback for node 69bd0ff005e4bbd6ba635a67 INFO: 172.21.0.1:56840 - "POST /node/69bd0ff005e4bbd6ba635a67 HTTP/1.0" 202 Accepted 2026-03-20 09:14:38,641 - lava_callback - INFO - Starting async job submit for node 69bd0ff005e4bbd6ba635a67 2026-03-20 09:14:38,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:14:38,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ff005e4bbd6ba635a67 HTTP/1.1" 200 None 2026-03-20 09:14:38,658 - lava_callback - DEBUG - Processing node 69bd0ff005e4bbd6ba635a67: baseline-arm 2026-03-20 09:14:38,663 - lava_callback - WARNING - Failed to upload log 2026-03-20 09:14:38,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:14:38,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:14:38,807 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd0ff005e4bbd6ba635a67/lava-logs.yaml 2026-03-20 09:14:38,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:14:38,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:14:38,935 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd0ff005e4bbd6ba635a67/lava_callback.json.gz 2026-03-20 09:14:38,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:14:38,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0ff005e4bbd6ba635a67 HTTP/1.1" 200 None 2026-03-20 09:14:38,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:14:38,966 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 09:14:38,968 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:14:38,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0ff005e4bbd6ba635a67 HTTP/1.1" 200 None 2026-03-20 09:14:38,998 - lava_callback - INFO - Completed processing callback for node 69bd0ff005e4bbd6ba635a67 2026-03-20 09:14:39,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:14:39,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:42296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37142 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57766 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:18:48,602 - lava_callback - INFO - Received callback for node 69bd0cc705e4bbd6ba635967 INFO: 172.21.0.1:57778 - "POST /node/69bd0cc705e4bbd6ba635967 HTTP/1.0" 202 Accepted 2026-03-20 09:18:48,609 - lava_callback - INFO - Starting async job submit for node 69bd0cc705e4bbd6ba635967 2026-03-20 09:18:48,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:18:48,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0cc705e4bbd6ba635967 HTTP/1.1" 200 None 2026-03-20 09:18:48,703 - lava_callback - DEBUG - Processing node 69bd0cc705e4bbd6ba635967: ltp-smoke 2026-03-20 09:18:49,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:18:49,334 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:18:49,336 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd0cc705e4bbd6ba635967/log.txt.gz 2026-03-20 09:18:49,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:18:49,819 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:18:49,821 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd0cc705e4bbd6ba635967/lava-logs.yaml 2026-03-20 09:18:49,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:43716 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:18:50,010 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:18:50,012 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd0cc705e4bbd6ba635967/lava_callback.json.gz 2026-03-20 09:18:50,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:18:50,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0cc705e4bbd6ba635967 HTTP/1.1" 200 None 2026-03-20 09:18:50,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:18:50,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027205e4bbd6ba634c5d HTTP/1.1" 200 None 2026-03-20 09:18:50,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:18:50,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0cc705e4bbd6ba635967 HTTP/1.1" 200 None 2026-03-20 09:18:50,322 - lava_callback - INFO - Completed processing callback for node 69bd0cc705e4bbd6ba635967 INFO: 172.21.0.1:43726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:19:06,849 - lava_callback - INFO - Received callback for node 69bd0e8405e4bbd6ba6359fd INFO: 172.21.0.1:43700 - "POST /node/69bd0e8405e4bbd6ba6359fd HTTP/1.0" 202 Accepted 2026-03-20 09:19:06,855 - lava_callback - INFO - Starting async job submit for node 69bd0e8405e4bbd6ba6359fd 2026-03-20 09:19:06,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:19:06,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0e8405e4bbd6ba6359fd HTTP/1.1" 200 None 2026-03-20 09:19:06,895 - lava_callback - DEBUG - Processing node 69bd0e8405e4bbd6ba6359fd: baseline-arm64 2026-03-20 09:19:07,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:19:07,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:19:07,562 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0e8405e4bbd6ba6359fd/log.txt.gz 2026-03-20 09:19:07,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:19:08,039 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:19:08,041 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0e8405e4bbd6ba6359fd/lava-logs.yaml 2026-03-20 09:19:08,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:19:08,214 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:19:08,216 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0e8405e4bbd6ba6359fd/lava_callback.json.gz 2026-03-20 09:19:08,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:19:08,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0e8405e4bbd6ba6359fd HTTP/1.1" 200 None 2026-03-20 09:19:08,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:19:08,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-20 09:19:08,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:19:08,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0e8405e4bbd6ba6359fd HTTP/1.1" 200 None 2026-03-20 09:19:08,364 - lava_callback - INFO - Completed processing callback for node 69bd0e8405e4bbd6ba6359fd 2026-03-20 09:19:09,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:19:09,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48428 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37784 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:19:35,686 - lava_callback - INFO - Received callback for node 69bd0db105e4bbd6ba6359b2 INFO: 172.21.0.1:43980 - "POST /node/69bd0db105e4bbd6ba6359b2 HTTP/1.0" 202 Accepted 2026-03-20 09:19:35,694 - lava_callback - INFO - Starting async job submit for node 69bd0db105e4bbd6ba6359b2 2026-03-20 09:19:35,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:19:35,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0db105e4bbd6ba6359b2 HTTP/1.1" 200 None 2026-03-20 09:19:35,756 - lava_callback - DEBUG - Processing node 69bd0db105e4bbd6ba6359b2: baseline-arm64 2026-03-20 09:19:36,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:19:36,288 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:19:36,289 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0db105e4bbd6ba6359b2/log.txt.gz INFO: 172.21.0.1:43988 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:19:36,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:19:36,741 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:19:36,743 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0db105e4bbd6ba6359b2/lava-logs.yaml 2026-03-20 09:19:36,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:19:36,935 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:19:36,937 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0db105e4bbd6ba6359b2/lava_callback.json.gz DEBUG: Setup failed for 69bd0db105e4bbd6ba6359b2. Transitting job node result: incomplete -> fail 2026-03-20 09:19:37,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:19:37,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0db105e4bbd6ba6359b2 HTTP/1.1" 200 None 2026-03-20 09:19:37,027 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:19:37,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:19:37,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:19:37,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0db105e4bbd6ba6359b2 HTTP/1.1" 200 None 2026-03-20 09:19:37,140 - lava_callback - INFO - Completed processing callback for node 69bd0db105e4bbd6ba6359b2 2026-03-20 09:19:39,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:19:39,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52574 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:20:06,177 - lava_callback - INFO - Received callback for node 69ba6e41537ae4d3c82378d0 INFO: 172.21.0.1:47026 - "POST /node/69ba6e41537ae4d3c82378d0 HTTP/1.0" 202 Accepted 2026-03-20 09:20:06,182 - lava_callback - INFO - Starting async job submit for node 69ba6e41537ae4d3c82378d0 2026-03-20 09:20:06,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:20:06,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6e41537ae4d3c82378d0 HTTP/1.1" 200 None 2026-03-20 09:20:06,199 - lava_callback - DEBUG - Processing node 69ba6e41537ae4d3c82378d0: baseline-arm64-baylibre 2026-03-20 09:20:06,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6e41537ae4d3c82378d0 2026-03-20 09:20:06,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:20:06,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6e41537ae4d3c82378d0 HTTP/1.1" 200 None 2026-03-20 09:20:06,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:20:06,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:20:06,230 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:20:06,255 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6e41537ae4d3c82378d0 HTTP/1.1" 200 None 2026-03-20 09:20:06,256 - lava_callback - ERROR - Error processing callback for node 69ba6e41537ae4d3c82378d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36182 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:20:28,691 - lava_callback - INFO - Received callback for node 69bd092c05e4bbd6ba635651 INFO: 172.21.0.1:36196 - "POST /node/69bd092c05e4bbd6ba635651 HTTP/1.0" 202 Accepted 2026-03-20 09:20:28,698 - lava_callback - INFO - Starting async job submit for node 69bd092c05e4bbd6ba635651 2026-03-20 09:20:28,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:20:28,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092c05e4bbd6ba635651 HTTP/1.1" 200 None 2026-03-20 09:20:28,742 - lava_callback - DEBUG - Processing node 69bd092c05e4bbd6ba635651: baseline-arm64-broonie 2026-03-20 09:20:29,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:20:29,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:20:29,174 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092c05e4bbd6ba635651/log.txt.gz 2026-03-20 09:20:29,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:20:29,540 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:20:29,542 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092c05e4bbd6ba635651/lava-logs.yaml 2026-03-20 09:20:29,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:20:29,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:20:29,659 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd092c05e4bbd6ba635651/lava_callback.json.gz 2026-03-20 09:20:29,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:20:29,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd092c05e4bbd6ba635651 HTTP/1.1" 200 None 2026-03-20 09:20:29,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:20:29,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:20:29,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:20:29,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd092c05e4bbd6ba635651 HTTP/1.1" 200 None 2026-03-20 09:20:29,803 - lava_callback - INFO - Completed processing callback for node 69bd092c05e4bbd6ba635651 INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:20:39,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:20:39,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:21:26,165 - lava_callback - INFO - Received callback for node 69ba6e94537ae4d3c82378db INFO: 172.21.0.1:60400 - "POST /node/69ba6e94537ae4d3c82378db HTTP/1.0" 202 Accepted 2026-03-20 09:21:26,171 - lava_callback - INFO - Starting async job submit for node 69ba6e94537ae4d3c82378db 2026-03-20 09:21:26,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:21:26,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6e94537ae4d3c82378db HTTP/1.1" 200 None 2026-03-20 09:21:26,187 - lava_callback - DEBUG - Processing node 69ba6e94537ae4d3c82378db: baseline-arm64-baylibre 2026-03-20 09:21:26,187 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6e94537ae4d3c82378db 2026-03-20 09:21:26,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:21:26,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6e94537ae4d3c82378db HTTP/1.1" 200 None 2026-03-20 09:21:26,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:21:26,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:21:26,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:21:26,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6e94537ae4d3c82378db HTTP/1.1" 200 None 2026-03-20 09:21:26,242 - lava_callback - ERROR - Error processing callback for node 69ba6e94537ae4d3c82378db: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57762 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:22:20,022 - lava_callback - INFO - Received callback for node 69bd0f4b05e4bbd6ba635a3b INFO: 172.21.0.1:52598 - "POST /node/69bd0f4b05e4bbd6ba635a3b HTTP/1.0" 202 Accepted 2026-03-20 09:22:20,028 - lava_callback - INFO - Starting async job submit for node 69bd0f4b05e4bbd6ba635a3b 2026-03-20 09:22:20,063 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:22:20,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0f4b05e4bbd6ba635a3b HTTP/1.1" 200 None 2026-03-20 09:22:20,078 - lava_callback - DEBUG - Processing node 69bd0f4b05e4bbd6ba635a3b: baseline-arm64 2026-03-20 09:22:20,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:22:20,760 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:22:20,762 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0f4b05e4bbd6ba635a3b/log.txt.gz 2026-03-20 09:22:21,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:22:21,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:22:21,236 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0f4b05e4bbd6ba635a3b/lava-logs.yaml 2026-03-20 09:22:21,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:22:21,411 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:22:21,413 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd0f4b05e4bbd6ba635a3b/lava_callback.json.gz 2026-03-20 09:22:21,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:22:21,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0f4b05e4bbd6ba635a3b HTTP/1.1" 200 None 2026-03-20 09:22:21,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:22:21,477 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:22:21,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:22:21,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0f4b05e4bbd6ba635a3b HTTP/1.1" 200 None 2026-03-20 09:22:21,563 - lava_callback - INFO - Completed processing callback for node 69bd0f4b05e4bbd6ba635a3b INFO: 172.21.0.1:52604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34374 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:22:39,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:22:39,128 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-20 09:22:46,294 - lava_callback - INFO - Received callback for node 69ba6ee3537ae4d3c82378e7 INFO: 172.21.0.1:50390 - "POST /node/69ba6ee3537ae4d3c82378e7 HTTP/1.0" 202 Accepted 2026-03-20 09:22:46,299 - lava_callback - INFO - Starting async job submit for node 69ba6ee3537ae4d3c82378e7 2026-03-20 09:22:46,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:22:46,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6ee3537ae4d3c82378e7 HTTP/1.1" 200 None 2026-03-20 09:22:46,314 - lava_callback - DEBUG - Processing node 69ba6ee3537ae4d3c82378e7: baseline-arm64-baylibre 2026-03-20 09:22:46,314 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6ee3537ae4d3c82378e7 2026-03-20 09:22:46,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:22:46,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6ee3537ae4d3c82378e7 HTTP/1.1" 200 None 2026-03-20 09:22:46,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:22:46,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:22:46,350 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:22:46,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6ee3537ae4d3c82378e7 HTTP/1.1" 200 None 2026-03-20 09:22:46,372 - lava_callback - ERROR - Error processing callback for node 69ba6ee3537ae4d3c82378e7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35760 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59162 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:24:26,366 - lava_callback - INFO - Received callback for node 69ba6f35537ae4d3c82378f2 INFO: 172.21.0.1:32774 - "POST /node/69ba6f35537ae4d3c82378f2 HTTP/1.0" 202 Accepted 2026-03-20 09:24:26,371 - lava_callback - INFO - Starting async job submit for node 69ba6f35537ae4d3c82378f2 2026-03-20 09:24:26,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:24:26,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6f35537ae4d3c82378f2 HTTP/1.1" 200 None 2026-03-20 09:24:26,387 - lava_callback - DEBUG - Processing node 69ba6f35537ae4d3c82378f2: baseline-arm64-baylibre 2026-03-20 09:24:26,387 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6f35537ae4d3c82378f2 2026-03-20 09:24:26,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:24:26,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6f35537ae4d3c82378f2 HTTP/1.1" 200 None 2026-03-20 09:24:26,403 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:24:26,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:24:26,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:24:26,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6f35537ae4d3c82378f2 HTTP/1.1" 200 None 2026-03-20 09:24:26,459 - lava_callback - ERROR - Error processing callback for node 69ba6f35537ae4d3c82378f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38190 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:25:39,910 - lava_callback - INFO - Received callback for node 69bd124e05e4bbd6ba635b37 INFO: 172.21.0.1:56108 - "POST /node/69bd124e05e4bbd6ba635b37 HTTP/1.0" 202 Accepted 2026-03-20 09:25:39,917 - lava_callback - INFO - Starting async job submit for node 69bd124e05e4bbd6ba635b37 2026-03-20 09:25:39,938 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:25:39,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd124e05e4bbd6ba635b37 HTTP/1.1" 200 None 2026-03-20 09:25:39,953 - lava_callback - DEBUG - Processing node 69bd124e05e4bbd6ba635b37: baseline-arm64 2026-03-20 09:25:40,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:25:40,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:25:40,493 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd124e05e4bbd6ba635b37/log.txt.gz 2026-03-20 09:25:40,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:25:40,927 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:25:40,929 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd124e05e4bbd6ba635b37/lava-logs.yaml 2026-03-20 09:25:40,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:25:41,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:25:41,111 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd124e05e4bbd6ba635b37/lava_callback.json.gz 2026-03-20 09:25:41,134 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:25:41,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd124e05e4bbd6ba635b37 HTTP/1.1" 200 None 2026-03-20 09:25:41,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:25:41,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:25:41,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:25:41,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd124e05e4bbd6ba635b37 HTTP/1.1" 200 None 2026-03-20 09:25:41,217 - lava_callback - INFO - Completed processing callback for node 69bd124e05e4bbd6ba635b37 INFO: 172.21.0.1:56112 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:25:46,502 - lava_callback - INFO - Received callback for node 69ba6f87537ae4d3c82378f9 INFO: 172.21.0.1:56120 - "POST /node/69ba6f87537ae4d3c82378f9 HTTP/1.0" 202 Accepted 2026-03-20 09:25:46,507 - lava_callback - INFO - Starting async job submit for node 69ba6f87537ae4d3c82378f9 2026-03-20 09:25:46,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:25:46,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6f87537ae4d3c82378f9 HTTP/1.1" 200 None 2026-03-20 09:25:46,523 - lava_callback - DEBUG - Processing node 69ba6f87537ae4d3c82378f9: baseline-arm64-baylibre 2026-03-20 09:25:46,523 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6f87537ae4d3c82378f9 2026-03-20 09:25:46,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:25:46,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6f87537ae4d3c82378f9 HTTP/1.1" 200 None 2026-03-20 09:25:46,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:25:46,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:25:46,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:25:46,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6f87537ae4d3c82378f9 HTTP/1.1" 200 None 2026-03-20 09:25:46,596 - lava_callback - ERROR - Error processing callback for node 69ba6f87537ae4d3c82378f9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:26:09,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:26:09,148 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:57032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:27:26,538 - lava_callback - INFO - Received callback for node 69ba6ffa537ae4d3c823790e INFO: 172.21.0.1:57198 - "POST /node/69ba6ffa537ae4d3c823790e HTTP/1.0" 202 Accepted 2026-03-20 09:27:26,543 - lava_callback - INFO - Starting async job submit for node 69ba6ffa537ae4d3c823790e 2026-03-20 09:27:26,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:27:26,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6ffa537ae4d3c823790e HTTP/1.1" 200 None 2026-03-20 09:27:26,559 - lava_callback - DEBUG - Processing node 69ba6ffa537ae4d3c823790e: baseline-arm64-baylibre 2026-03-20 09:27:26,560 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba6ffa537ae4d3c823790e 2026-03-20 09:27:26,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:27:26,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba6ffa537ae4d3c823790e HTTP/1.1" 200 None 2026-03-20 09:27:26,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:27:26,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:27:26,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:27:26,619 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba6ffa537ae4d3c823790e HTTP/1.1" 200 None 2026-03-20 09:27:26,620 - lava_callback - ERROR - Error processing callback for node 69ba6ffa537ae4d3c823790e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44780 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:28:03,629 - lava_callback - INFO - Received callback for node 69bd12ab05e4bbd6ba635b4b INFO: 172.21.0.1:53200 - "POST /node/69bd12ab05e4bbd6ba635b4b HTTP/1.0" 202 Accepted 2026-03-20 09:28:03,635 - lava_callback - INFO - Starting async job submit for node 69bd12ab05e4bbd6ba635b4b 2026-03-20 09:28:03,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:28:03,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd12ab05e4bbd6ba635b4b HTTP/1.1" 200 None 2026-03-20 09:28:03,673 - lava_callback - DEBUG - Processing node 69bd12ab05e4bbd6ba635b4b: baseline-arm64-broonie 2026-03-20 09:28:03,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:28:04,092 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:28:04,094 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd12ab05e4bbd6ba635b4b/log.txt.gz 2026-03-20 09:28:04,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:28:04,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:28:04,460 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd12ab05e4bbd6ba635b4b/lava-logs.yaml 2026-03-20 09:28:04,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:28:04,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:28:04,628 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd12ab05e4bbd6ba635b4b/lava_callback.json.gz 2026-03-20 09:28:04,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:28:04,675 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd12ab05e4bbd6ba635b4b HTTP/1.1" 200 None 2026-03-20 09:28:04,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:28:04,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:28:04,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:28:04,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd12ab05e4bbd6ba635b4b HTTP/1.1" 200 None 2026-03-20 09:28:04,716 - lava_callback - INFO - Completed processing callback for node 69bd12ab05e4bbd6ba635b4b INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:28:09,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:28:09,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45804 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:29:03,666 - lava_callback - INFO - Received callback for node 69bd12f705e4bbd6ba635b5a INFO: 172.21.0.1:42648 - "POST /node/69bd12f705e4bbd6ba635b5a HTTP/1.0" 202 Accepted 2026-03-20 09:29:03,672 - lava_callback - INFO - Starting async job submit for node 69bd12f705e4bbd6ba635b5a 2026-03-20 09:29:03,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:29:03,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd12f705e4bbd6ba635b5a HTTP/1.1" 200 None 2026-03-20 09:29:03,717 - lava_callback - DEBUG - Processing node 69bd12f705e4bbd6ba635b5a: baseline-arm64-broonie 2026-03-20 09:29:03,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:29:04,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:29:04,126 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd12f705e4bbd6ba635b5a/log.txt.gz 2026-03-20 09:29:04,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:29:04,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:29:04,477 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd12f705e4bbd6ba635b5a/lava-logs.yaml 2026-03-20 09:29:04,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:29:04,631 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:29:04,632 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd12f705e4bbd6ba635b5a/lava_callback.json.gz 2026-03-20 09:29:04,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:29:04,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd12f705e4bbd6ba635b5a HTTP/1.1" 200 None 2026-03-20 09:29:04,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:29:04,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:29:04,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:29:04,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd12f705e4bbd6ba635b5a HTTP/1.1" 200 None 2026-03-20 09:29:04,729 - lava_callback - INFO - Completed processing callback for node 69bd12f705e4bbd6ba635b5a INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:29:09,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:29:09,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59166 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:29:59,900 - lava_callback - INFO - Received callback for node 69bd138005e4bbd6ba635b80 INFO: 172.21.0.1:50328 - "POST /node/69bd138005e4bbd6ba635b80 HTTP/1.0" 202 Accepted 2026-03-20 09:29:59,905 - lava_callback - INFO - Starting async job submit for node 69bd138005e4bbd6ba635b80 2026-03-20 09:29:59,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:29:59,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd138005e4bbd6ba635b80 HTTP/1.1" 200 None 2026-03-20 09:29:59,924 - lava_callback - DEBUG - Processing node 69bd138005e4bbd6ba635b80: baseline-nfs-arm64 2026-03-20 09:29:59,925 - lava_callback - WARNING - Failed to upload log 2026-03-20 09:29:59,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:30:00,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:30:00,074 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd138005e4bbd6ba635b80/lava-logs.yaml 2026-03-20 09:30:00,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:30:00,212 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:30:00,214 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd138005e4bbd6ba635b80/lava_callback.json.gz 2026-03-20 09:30:00,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:30:00,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd138005e4bbd6ba635b80 HTTP/1.1" 200 None 2026-03-20 09:30:00,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:30:00,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:30:00,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:30:00,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd138005e4bbd6ba635b80 HTTP/1.1" 200 None 2026-03-20 09:30:00,280 - lava_callback - INFO - Completed processing callback for node 69bd138005e4bbd6ba635b80 INFO: 172.21.0.1:50340 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:30:09,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:30:09,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42728 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:30:29,114 - lava_callback - INFO - Received callback for node 69bd134305e4bbd6ba635b70 INFO: 172.21.0.1:42744 - "POST /node/69bd134305e4bbd6ba635b70 HTTP/1.0" 202 Accepted 2026-03-20 09:30:29,120 - lava_callback - INFO - Starting async job submit for node 69bd134305e4bbd6ba635b70 2026-03-20 09:30:29,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:30:29,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd134305e4bbd6ba635b70 HTTP/1.1" 200 None 2026-03-20 09:30:29,158 - lava_callback - DEBUG - Processing node 69bd134305e4bbd6ba635b70: baseline-arm64-broonie 2026-03-20 09:30:29,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:30:29,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:30:29,555 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd134305e4bbd6ba635b70/log.txt.gz 2026-03-20 09:30:29,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:30:29,926 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:30:29,928 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd134305e4bbd6ba635b70/lava-logs.yaml 2026-03-20 09:30:29,934 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:30:30,126 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:30:30,128 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd134305e4bbd6ba635b70/lava_callback.json.gz 2026-03-20 09:30:30,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:30:30,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd134305e4bbd6ba635b70 HTTP/1.1" 200 None 2026-03-20 09:30:30,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:30:30,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:30:30,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:30:30,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd134305e4bbd6ba635b70 HTTP/1.1" 200 None 2026-03-20 09:30:30,225 - lava_callback - INFO - Completed processing callback for node 69bd134305e4bbd6ba635b70 INFO: 172.21.0.1:39130 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:30:39,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:30:39,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44376 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:31:08,971 - lava_callback - INFO - Received callback for node 69bd117a05e4bbd6ba635b0b INFO: 172.21.0.1:44384 - "POST /node/69bd117a05e4bbd6ba635b0b HTTP/1.0" 202 Accepted 2026-03-20 09:31:08,978 - lava_callback - INFO - Starting async job submit for node 69bd117a05e4bbd6ba635b0b 2026-03-20 09:31:09,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:09,019 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd117a05e4bbd6ba635b0b HTTP/1.1" 200 None 2026-03-20 09:31:09,020 - lava_callback - DEBUG - Processing node 69bd117a05e4bbd6ba635b0b: baseline-nfs-arm64 2026-03-20 09:31:09,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:31:09,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:31:09,702 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd117a05e4bbd6ba635b0b/log.txt.gz 2026-03-20 09:31:09,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:31:10,192 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:31:10,194 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd117a05e4bbd6ba635b0b/lava-logs.yaml 2026-03-20 09:31:10,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:31:10,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:31:10,362 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd117a05e4bbd6ba635b0b/lava_callback.json.gz 2026-03-20 09:31:10,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:10,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd117a05e4bbd6ba635b0b HTTP/1.1" 200 None 2026-03-20 09:31:10,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:10,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:31:10,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:10,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd117a05e4bbd6ba635b0b HTTP/1.1" 200 None 2026-03-20 09:31:10,526 - lava_callback - INFO - Completed processing callback for node 69bd117a05e4bbd6ba635b0b INFO: 172.21.0.1:36572 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57138 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:31:39,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:39,260 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-20 09:31:45,826 - lava_callback - INFO - Received callback for node 69ba70f0537ae4d3c8237927 INFO: 172.21.0.1:37332 - "POST /node/69ba70f0537ae4d3c8237927 HTTP/1.0" 202 Accepted 2026-03-20 09:31:45,832 - lava_callback - INFO - Starting async job submit for node 69ba70f0537ae4d3c8237927 2026-03-20 09:31:45,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:45,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba70f0537ae4d3c8237927 HTTP/1.1" 200 None 2026-03-20 09:31:45,848 - lava_callback - DEBUG - Processing node 69ba70f0537ae4d3c8237927: baseline-arm64-clabbe 2026-03-20 09:31:45,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba70f0537ae4d3c8237927 2026-03-20 09:31:45,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:45,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba70f0537ae4d3c8237927 HTTP/1.1" 200 None 2026-03-20 09:31:45,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:45,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:31:45,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:45,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba70f0537ae4d3c8237927 HTTP/1.1" 200 None 2026-03-20 09:31:45,909 - lava_callback - ERROR - Error processing callback for node 69ba70f0537ae4d3c8237927: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37342 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:31:48,431 - lava_callback - INFO - Received callback for node 69bd13c305e4bbd6ba635b8f INFO: 172.21.0.1:37344 - "POST /node/69bd13c305e4bbd6ba635b8f HTTP/1.0" 202 Accepted 2026-03-20 09:31:48,438 - lava_callback - INFO - Starting async job submit for node 69bd13c305e4bbd6ba635b8f 2026-03-20 09:31:48,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:48,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd13c305e4bbd6ba635b8f HTTP/1.1" 200 None 2026-03-20 09:31:48,484 - lava_callback - DEBUG - Processing node 69bd13c305e4bbd6ba635b8f: baseline-arm64 2026-03-20 09:31:48,619 - lava_callback - WARNING - Failed to upload log 2026-03-20 09:31:48,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:31:48,913 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:31:48,915 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd13c305e4bbd6ba635b8f/lava-logs.yaml 2026-03-20 09:31:48,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:31:49,077 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:31:49,078 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd13c305e4bbd6ba635b8f/lava_callback.json.gz 2026-03-20 09:31:49,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:49,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd13c305e4bbd6ba635b8f HTTP/1.1" 200 None 2026-03-20 09:31:49,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:49,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:31:49,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:31:49,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd13c305e4bbd6ba635b8f HTTP/1.1" 200 None 2026-03-20 09:31:49,249 - lava_callback - INFO - Completed processing callback for node 69bd13c305e4bbd6ba635b8f INFO: 172.21.0.1:44298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:32:03,491 - lava_callback - INFO - Received callback for node 69bd0fd505e4bbd6ba635a5a INFO: 172.21.0.1:44260 - "POST /node/69bd0fd505e4bbd6ba635a5a HTTP/1.0" 202 Accepted 2026-03-20 09:32:03,498 - lava_callback - INFO - Starting async job submit for node 69bd0fd505e4bbd6ba635a5a 2026-03-20 09:32:03,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:32:03,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0fd505e4bbd6ba635a5a HTTP/1.1" 200 None 2026-03-20 09:32:03,584 - lava_callback - DEBUG - Processing node 69bd0fd505e4bbd6ba635a5a: baseline-arm 2026-03-20 09:32:04,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:32:04,305 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:32:04,307 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd0fd505e4bbd6ba635a5a/log.txt.gz 2026-03-20 09:32:04,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:32:04,928 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:32:04,930 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd0fd505e4bbd6ba635a5a/lava-logs.yaml 2026-03-20 09:32:04,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:32:05,114 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:32:05,116 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd0fd505e4bbd6ba635a5a/lava_callback.json.gz DEBUG: Setup failed for 69bd0fd505e4bbd6ba635a5a. Transitting job node result: incomplete -> fail 2026-03-20 09:32:05,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:32:05,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd0fd505e4bbd6ba635a5a HTTP/1.1" 200 None 2026-03-20 09:32:05,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:32:05,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 09:32:05,266 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:32:05,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd0fd505e4bbd6ba635a5a HTTP/1.1" 200 None 2026-03-20 09:32:05,417 - lava_callback - INFO - Completed processing callback for node 69bd0fd505e4bbd6ba635a5a INFO: 172.21.0.1:44276 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:32:09,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:32:09,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47210 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40408 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:32:51,697 - lava_callback - INFO - Received callback for node 69bd140e05e4bbd6ba635b9f INFO: 172.21.0.1:40414 - "POST /node/69bd140e05e4bbd6ba635b9f HTTP/1.0" 202 Accepted 2026-03-20 09:32:51,703 - lava_callback - INFO - Starting async job submit for node 69bd140e05e4bbd6ba635b9f 2026-03-20 09:32:51,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:32:51,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd140e05e4bbd6ba635b9f HTTP/1.1" 200 None 2026-03-20 09:32:51,748 - lava_callback - DEBUG - Processing node 69bd140e05e4bbd6ba635b9f: baseline-arm64 2026-03-20 09:32:51,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:32:52,052 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:32:52,054 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd140e05e4bbd6ba635b9f/log.txt.gz 2026-03-20 09:32:52,129 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:32:52,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:32:52,337 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd140e05e4bbd6ba635b9f/lava-logs.yaml 2026-03-20 09:32:52,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:32:52,475 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:32:52,477 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd140e05e4bbd6ba635b9f/lava_callback.json.gz 2026-03-20 09:32:52,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:32:52,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd140e05e4bbd6ba635b9f HTTP/1.1" 200 None 2026-03-20 09:32:52,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:32:52,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:32:52,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:32:52,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd140e05e4bbd6ba635b9f HTTP/1.1" 200 None 2026-03-20 09:32:52,638 - lava_callback - INFO - Completed processing callback for node 69bd140e05e4bbd6ba635b9f INFO: 172.21.0.1:40416 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:33:05,860 - lava_callback - INFO - Received callback for node 69ba7145537ae4d3c8237935 INFO: 172.21.0.1:36488 - "POST /node/69ba7145537ae4d3c8237935 HTTP/1.0" 202 Accepted 2026-03-20 09:33:05,866 - lava_callback - INFO - Starting async job submit for node 69ba7145537ae4d3c8237935 2026-03-20 09:33:05,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:33:05,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7145537ae4d3c8237935 HTTP/1.1" 200 None 2026-03-20 09:33:05,883 - lava_callback - DEBUG - Processing node 69ba7145537ae4d3c8237935: baseline-arm64-clabbe 2026-03-20 09:33:05,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7145537ae4d3c8237935 2026-03-20 09:33:05,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:33:05,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7145537ae4d3c8237935 HTTP/1.1" 200 None 2026-03-20 09:33:05,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:33:05,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:33:05,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:33:05,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7145537ae4d3c8237935 HTTP/1.1" 200 None 2026-03-20 09:33:05,961 - lava_callback - ERROR - Error processing callback for node 69ba7145537ae4d3c8237935: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36498 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:33:09,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:33:09,300 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58210 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:34:25,923 - lava_callback - INFO - Received callback for node 69ba719a537ae4d3c8237942 INFO: 172.21.0.1:43682 - "POST /node/69ba719a537ae4d3c8237942 HTTP/1.0" 202 Accepted 2026-03-20 09:34:25,930 - lava_callback - INFO - Starting async job submit for node 69ba719a537ae4d3c8237942 2026-03-20 09:34:25,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:34:25,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba719a537ae4d3c8237942 HTTP/1.1" 200 None 2026-03-20 09:34:25,945 - lava_callback - DEBUG - Processing node 69ba719a537ae4d3c8237942: baseline-arm64-clabbe 2026-03-20 09:34:25,945 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba719a537ae4d3c8237942 2026-03-20 09:34:25,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:34:25,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba719a537ae4d3c8237942 HTTP/1.1" 200 None 2026-03-20 09:34:25,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:34:25,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:34:25,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:34:26,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba719a537ae4d3c8237942 HTTP/1.1" 200 None 2026-03-20 09:34:26,010 - lava_callback - ERROR - Error processing callback for node 69ba719a537ae4d3c8237942: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36314 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:35:45,908 - lava_callback - INFO - Received callback for node 69ba71ec537ae4d3c823794f INFO: 172.21.0.1:50006 - "POST /node/69ba71ec537ae4d3c823794f HTTP/1.0" 202 Accepted 2026-03-20 09:35:45,914 - lava_callback - INFO - Starting async job submit for node 69ba71ec537ae4d3c823794f 2026-03-20 09:35:45,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:35:45,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba71ec537ae4d3c823794f HTTP/1.1" 200 None 2026-03-20 09:35:45,930 - lava_callback - DEBUG - Processing node 69ba71ec537ae4d3c823794f: baseline-arm64-clabbe 2026-03-20 09:35:45,930 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba71ec537ae4d3c823794f 2026-03-20 09:35:45,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:35:45,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba71ec537ae4d3c823794f HTTP/1.1" 200 None 2026-03-20 09:35:45,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:35:45,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:35:45,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:35:45,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba71ec537ae4d3c823794f HTTP/1.1" 200 None 2026-03-20 09:35:46,001 - lava_callback - ERROR - Error processing callback for node 69ba71ec537ae4d3c823794f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38874 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:37:26,008 - lava_callback - INFO - Received callback for node 69ba7241537ae4d3c8237956 INFO: 172.21.0.1:43052 - "POST /node/69ba7241537ae4d3c8237956 HTTP/1.0" 202 Accepted 2026-03-20 09:37:26,014 - lava_callback - INFO - Starting async job submit for node 69ba7241537ae4d3c8237956 2026-03-20 09:37:26,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:37:26,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7241537ae4d3c8237956 HTTP/1.1" 200 None 2026-03-20 09:37:26,030 - lava_callback - DEBUG - Processing node 69ba7241537ae4d3c8237956: baseline-arm64-clabbe 2026-03-20 09:37:26,030 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7241537ae4d3c8237956 2026-03-20 09:37:26,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:37:26,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7241537ae4d3c8237956 HTTP/1.1" 200 None 2026-03-20 09:37:26,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:37:26,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:37:26,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:37:26,085 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7241537ae4d3c8237956 HTTP/1.1" 200 None 2026-03-20 09:37:26,087 - lava_callback - ERROR - Error processing callback for node 69ba7241537ae4d3c8237956: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43058 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:37:28,649 - lava_callback - INFO - Received callback for node 69bd10cb05e4bbd6ba635ac7 INFO: 172.21.0.1:43074 - "POST /node/69bd10cb05e4bbd6ba635ac7 HTTP/1.0" 202 Accepted 2026-03-20 09:37:28,697 - lava_callback - INFO - Starting async job submit for node 69bd10cb05e4bbd6ba635ac7 2026-03-20 09:37:28,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:37:28,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd10cb05e4bbd6ba635ac7 HTTP/1.1" 200 None 2026-03-20 09:37:28,745 - lava_callback - DEBUG - Processing node 69bd10cb05e4bbd6ba635ac7: baseline-arm-pengutronix 2026-03-20 09:37:28,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:37:29,004 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:37:29,006 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd10cb05e4bbd6ba635ac7/log.txt.gz 2026-03-20 09:37:29,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:37:29,265 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:37:29,267 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd10cb05e4bbd6ba635ac7/lava-logs.yaml 2026-03-20 09:37:29,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:37:29,415 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:37:29,417 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd10cb05e4bbd6ba635ac7/lava_callback.json.gz DEBUG: Setup failed for 69bd10cb05e4bbd6ba635ac7. Transitting job node result: incomplete -> fail 2026-03-20 09:37:29,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:37:29,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd10cb05e4bbd6ba635ac7 HTTP/1.1" 200 None 2026-03-20 09:37:29,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:37:29,497 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 09:37:29,499 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:37:29,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd10cb05e4bbd6ba635ac7 HTTP/1.1" 200 None 2026-03-20 09:37:29,598 - lava_callback - INFO - Completed processing callback for node 69bd10cb05e4bbd6ba635ac7 INFO: 172.21.0.1:58158 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:37:39,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:37:39,319 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:60064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47524 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:38:46,117 - lava_callback - INFO - Received callback for node 69ba7295537ae4d3c8237967 INFO: 172.21.0.1:52966 - "POST /node/69ba7295537ae4d3c8237967 HTTP/1.0" 202 Accepted 2026-03-20 09:38:46,123 - lava_callback - INFO - Starting async job submit for node 69ba7295537ae4d3c8237967 2026-03-20 09:38:46,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:38:46,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7295537ae4d3c8237967 HTTP/1.1" 200 None 2026-03-20 09:38:46,140 - lava_callback - DEBUG - Processing node 69ba7295537ae4d3c8237967: baseline-arm64-clabbe 2026-03-20 09:38:46,140 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7295537ae4d3c8237967 2026-03-20 09:38:46,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:38:46,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7295537ae4d3c8237967 HTTP/1.1" 200 None 2026-03-20 09:38:46,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:38:46,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 09:38:46,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:38:46,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7295537ae4d3c8237967 HTTP/1.1" 200 None 2026-03-20 09:38:46,205 - lava_callback - ERROR - Error processing callback for node 69ba7295537ae4d3c8237967: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60604 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42750 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:39:47,200 - lava_callback - INFO - Received callback for node 69ba72e0537ae4d3c8237973 INFO: 172.21.0.1:42754 - "POST /node/69ba72e0537ae4d3c8237973 HTTP/1.0" 202 Accepted 2026-03-20 09:39:47,205 - lava_callback - INFO - Starting async job submit for node 69ba72e0537ae4d3c8237973 2026-03-20 09:39:47,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:39:47,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba72e0537ae4d3c8237973 HTTP/1.1" 200 None 2026-03-20 09:39:47,237 - lava_callback - DEBUG - Processing node 69ba72e0537ae4d3c8237973: baseline-arm64-baylibre 2026-03-20 09:39:47,238 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba72e0537ae4d3c8237973 2026-03-20 09:39:47,238 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:39:47,251 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba72e0537ae4d3c8237973 HTTP/1.1" 200 None 2026-03-20 09:39:47,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:39:47,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-20 09:39:47,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:39:47,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba72e0537ae4d3c8237973 HTTP/1.1" 200 None 2026-03-20 09:39:47,299 - lava_callback - ERROR - Error processing callback for node 69ba72e0537ae4d3c8237973: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:41:27,268 - lava_callback - INFO - Received callback for node 69ba7335537ae4d3c823797c INFO: 172.21.0.1:39652 - "POST /node/69ba7335537ae4d3c823797c HTTP/1.0" 202 Accepted 2026-03-20 09:41:27,273 - lava_callback - INFO - Starting async job submit for node 69ba7335537ae4d3c823797c 2026-03-20 09:41:27,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:41:27,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7335537ae4d3c823797c HTTP/1.1" 200 None 2026-03-20 09:41:27,290 - lava_callback - DEBUG - Processing node 69ba7335537ae4d3c823797c: baseline-arm64-baylibre 2026-03-20 09:41:27,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7335537ae4d3c823797c 2026-03-20 09:41:27,290 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:41:27,312 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7335537ae4d3c823797c HTTP/1.1" 200 None 2026-03-20 09:41:27,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:41:27,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-20 09:41:27,335 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:41:27,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7335537ae4d3c823797c HTTP/1.1" 200 None 2026-03-20 09:41:27,361 - lava_callback - ERROR - Error processing callback for node 69ba7335537ae4d3c823797c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32820 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:42:06,413 - lava_callback - INFO - Received callback for node 69bd11c305e4bbd6ba635b1e INFO: 172.21.0.1:54882 - "POST /node/69bd11c305e4bbd6ba635b1e HTTP/1.0" 202 Accepted 2026-03-20 09:42:06,422 - lava_callback - INFO - Starting async job submit for node 69bd11c305e4bbd6ba635b1e INFO: 172.21.0.1:54890 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:42:06,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:42:06,490 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd11c305e4bbd6ba635b1e HTTP/1.1" 200 None 2026-03-20 09:42:06,491 - lava_callback - DEBUG - Processing node 69bd11c305e4bbd6ba635b1e: baseline-nfs-arm64 2026-03-20 09:42:07,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:42:07,845 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:42:07,847 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd11c305e4bbd6ba635b1e/log.txt.gz 2026-03-20 09:42:08,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:42:08,758 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:42:08,761 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd11c305e4bbd6ba635b1e/lava-logs.yaml 2026-03-20 09:42:08,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:42:08,967 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:42:08,968 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd11c305e4bbd6ba635b1e/lava_callback.json.gz DEBUG: Setup failed for 69bd11c305e4bbd6ba635b1e. Transitting job node result: incomplete -> fail 2026-03-20 09:42:09,060 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:42:09,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd11c305e4bbd6ba635b1e HTTP/1.1" 200 None 2026-03-20 09:42:09,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:42:09,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:42:09,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:42:09,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd11c305e4bbd6ba635b1e HTTP/1.1" 200 None 2026-03-20 09:42:09,245 - lava_callback - INFO - Completed processing callback for node 69bd11c305e4bbd6ba635b1e 2026-03-20 09:42:09,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:42:09,358 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:58018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36982 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:42:47,389 - lava_callback - INFO - Received callback for node 69ba7389537ae4d3c82379a3 INFO: 172.21.0.1:36986 - "POST /node/69ba7389537ae4d3c82379a3 HTTP/1.0" 202 Accepted 2026-03-20 09:42:47,395 - lava_callback - INFO - Starting async job submit for node 69ba7389537ae4d3c82379a3 2026-03-20 09:42:47,395 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:42:47,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7389537ae4d3c82379a3 HTTP/1.1" 200 None 2026-03-20 09:42:47,413 - lava_callback - DEBUG - Processing node 69ba7389537ae4d3c82379a3: baseline-arm64-baylibre 2026-03-20 09:42:47,413 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7389537ae4d3c82379a3 2026-03-20 09:42:47,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:42:47,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7389537ae4d3c82379a3 HTTP/1.1" 200 None 2026-03-20 09:42:47,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:42:47,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-20 09:42:47,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:42:47,472 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7389537ae4d3c82379a3 HTTP/1.1" 200 None 2026-03-20 09:42:47,474 - lava_callback - ERROR - Error processing callback for node 69ba7389537ae4d3c82379a3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:43:07,289 - lava_callback - INFO - Received callback for node 69ba73a9537ae4d3c8237a0d INFO: 172.21.0.1:41980 - "POST /node/69ba73a9537ae4d3c8237a0d HTTP/1.0" 202 Accepted 2026-03-20 09:43:07,294 - lava_callback - INFO - Starting async job submit for node 69ba73a9537ae4d3c8237a0d 2026-03-20 09:43:07,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:07,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a9537ae4d3c8237a0d HTTP/1.1" 200 None 2026-03-20 09:43:07,314 - lava_callback - DEBUG - Processing node 69ba73a9537ae4d3c8237a0d: baseline-arm64-baylibre 2026-03-20 09:43:07,315 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73a9537ae4d3c8237a0d 2026-03-20 09:43:07,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:07,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73a9537ae4d3c8237a0d HTTP/1.1" 200 None 2026-03-20 09:43:07,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:07,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:07,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:07,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73a9537ae4d3c8237a0d HTTP/1.1" 200 None 2026-03-20 09:43:07,375 - lava_callback - ERROR - Error processing callback for node 69ba73a9537ae4d3c8237a0d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:43:27,325 - lava_callback - INFO - Received callback for node 69ba73aa537ae4d3c8237a2a INFO: 172.21.0.1:40684 - "POST /node/69ba73aa537ae4d3c8237a2a HTTP/1.0" 202 Accepted 2026-03-20 09:43:27,330 - lava_callback - INFO - Starting async job submit for node 69ba73aa537ae4d3c8237a2a 2026-03-20 09:43:27,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:27,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73aa537ae4d3c8237a2a HTTP/1.1" 200 None 2026-03-20 09:43:27,350 - lava_callback - DEBUG - Processing node 69ba73aa537ae4d3c8237a2a: baseline-arm64-baylibre 2026-03-20 09:43:27,350 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73aa537ae4d3c8237a2a 2026-03-20 09:43:27,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:27,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73aa537ae4d3c8237a2a HTTP/1.1" 200 None 2026-03-20 09:43:27,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:27,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:27,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:27,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73aa537ae4d3c8237a2a HTTP/1.1" 200 None 2026-03-20 09:43:27,405 - lava_callback - ERROR - Error processing callback for node 69ba73aa537ae4d3c8237a2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 09:43:28,013 - lava_callback - INFO - Received callback for node 69ba73ab537ae4d3c8237a2d INFO: 172.21.0.1:40698 - "POST /node/69ba73ab537ae4d3c8237a2d HTTP/1.0" 202 Accepted 2026-03-20 09:43:28,020 - lava_callback - INFO - Starting async job submit for node 69ba73ab537ae4d3c8237a2d 2026-03-20 09:43:28,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:28,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73ab537ae4d3c8237a2d HTTP/1.1" 200 None 2026-03-20 09:43:28,037 - lava_callback - DEBUG - Processing node 69ba73ab537ae4d3c8237a2d: baseline-arm64-baylibre 2026-03-20 09:43:28,037 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73ab537ae4d3c8237a2d 2026-03-20 09:43:28,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:28,052 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73ab537ae4d3c8237a2d HTTP/1.1" 200 None 2026-03-20 09:43:28,053 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:28,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:28,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:28,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73ab537ae4d3c8237a2d HTTP/1.1" 200 None 2026-03-20 09:43:28,096 - lava_callback - ERROR - Error processing callback for node 69ba73ab537ae4d3c8237a2d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 09:43:28,702 - lava_callback - INFO - Received callback for node 69ba73b1537ae4d3c8237a3b INFO: 172.21.0.1:40714 - "POST /node/69ba73b1537ae4d3c8237a3b HTTP/1.0" 202 Accepted 2026-03-20 09:43:28,707 - lava_callback - INFO - Starting async job submit for node 69ba73b1537ae4d3c8237a3b 2026-03-20 09:43:28,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:28,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73b1537ae4d3c8237a3b HTTP/1.1" 200 None 2026-03-20 09:43:28,723 - lava_callback - DEBUG - Processing node 69ba73b1537ae4d3c8237a3b: baseline-arm64-baylibre 2026-03-20 09:43:28,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73b1537ae4d3c8237a3b 2026-03-20 09:43:28,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:28,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73b1537ae4d3c8237a3b HTTP/1.1" 200 None 2026-03-20 09:43:28,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:28,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:28,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:28,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73b1537ae4d3c8237a3b HTTP/1.1" 200 None 2026-03-20 09:43:28,783 - lava_callback - ERROR - Error processing callback for node 69ba73b1537ae4d3c8237a3b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 09:43:29,362 - lava_callback - INFO - Received callback for node 69ba73ae537ae4d3c8237a35 INFO: 172.21.0.1:40720 - "POST /node/69ba73ae537ae4d3c8237a35 HTTP/1.0" 202 Accepted 2026-03-20 09:43:29,367 - lava_callback - INFO - Starting async job submit for node 69ba73ae537ae4d3c8237a35 2026-03-20 09:43:29,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:29,384 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73ae537ae4d3c8237a35 HTTP/1.1" 200 None 2026-03-20 09:43:29,384 - lava_callback - DEBUG - Processing node 69ba73ae537ae4d3c8237a35: baseline-arm64-baylibre 2026-03-20 09:43:29,385 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73ae537ae4d3c8237a35 2026-03-20 09:43:29,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:29,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73ae537ae4d3c8237a35 HTTP/1.1" 200 None 2026-03-20 09:43:29,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:29,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:29,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:29,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73ae537ae4d3c8237a35 HTTP/1.1" 200 None 2026-03-20 09:43:29,446 - lava_callback - ERROR - Error processing callback for node 69ba73ae537ae4d3c8237a35: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 09:43:30,030 - lava_callback - INFO - Received callback for node 69ba73af537ae4d3c8237a38 INFO: 172.21.0.1:36064 - "POST /node/69ba73af537ae4d3c8237a38 HTTP/1.0" 202 Accepted 2026-03-20 09:43:30,036 - lava_callback - INFO - Starting async job submit for node 69ba73af537ae4d3c8237a38 2026-03-20 09:43:30,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:30,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73af537ae4d3c8237a38 HTTP/1.1" 200 None 2026-03-20 09:43:30,058 - lava_callback - DEBUG - Processing node 69ba73af537ae4d3c8237a38: baseline-arm64-baylibre 2026-03-20 09:43:30,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73af537ae4d3c8237a38 2026-03-20 09:43:30,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:30,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73af537ae4d3c8237a38 HTTP/1.1" 200 None 2026-03-20 09:43:30,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:30,090 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:30,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:30,112 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73af537ae4d3c8237a38 HTTP/1.1" 200 None 2026-03-20 09:43:30,113 - lava_callback - ERROR - Error processing callback for node 69ba73af537ae4d3c8237a38: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36074 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:43:46,222 - lava_callback - INFO - Received callback for node 69ba73c3537ae4d3c8237a62 INFO: 172.21.0.1:60744 - "POST /node/69ba73c3537ae4d3c8237a62 HTTP/1.0" 202 Accepted 2026-03-20 09:43:46,227 - lava_callback - INFO - Starting async job submit for node 69ba73c3537ae4d3c8237a62 2026-03-20 09:43:46,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:46,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c3537ae4d3c8237a62 HTTP/1.1" 200 None 2026-03-20 09:43:46,243 - lava_callback - DEBUG - Processing node 69ba73c3537ae4d3c8237a62: baseline-arm64-clabbe 2026-03-20 09:43:46,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73c3537ae4d3c8237a62 2026-03-20 09:43:46,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:46,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c3537ae4d3c8237a62 HTTP/1.1" 200 None 2026-03-20 09:43:46,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:46,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:46,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:46,311 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73c3537ae4d3c8237a62 HTTP/1.1" 200 None 2026-03-20 09:43:46,313 - lava_callback - ERROR - Error processing callback for node 69ba73c3537ae4d3c8237a62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60758 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:43:46,913 - lava_callback - INFO - Received callback for node 69ba73c4537ae4d3c8237a65 INFO: 172.21.0.1:60760 - "POST /node/69ba73c4537ae4d3c8237a65 HTTP/1.0" 202 Accepted 2026-03-20 09:43:46,919 - lava_callback - INFO - Starting async job submit for node 69ba73c4537ae4d3c8237a65 2026-03-20 09:43:46,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:46,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c4537ae4d3c8237a65 HTTP/1.1" 200 None 2026-03-20 09:43:46,935 - lava_callback - DEBUG - Processing node 69ba73c4537ae4d3c8237a65: baseline-arm64-clabbe 2026-03-20 09:43:46,935 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73c4537ae4d3c8237a65 2026-03-20 09:43:46,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:46,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c4537ae4d3c8237a65 HTTP/1.1" 200 None 2026-03-20 09:43:46,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:46,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:46,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:46,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73c4537ae4d3c8237a65 HTTP/1.1" 200 None 2026-03-20 09:43:46,992 - lava_callback - ERROR - Error processing callback for node 69ba73c4537ae4d3c8237a65: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 09:43:47,596 - lava_callback - INFO - Received callback for node 69ba73c5537ae4d3c8237a68 INFO: 172.21.0.1:60762 - "POST /node/69ba73c5537ae4d3c8237a68 HTTP/1.0" 202 Accepted 2026-03-20 09:43:47,602 - lava_callback - INFO - Starting async job submit for node 69ba73c5537ae4d3c8237a68 2026-03-20 09:43:47,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:47,617 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c5537ae4d3c8237a68 HTTP/1.1" 200 None 2026-03-20 09:43:47,618 - lava_callback - DEBUG - Processing node 69ba73c5537ae4d3c8237a68: baseline-arm64-clabbe 2026-03-20 09:43:47,619 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73c5537ae4d3c8237a68 2026-03-20 09:43:47,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:47,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c5537ae4d3c8237a68 HTTP/1.1" 200 None 2026-03-20 09:43:47,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:47,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:47,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:47,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73c5537ae4d3c8237a68 HTTP/1.1" 200 None 2026-03-20 09:43:47,683 - lava_callback - ERROR - Error processing callback for node 69ba73c5537ae4d3c8237a68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 09:43:48,286 - lava_callback - INFO - Received callback for node 69ba73c6537ae4d3c8237a6b INFO: 172.21.0.1:60768 - "POST /node/69ba73c6537ae4d3c8237a6b HTTP/1.0" 202 Accepted 2026-03-20 09:43:48,292 - lava_callback - INFO - Starting async job submit for node 69ba73c6537ae4d3c8237a6b 2026-03-20 09:43:48,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:48,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c6537ae4d3c8237a6b HTTP/1.1" 200 None 2026-03-20 09:43:48,308 - lava_callback - DEBUG - Processing node 69ba73c6537ae4d3c8237a6b: baseline-arm64-clabbe 2026-03-20 09:43:48,308 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73c6537ae4d3c8237a6b 2026-03-20 09:43:48,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:48,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c6537ae4d3c8237a6b HTTP/1.1" 200 None 2026-03-20 09:43:48,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:48,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:48,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:48,376 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73c6537ae4d3c8237a6b HTTP/1.1" 200 None 2026-03-20 09:43:48,378 - lava_callback - ERROR - Error processing callback for node 69ba73c6537ae4d3c8237a6b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 09:43:48,966 - lava_callback - INFO - Received callback for node 69ba73c8537ae4d3c8237a8b INFO: 172.21.0.1:60770 - "POST /node/69ba73c8537ae4d3c8237a8b HTTP/1.0" 202 Accepted 2026-03-20 09:43:48,971 - lava_callback - INFO - Starting async job submit for node 69ba73c8537ae4d3c8237a8b 2026-03-20 09:43:48,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:48,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c8537ae4d3c8237a8b HTTP/1.1" 200 None 2026-03-20 09:43:48,986 - lava_callback - DEBUG - Processing node 69ba73c8537ae4d3c8237a8b: baseline-arm64-clabbe 2026-03-20 09:43:48,987 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73c8537ae4d3c8237a8b 2026-03-20 09:43:48,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:49,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c8537ae4d3c8237a8b HTTP/1.1" 200 None 2026-03-20 09:43:49,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:49,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:49,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:49,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73c8537ae4d3c8237a8b HTTP/1.1" 200 None 2026-03-20 09:43:49,043 - lava_callback - ERROR - Error processing callback for node 69ba73c8537ae4d3c8237a8b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 09:43:49,659 - lava_callback - INFO - Received callback for node 69ba73c9537ae4d3c8237a8e INFO: 172.21.0.1:60782 - "POST /node/69ba73c9537ae4d3c8237a8e HTTP/1.0" 202 Accepted 2026-03-20 09:43:49,665 - lava_callback - INFO - Starting async job submit for node 69ba73c9537ae4d3c8237a8e 2026-03-20 09:43:49,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:49,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c9537ae4d3c8237a8e HTTP/1.1" 200 None 2026-03-20 09:43:49,681 - lava_callback - DEBUG - Processing node 69ba73c9537ae4d3c8237a8e: baseline-arm64-clabbe 2026-03-20 09:43:49,681 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73c9537ae4d3c8237a8e 2026-03-20 09:43:49,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:49,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73c9537ae4d3c8237a8e HTTP/1.1" 200 None 2026-03-20 09:43:49,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:49,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 09:43:49,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:43:49,733 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73c9537ae4d3c8237a8e HTTP/1.1" 200 None 2026-03-20 09:43:49,734 - lava_callback - ERROR - Error processing callback for node 69ba73c9537ae4d3c8237a8e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37828 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:44:07,584 - lava_callback - INFO - Received callback for node 69ba73dc537ae4d3c8237ab2 INFO: 172.21.0.1:37830 - "POST /node/69ba73dc537ae4d3c8237ab2 HTTP/1.0" 202 Accepted 2026-03-20 09:44:07,589 - lava_callback - INFO - Starting async job submit for node 69ba73dc537ae4d3c8237ab2 2026-03-20 09:44:07,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:44:07,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73dc537ae4d3c8237ab2 HTTP/1.1" 200 None 2026-03-20 09:44:07,609 - lava_callback - DEBUG - Processing node 69ba73dc537ae4d3c8237ab2: baseline-arm64-baylibre 2026-03-20 09:44:07,609 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba73dc537ae4d3c8237ab2 2026-03-20 09:44:07,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:44:07,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba73dc537ae4d3c8237ab2 HTTP/1.1" 200 None 2026-03-20 09:44:07,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:44:07,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-20 09:44:07,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:44:07,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba73dc537ae4d3c8237ab2 HTTP/1.1" 200 None 2026-03-20 09:44:07,672 - lava_callback - ERROR - Error processing callback for node 69ba73dc537ae4d3c8237ab2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55734 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60848 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:45:27,453 - lava_callback - INFO - Received callback for node 69ba742d537ae4d3c8237b46 INFO: 172.21.0.1:38376 - "POST /node/69ba742d537ae4d3c8237b46 HTTP/1.0" 202 Accepted 2026-03-20 09:45:27,459 - lava_callback - INFO - Starting async job submit for node 69ba742d537ae4d3c8237b46 2026-03-20 09:45:27,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:45:27,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba742d537ae4d3c8237b46 HTTP/1.1" 200 None 2026-03-20 09:45:27,475 - lava_callback - DEBUG - Processing node 69ba742d537ae4d3c8237b46: baseline-arm64-baylibre 2026-03-20 09:45:27,475 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba742d537ae4d3c8237b46 2026-03-20 09:45:27,476 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:45:27,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba742d537ae4d3c8237b46 HTTP/1.1" 200 None 2026-03-20 09:45:27,490 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:45:27,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-20 09:45:27,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:45:27,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba742d537ae4d3c8237b46 HTTP/1.1" 200 None 2026-03-20 09:45:27,546 - lava_callback - ERROR - Error processing callback for node 69ba742d537ae4d3c8237b46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60438 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:46:54,024 - lava_callback - INFO - Received callback for node 69bd15d705e4bbd6ba635bfd INFO: 172.21.0.1:60452 - "POST /node/69bd15d705e4bbd6ba635bfd HTTP/1.0" 202 Accepted 2026-03-20 09:46:54,032 - lava_callback - INFO - Starting async job submit for node 69bd15d705e4bbd6ba635bfd 2026-03-20 09:46:54,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:46:54,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd15d705e4bbd6ba635bfd HTTP/1.1" 200 None 2026-03-20 09:46:54,083 - lava_callback - DEBUG - Processing node 69bd15d705e4bbd6ba635bfd: baseline-arm64 2026-03-20 09:46:54,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:46:54,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:46:54,628 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd15d705e4bbd6ba635bfd/log.txt.gz 2026-03-20 09:46:54,840 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:46:55,089 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:46:55,092 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd15d705e4bbd6ba635bfd/lava-logs.yaml 2026-03-20 09:46:55,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:46:55,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:46:55,286 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd15d705e4bbd6ba635bfd/lava_callback.json.gz DEBUG: Setup failed for 69bd15d705e4bbd6ba635bfd. Transitting job node result: incomplete -> fail 2026-03-20 09:46:55,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:46:55,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd15d705e4bbd6ba635bfd HTTP/1.1" 200 None 2026-03-20 09:46:55,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:46:55,389 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:46:55,391 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:46:55,417 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd15d705e4bbd6ba635bfd HTTP/1.1" 200 None 2026-03-20 09:46:55,487 - lava_callback - INFO - Completed processing callback for node 69bd15d705e4bbd6ba635bfd INFO: 172.21.0.1:60462 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:47:06,347 - lava_callback - INFO - Received callback for node 69ba7486537ae4d3c8237b89 INFO: 172.21.0.1:47408 - "POST /node/69ba7486537ae4d3c8237b89 HTTP/1.0" 202 Accepted 2026-03-20 09:47:06,352 - lava_callback - INFO - Starting async job submit for node 69ba7486537ae4d3c8237b89 2026-03-20 09:47:06,353 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:47:06,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7486537ae4d3c8237b89 HTTP/1.1" 200 None 2026-03-20 09:47:06,368 - lava_callback - DEBUG - Processing node 69ba7486537ae4d3c8237b89: baseline-arm64-clabbe 2026-03-20 09:47:06,368 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7486537ae4d3c8237b89 2026-03-20 09:47:06,369 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:47:06,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7486537ae4d3c8237b89 HTTP/1.1" 200 None 2026-03-20 09:47:06,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:47:06,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-20 09:47:06,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:47:06,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7486537ae4d3c8237b89 HTTP/1.1" 200 None 2026-03-20 09:47:06,420 - lava_callback - ERROR - Error processing callback for node 69ba7486537ae4d3c8237b89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47422 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:47:09,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:47:09,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:47446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52508 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:48:18,367 - lava_callback - INFO - Received callback for node 69bd158b05e4bbd6ba635bec INFO: 172.21.0.1:52516 - "POST /node/69bd158b05e4bbd6ba635bec HTTP/1.0" 202 Accepted 2026-03-20 09:48:18,374 - lava_callback - INFO - Starting async job submit for node 69bd158b05e4bbd6ba635bec 2026-03-20 09:48:18,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:48:18,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd158b05e4bbd6ba635bec HTTP/1.1" 200 None 2026-03-20 09:48:18,413 - lava_callback - DEBUG - Processing node 69bd158b05e4bbd6ba635bec: baseline-arm64 2026-03-20 09:48:18,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:48:19,110 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:48:19,112 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd158b05e4bbd6ba635bec/log.txt.gz 2026-03-20 09:48:19,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:48:19,604 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:48:19,606 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd158b05e4bbd6ba635bec/lava-logs.yaml 2026-03-20 09:48:19,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:48:19,869 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:48:19,871 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd158b05e4bbd6ba635bec/lava_callback.json.gz 2026-03-20 09:48:19,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:48:19,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd158b05e4bbd6ba635bec HTTP/1.1" 200 None 2026-03-20 09:48:19,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:48:19,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bc21b717e5cb936602bc2b HTTP/1.1" 200 None 2026-03-20 09:48:19,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:48:19,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd158b05e4bbd6ba635bec HTTP/1.1" 200 None 2026-03-20 09:48:20,023 - lava_callback - INFO - Completed processing callback for node 69bd158b05e4bbd6ba635bec 2026-03-20 09:48:26,382 - lava_callback - INFO - Received callback for node 69ba74d9537ae4d3c8237ba4 INFO: 172.21.0.1:36812 - "POST /node/69ba74d9537ae4d3c8237ba4 HTTP/1.0" 202 Accepted 2026-03-20 09:48:26,399 - lava_callback - INFO - Starting async job submit for node 69ba74d9537ae4d3c8237ba4 2026-03-20 09:48:26,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:48:26,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba74d9537ae4d3c8237ba4 HTTP/1.1" 200 None 2026-03-20 09:48:26,459 - lava_callback - DEBUG - Processing node 69ba74d9537ae4d3c8237ba4: baseline-arm64-clabbe 2026-03-20 09:48:26,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba74d9537ae4d3c8237ba4 2026-03-20 09:48:26,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:48:26,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba74d9537ae4d3c8237ba4 HTTP/1.1" 200 None 2026-03-20 09:48:26,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36820 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:48:26,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-20 09:48:26,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:48:26,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba74d9537ae4d3c8237ba4 HTTP/1.1" 200 None 2026-03-20 09:48:26,528 - lava_callback - ERROR - Error processing callback for node 69ba74d9537ae4d3c8237ba4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36460 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:48:39,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:48:39,407 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43494 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:49:46,446 - lava_callback - INFO - Received callback for node 69ba752c537ae4d3c8237baa INFO: 172.21.0.1:55956 - "POST /node/69ba752c537ae4d3c8237baa HTTP/1.0" 202 Accepted 2026-03-20 09:49:46,452 - lava_callback - INFO - Starting async job submit for node 69ba752c537ae4d3c8237baa 2026-03-20 09:49:46,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:49:46,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba752c537ae4d3c8237baa HTTP/1.1" 200 None 2026-03-20 09:49:46,468 - lava_callback - DEBUG - Processing node 69ba752c537ae4d3c8237baa: baseline-arm64-clabbe 2026-03-20 09:49:46,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba752c537ae4d3c8237baa 2026-03-20 09:49:46,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:49:46,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba752c537ae4d3c8237baa HTTP/1.1" 200 None 2026-03-20 09:49:46,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:55970 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:49:46,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-20 09:49:46,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:49:46,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba752c537ae4d3c8237baa HTTP/1.1" 200 None 2026-03-20 09:49:46,527 - lava_callback - ERROR - Error processing callback for node 69ba752c537ae4d3c8237baa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33836 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:51:06,502 - lava_callback - INFO - Received callback for node 69ba7581537ae4d3c8237bb3 INFO: 172.21.0.1:33840 - "POST /node/69ba7581537ae4d3c8237bb3 HTTP/1.0" 202 Accepted 2026-03-20 09:51:06,508 - lava_callback - INFO - Starting async job submit for node 69ba7581537ae4d3c8237bb3 2026-03-20 09:51:06,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:51:06,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7581537ae4d3c8237bb3 HTTP/1.1" 200 None 2026-03-20 09:51:06,533 - lava_callback - DEBUG - Processing node 69ba7581537ae4d3c8237bb3: baseline-arm64-clabbe 2026-03-20 09:51:06,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7581537ae4d3c8237bb3 2026-03-20 09:51:06,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:51:06,553 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7581537ae4d3c8237bb3 HTTP/1.1" 200 None 2026-03-20 09:51:06,555 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:51:06,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-20 09:51:06,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:51:06,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7581537ae4d3c8237bb3 HTTP/1.1" 200 None 2026-03-20 09:51:06,606 - lava_callback - ERROR - Error processing callback for node 69ba7581537ae4d3c8237bb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35704 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:52:26,579 - lava_callback - INFO - Received callback for node 69ba75d3537ae4d3c8237bc8 INFO: 172.21.0.1:35708 - "POST /node/69ba75d3537ae4d3c8237bc8 HTTP/1.0" 202 Accepted 2026-03-20 09:52:26,584 - lava_callback - INFO - Starting async job submit for node 69ba75d3537ae4d3c8237bc8 2026-03-20 09:52:26,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:52:26,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba75d3537ae4d3c8237bc8 HTTP/1.1" 200 None 2026-03-20 09:52:26,601 - lava_callback - DEBUG - Processing node 69ba75d3537ae4d3c8237bc8: baseline-arm64-clabbe 2026-03-20 09:52:26,601 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba75d3537ae4d3c8237bc8 2026-03-20 09:52:26,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:52:26,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba75d3537ae4d3c8237bc8 HTTP/1.1" 200 None 2026-03-20 09:52:26,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:52:26,630 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-20 09:52:26,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:52:26,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba75d3537ae4d3c8237bc8 HTTP/1.1" 200 None 2026-03-20 09:52:26,676 - lava_callback - ERROR - Error processing callback for node 69ba75d3537ae4d3c8237bc8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57726 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:53:46,683 - lava_callback - INFO - Received callback for node 69ba7626537ae4d3c8237be5 INFO: 172.21.0.1:57732 - "POST /node/69ba7626537ae4d3c8237be5 HTTP/1.0" 202 Accepted 2026-03-20 09:53:46,689 - lava_callback - INFO - Starting async job submit for node 69ba7626537ae4d3c8237be5 2026-03-20 09:53:46,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:53:46,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7626537ae4d3c8237be5 HTTP/1.1" 200 None 2026-03-20 09:53:46,710 - lava_callback - DEBUG - Processing node 69ba7626537ae4d3c8237be5: baseline-arm64-clabbe 2026-03-20 09:53:46,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7626537ae4d3c8237be5 2026-03-20 09:53:46,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:53:46,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7626537ae4d3c8237be5 HTTP/1.1" 200 None 2026-03-20 09:53:46,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:53:46,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b276764bce73bcf0233d23 HTTP/1.1" 200 None 2026-03-20 09:53:46,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:53:46,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7626537ae4d3c8237be5 HTTP/1.1" 200 None 2026-03-20 09:53:46,765 - lava_callback - ERROR - Error processing callback for node 69ba7626537ae4d3c8237be5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36272 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:54:29,969 - lava_callback - INFO - Received callback for node 69bd153805e4bbd6ba635bd3 INFO: 172.21.0.1:34938 - "POST /node/69bd153805e4bbd6ba635bd3 HTTP/1.0" 202 Accepted 2026-03-20 09:54:29,975 - lava_callback - INFO - Starting async job submit for node 69bd153805e4bbd6ba635bd3 2026-03-20 09:54:30,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:54:30,075 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd153805e4bbd6ba635bd3 HTTP/1.1" 200 None 2026-03-20 09:54:30,076 - lava_callback - DEBUG - Processing node 69bd153805e4bbd6ba635bd3: ltp-smoke 2026-03-20 09:54:30,571 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:54:30,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:54:30,755 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd153805e4bbd6ba635bd3/log.txt.gz 2026-03-20 09:54:31,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:54:31,275 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:54:31,277 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd153805e4bbd6ba635bd3/lava-logs.yaml 2026-03-20 09:54:31,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:54:31,503 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:54:31,505 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd153805e4bbd6ba635bd3/lava_callback.json.gz 2026-03-20 09:54:31,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:54:31,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd153805e4bbd6ba635bd3 HTTP/1.1" 200 None 2026-03-20 09:54:31,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:54:31,667 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027205e4bbd6ba634c5d HTTP/1.1" 200 None 2026-03-20 09:54:31,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:54:31,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd153805e4bbd6ba635bd3 HTTP/1.1" 200 None 2026-03-20 09:54:31,825 - lava_callback - INFO - Completed processing callback for node 69bd153805e4bbd6ba635bd3 INFO: 172.21.0.1:34948 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:54:39,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:54:39,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38458 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36118 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42006 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:57:35,240 - lava_callback - INFO - Received callback for node 69bd179605e4bbd6ba635c63 INFO: 172.21.0.1:59954 - "POST /node/69bd179605e4bbd6ba635c63 HTTP/1.0" 202 Accepted 2026-03-20 09:57:35,248 - lava_callback - INFO - Starting async job submit for node 69bd179605e4bbd6ba635c63 2026-03-20 09:57:35,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:57:35,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd179605e4bbd6ba635c63 HTTP/1.1" 200 None 2026-03-20 09:57:35,288 - lava_callback - DEBUG - Processing node 69bd179605e4bbd6ba635c63: baseline-arm64 2026-03-20 09:57:35,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:57:35,966 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:57:35,967 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd179605e4bbd6ba635c63/log.txt.gz 2026-03-20 09:57:36,226 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 09:57:36,457 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:57:36,459 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd179605e4bbd6ba635c63/lava-logs.yaml 2026-03-20 09:57:36,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:59958 - "GET / HTTP/1.0" 200 OK 2026-03-20 09:57:36,649 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 09:57:36,651 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd179605e4bbd6ba635c63/lava_callback.json.gz 2026-03-20 09:57:36,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:57:36,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd179605e4bbd6ba635c63 HTTP/1.1" 200 None 2026-03-20 09:57:36,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:57:36,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 09:57:36,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:57:36,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd179605e4bbd6ba635c63 HTTP/1.1" 200 None 2026-03-20 09:57:36,795 - lava_callback - INFO - Completed processing callback for node 69bd179605e4bbd6ba635c63 2026-03-20 09:57:39,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 09:57:39,444 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45406 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:05:08,852 - lava_callback - INFO - Received callback for node 69ba78c9537ae4d3c8237c6f INFO: 172.21.0.1:45412 - "POST /node/69ba78c9537ae4d3c8237c6f HTTP/1.0" 202 Accepted 2026-03-20 10:05:08,858 - lava_callback - INFO - Starting async job submit for node 69ba78c9537ae4d3c8237c6f 2026-03-20 10:05:08,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:05:08,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba78c9537ae4d3c8237c6f HTTP/1.1" 200 None 2026-03-20 10:05:08,873 - lava_callback - DEBUG - Processing node 69ba78c9537ae4d3c8237c6f: baseline-arm-baylibre 2026-03-20 10:05:08,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba78c9537ae4d3c8237c6f 2026-03-20 10:05:08,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:05:08,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba78c9537ae4d3c8237c6f HTTP/1.1" 200 None 2026-03-20 10:05:08,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:05:08,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 10:05:08,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:05:08,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba78c9537ae4d3c8237c6f HTTP/1.1" 200 None 2026-03-20 10:05:08,930 - lava_callback - ERROR - Error processing callback for node 69ba78c9537ae4d3c8237c6f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46962 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:05:48,528 - lava_callback - INFO - Received callback for node 69ba78ef537ae4d3c8237c7b INFO: 172.21.0.1:46978 - "POST /node/69ba78ef537ae4d3c8237c7b HTTP/1.0" 202 Accepted 2026-03-20 10:05:48,534 - lava_callback - INFO - Starting async job submit for node 69ba78ef537ae4d3c8237c7b 2026-03-20 10:05:48,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:05:48,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba78ef537ae4d3c8237c7b HTTP/1.1" 200 None 2026-03-20 10:05:48,550 - lava_callback - DEBUG - Processing node 69ba78ef537ae4d3c8237c7b: baseline-arm-baylibre 2026-03-20 10:05:48,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba78ef537ae4d3c8237c7b 2026-03-20 10:05:48,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:05:48,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba78ef537ae4d3c8237c7b HTTP/1.1" 200 None 2026-03-20 10:05:48,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:05:48,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 10:05:48,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:05:48,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba78ef537ae4d3c8237c7b HTTP/1.1" 200 None 2026-03-20 10:05:48,603 - lava_callback - ERROR - Error processing callback for node 69ba78ef537ae4d3c8237c7b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38454 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54840 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:06:28,636 - lava_callback - INFO - Received callback for node 69ba7915537ae4d3c8237c87 INFO: 172.21.0.1:54848 - "POST /node/69ba7915537ae4d3c8237c87 HTTP/1.0" 202 Accepted 2026-03-20 10:06:28,642 - lava_callback - INFO - Starting async job submit for node 69ba7915537ae4d3c8237c87 2026-03-20 10:06:28,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:06:28,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7915537ae4d3c8237c87 HTTP/1.1" 200 None 2026-03-20 10:06:28,657 - lava_callback - DEBUG - Processing node 69ba7915537ae4d3c8237c87: baseline-arm-baylibre 2026-03-20 10:06:28,658 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7915537ae4d3c8237c87 2026-03-20 10:06:28,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:06:28,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7915537ae4d3c8237c87 HTTP/1.1" 200 None 2026-03-20 10:06:28,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:06:28,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 10:06:28,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:06:28,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7915537ae4d3c8237c87 HTTP/1.1" 200 None 2026-03-20 10:06:28,746 - lava_callback - ERROR - Error processing callback for node 69ba7915537ae4d3c8237c87: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36558 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:07:08,608 - lava_callback - INFO - Received callback for node 69ba793b537ae4d3c8237c91 INFO: 172.21.0.1:36560 - "POST /node/69ba793b537ae4d3c8237c91 HTTP/1.0" 202 Accepted 2026-03-20 10:07:08,614 - lava_callback - INFO - Starting async job submit for node 69ba793b537ae4d3c8237c91 2026-03-20 10:07:08,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:07:08,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba793b537ae4d3c8237c91 HTTP/1.1" 200 None 2026-03-20 10:07:08,630 - lava_callback - DEBUG - Processing node 69ba793b537ae4d3c8237c91: baseline-arm-baylibre 2026-03-20 10:07:08,630 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba793b537ae4d3c8237c91 2026-03-20 10:07:08,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:07:08,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba793b537ae4d3c8237c91 HTTP/1.1" 200 None 2026-03-20 10:07:08,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:07:08,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 10:07:08,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:07:08,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba793b537ae4d3c8237c91 HTTP/1.1" 200 None 2026-03-20 10:07:08,694 - lava_callback - ERROR - Error processing callback for node 69ba793b537ae4d3c8237c91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49874 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35218 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:07:48,677 - lava_callback - INFO - Received callback for node 69ba7961537ae4d3c8237c9e INFO: 172.21.0.1:35220 - "POST /node/69ba7961537ae4d3c8237c9e HTTP/1.0" 202 Accepted 2026-03-20 10:07:48,682 - lava_callback - INFO - Starting async job submit for node 69ba7961537ae4d3c8237c9e 2026-03-20 10:07:48,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:07:48,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7961537ae4d3c8237c9e HTTP/1.1" 200 None 2026-03-20 10:07:48,713 - lava_callback - DEBUG - Processing node 69ba7961537ae4d3c8237c9e: baseline-arm-baylibre 2026-03-20 10:07:48,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7961537ae4d3c8237c9e 2026-03-20 10:07:48,713 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:07:48,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7961537ae4d3c8237c9e HTTP/1.1" 200 None 2026-03-20 10:07:48,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:07:48,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 10:07:48,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:07:48,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7961537ae4d3c8237c9e HTTP/1.1" 200 None 2026-03-20 10:07:48,788 - lava_callback - ERROR - Error processing callback for node 69ba7961537ae4d3c8237c9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41082 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:08:28,690 - lava_callback - INFO - Received callback for node 69ba7987537ae4d3c8237cac INFO: 172.21.0.1:41098 - "POST /node/69ba7987537ae4d3c8237cac HTTP/1.0" 202 Accepted 2026-03-20 10:08:28,695 - lava_callback - INFO - Starting async job submit for node 69ba7987537ae4d3c8237cac 2026-03-20 10:08:28,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:08:28,710 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7987537ae4d3c8237cac HTTP/1.1" 200 None 2026-03-20 10:08:28,711 - lava_callback - DEBUG - Processing node 69ba7987537ae4d3c8237cac: baseline-arm-baylibre 2026-03-20 10:08:28,711 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7987537ae4d3c8237cac 2026-03-20 10:08:28,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:08:28,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7987537ae4d3c8237cac HTTP/1.1" 200 None 2026-03-20 10:08:28,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:08:28,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 10:08:28,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:08:28,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7987537ae4d3c8237cac HTTP/1.1" 200 None 2026-03-20 10:08:28,778 - lava_callback - ERROR - Error processing callback for node 69ba7987537ae4d3c8237cac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34746 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:09:07,455 - lava_callback - INFO - Received callback for node 69ba79ae537ae4d3c8237cb3 INFO: 172.21.0.1:36214 - "POST /node/69ba79ae537ae4d3c8237cb3 HTTP/1.0" 202 Accepted 2026-03-20 10:09:07,460 - lava_callback - INFO - Starting async job submit for node 69ba79ae537ae4d3c8237cb3 2026-03-20 10:09:07,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:09:07,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba79ae537ae4d3c8237cb3 HTTP/1.1" 200 None 2026-03-20 10:09:07,476 - lava_callback - DEBUG - Processing node 69ba79ae537ae4d3c8237cb3: baseline-arm-clabbe 2026-03-20 10:09:07,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba79ae537ae4d3c8237cb3 2026-03-20 10:09:07,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:09:07,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba79ae537ae4d3c8237cb3 HTTP/1.1" 200 None 2026-03-20 10:09:07,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:09:07,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 10:09:07,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:09:07,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba79ae537ae4d3c8237cb3 HTTP/1.1" 200 None 2026-03-20 10:09:07,540 - lava_callback - ERROR - Error processing callback for node 69ba79ae537ae4d3c8237cb3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34858 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:09:27,394 - lava_callback - INFO - Received callback for node 69ba79d4537ae4d3c8237cbd INFO: 172.21.0.1:34864 - "POST /node/69ba79d4537ae4d3c8237cbd HTTP/1.0" 202 Accepted 2026-03-20 10:09:27,400 - lava_callback - INFO - Starting async job submit for node 69ba79d4537ae4d3c8237cbd 2026-03-20 10:09:27,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:09:27,416 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba79d4537ae4d3c8237cbd HTTP/1.1" 200 None 2026-03-20 10:09:27,417 - lava_callback - DEBUG - Processing node 69ba79d4537ae4d3c8237cbd: baseline-arm-clabbe 2026-03-20 10:09:27,417 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba79d4537ae4d3c8237cbd 2026-03-20 10:09:27,418 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:09:27,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba79d4537ae4d3c8237cbd HTTP/1.1" 200 None 2026-03-20 10:09:27,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:09:27,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 10:09:27,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:09:27,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba79d4537ae4d3c8237cbd HTTP/1.1" 200 None 2026-03-20 10:09:27,501 - lava_callback - ERROR - Error processing callback for node 69ba79d4537ae4d3c8237cbd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53008 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:10:07,463 - lava_callback - INFO - Received callback for node 69ba79f9537ae4d3c8237cc6 INFO: 172.21.0.1:53020 - "POST /node/69ba79f9537ae4d3c8237cc6 HTTP/1.0" 202 Accepted 2026-03-20 10:10:07,468 - lava_callback - INFO - Starting async job submit for node 69ba79f9537ae4d3c8237cc6 2026-03-20 10:10:07,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:10:07,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba79f9537ae4d3c8237cc6 HTTP/1.1" 200 None 2026-03-20 10:10:07,484 - lava_callback - DEBUG - Processing node 69ba79f9537ae4d3c8237cc6: baseline-arm-clabbe 2026-03-20 10:10:07,485 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba79f9537ae4d3c8237cc6 2026-03-20 10:10:07,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:10:07,498 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba79f9537ae4d3c8237cc6 HTTP/1.1" 200 None 2026-03-20 10:10:07,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:10:07,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 10:10:07,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:10:07,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba79f9537ae4d3c8237cc6 HTTP/1.1" 200 None 2026-03-20 10:10:07,543 - lava_callback - ERROR - Error processing callback for node 69ba79f9537ae4d3c8237cc6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36684 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54442 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:10:47,445 - lava_callback - INFO - Received callback for node 69ba7a20537ae4d3c8237cd6 INFO: 172.21.0.1:54446 - "POST /node/69ba7a20537ae4d3c8237cd6 HTTP/1.0" 202 Accepted 2026-03-20 10:10:47,451 - lava_callback - INFO - Starting async job submit for node 69ba7a20537ae4d3c8237cd6 2026-03-20 10:10:47,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:10:47,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7a20537ae4d3c8237cd6 HTTP/1.1" 200 None 2026-03-20 10:10:47,467 - lava_callback - DEBUG - Processing node 69ba7a20537ae4d3c8237cd6: baseline-arm-clabbe 2026-03-20 10:10:47,468 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7a20537ae4d3c8237cd6 2026-03-20 10:10:47,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:10:47,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7a20537ae4d3c8237cd6 HTTP/1.1" 200 None 2026-03-20 10:10:47,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:10:47,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 10:10:47,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:10:47,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7a20537ae4d3c8237cd6 HTTP/1.1" 200 None 2026-03-20 10:10:47,528 - lava_callback - ERROR - Error processing callback for node 69ba7a20537ae4d3c8237cd6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57450 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59344 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:11:27,515 - lava_callback - INFO - Received callback for node 69ba7a47537ae4d3c8237ce0 INFO: 172.21.0.1:59354 - "POST /node/69ba7a47537ae4d3c8237ce0 HTTP/1.0" 202 Accepted 2026-03-20 10:11:27,521 - lava_callback - INFO - Starting async job submit for node 69ba7a47537ae4d3c8237ce0 2026-03-20 10:11:27,521 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:11:27,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7a47537ae4d3c8237ce0 HTTP/1.1" 200 None 2026-03-20 10:11:27,539 - lava_callback - DEBUG - Processing node 69ba7a47537ae4d3c8237ce0: baseline-arm-clabbe 2026-03-20 10:11:27,539 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7a47537ae4d3c8237ce0 2026-03-20 10:11:27,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:11:27,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7a47537ae4d3c8237ce0 HTTP/1.1" 200 None 2026-03-20 10:11:27,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:11:27,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 10:11:27,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:11:27,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7a47537ae4d3c8237ce0 HTTP/1.1" 200 None 2026-03-20 10:11:27,595 - lava_callback - ERROR - Error processing callback for node 69ba7a47537ae4d3c8237ce0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34814 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:11:46,737 - lava_callback - INFO - Received callback for node 69bd1ada05e4bbd6ba635cda INFO: 172.21.0.1:34830 - "POST /node/69bd1ada05e4bbd6ba635cda HTTP/1.0" 202 Accepted 2026-03-20 10:11:46,744 - lava_callback - INFO - Starting async job submit for node 69bd1ada05e4bbd6ba635cda 2026-03-20 10:11:46,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:11:46,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd1ada05e4bbd6ba635cda HTTP/1.1" 200 None 2026-03-20 10:11:46,788 - lava_callback - DEBUG - Processing node 69bd1ada05e4bbd6ba635cda: baseline-nfs-arm64 2026-03-20 10:11:47,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:11:47,495 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:11:47,497 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd1ada05e4bbd6ba635cda/log.txt.gz 2026-03-20 10:11:47,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:11:47,986 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:11:47,988 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd1ada05e4bbd6ba635cda/lava-logs.yaml 2026-03-20 10:11:48,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:11:48,174 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:11:48,176 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd1ada05e4bbd6ba635cda/lava_callback.json.gz 2026-03-20 10:11:48,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:11:48,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd1ada05e4bbd6ba635cda HTTP/1.1" 200 None 2026-03-20 10:11:48,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:11:48,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 10:11:48,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:11:48,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd1ada05e4bbd6ba635cda HTTP/1.1" 200 None 2026-03-20 10:11:48,306 - lava_callback - INFO - Completed processing callback for node 69bd1ada05e4bbd6ba635cda INFO: 172.21.0.1:50946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:12:09,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:12:09,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38540 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:18:05,750 - lava_callback - INFO - Received callback for node 69ba7bd4537ae4d3c8237d20 INFO: 172.21.0.1:49330 - "POST /node/69ba7bd4537ae4d3c8237d20 HTTP/1.0" 202 Accepted 2026-03-20 10:18:05,755 - lava_callback - INFO - Starting async job submit for node 69ba7bd4537ae4d3c8237d20 2026-03-20 10:18:05,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:18:05,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7bd4537ae4d3c8237d20 HTTP/1.1" 200 None 2026-03-20 10:18:05,772 - lava_callback - DEBUG - Processing node 69ba7bd4537ae4d3c8237d20: baseline-x86 2026-03-20 10:18:05,772 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7bd4537ae4d3c8237d20 2026-03-20 10:18:05,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:18:05,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7bd4537ae4d3c8237d20 HTTP/1.1" 200 None 2026-03-20 10:18:05,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:18:05,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b974a7151254d948eeea18 HTTP/1.1" 200 None 2026-03-20 10:18:05,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:18:05,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7bd4537ae4d3c8237d20 HTTP/1.1" 200 None 2026-03-20 10:18:05,839 - lava_callback - ERROR - Error processing callback for node 69ba7bd4537ae4d3c8237d20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51108 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:18:30,838 - lava_callback - INFO - Received callback for node 69bd16c205e4bbd6ba635c33 INFO: 172.21.0.1:34996 - "POST /node/69bd16c205e4bbd6ba635c33 HTTP/1.0" 202 Accepted 2026-03-20 10:18:30,845 - lava_callback - INFO - Starting async job submit for node 69bd16c205e4bbd6ba635c33 2026-03-20 10:18:30,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:18:30,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd16c205e4bbd6ba635c33 HTTP/1.1" 200 None 2026-03-20 10:18:30,880 - lava_callback - DEBUG - Processing node 69bd16c205e4bbd6ba635c33: baseline-arm64-broonie 2026-03-20 10:18:31,093 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:18:31,228 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:18:31,230 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd16c205e4bbd6ba635c33/log.txt.gz 2026-03-20 10:18:31,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:18:31,657 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:18:31,659 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd16c205e4bbd6ba635c33/lava-logs.yaml 2026-03-20 10:18:31,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:18:31,818 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:18:31,819 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd16c205e4bbd6ba635c33/lava_callback.json.gz 2026-03-20 10:18:31,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:18:31,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd16c205e4bbd6ba635c33 HTTP/1.1" 200 None 2026-03-20 10:18:31,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:18:31,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 10:18:31,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:18:31,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd16c205e4bbd6ba635c33 HTTP/1.1" 200 None 2026-03-20 10:18:31,977 - lava_callback - INFO - Completed processing callback for node 69bd16c205e4bbd6ba635c33 INFO: 172.21.0.1:35010 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:18:39,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:18:39,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:49442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34842 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34820 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:20:49,458 - lava_callback - INFO - Received callback for node 69ba7c6f537ae4d3c8237d48 INFO: 172.21.0.1:34836 - "POST /node/69ba7c6f537ae4d3c8237d48 HTTP/1.0" 202 Accepted 2026-03-20 10:20:49,463 - lava_callback - INFO - Starting async job submit for node 69ba7c6f537ae4d3c8237d48 2026-03-20 10:20:49,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:20:49,479 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7c6f537ae4d3c8237d48 HTTP/1.1" 200 None 2026-03-20 10:20:49,480 - lava_callback - DEBUG - Processing node 69ba7c6f537ae4d3c8237d48: baseline-arm-baylibre 2026-03-20 10:20:49,480 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7c6f537ae4d3c8237d48 2026-03-20 10:20:49,481 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:20:49,494 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7c6f537ae4d3c8237d48 HTTP/1.1" 200 None 2026-03-20 10:20:49,496 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:20:49,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-20 10:20:49,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:20:49,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7c6f537ae4d3c8237d48 HTTP/1.1" 200 None 2026-03-20 10:20:49,569 - lava_callback - ERROR - Error processing callback for node 69ba7c6f537ae4d3c8237d48: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46110 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:21:01,494 - lava_callback - INFO - Received callback for node 69bd1b6d05e4bbd6ba635cef INFO: 172.21.0.1:56210 - "POST /node/69bd1b6d05e4bbd6ba635cef HTTP/1.0" 202 Accepted 2026-03-20 10:21:01,501 - lava_callback - INFO - Starting async job submit for node 69bd1b6d05e4bbd6ba635cef 2026-03-20 10:21:01,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:21:01,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd1b6d05e4bbd6ba635cef HTTP/1.1" 200 None 2026-03-20 10:21:01,572 - lava_callback - DEBUG - Processing node 69bd1b6d05e4bbd6ba635cef: baseline-arm 2026-03-20 10:21:02,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:21:02,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:21:02,423 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd1b6d05e4bbd6ba635cef/log.txt.gz 2026-03-20 10:21:02,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:21:03,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:21:03,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd1b6d05e4bbd6ba635cef/lava-logs.yaml 2026-03-20 10:21:03,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:21:03,235 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:21:03,237 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd1b6d05e4bbd6ba635cef/lava_callback.json.gz DEBUG: Setup failed for 69bd1b6d05e4bbd6ba635cef. Transitting job node result: incomplete -> fail 2026-03-20 10:21:03,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:21:03,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd1b6d05e4bbd6ba635cef HTTP/1.1" 200 None 2026-03-20 10:21:03,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:21:03,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 10:21:03,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:21:03,433 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd1b6d05e4bbd6ba635cef HTTP/1.1" 200 None 2026-03-20 10:21:03,543 - lava_callback - INFO - Completed processing callback for node 69bd1b6d05e4bbd6ba635cef INFO: 172.21.0.1:56226 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:21:09,422 - lava_callback - INFO - Received callback for node 69ba7c93537ae4d3c8237d56 INFO: 172.21.0.1:56238 - "POST /node/69ba7c93537ae4d3c8237d56 HTTP/1.0" 202 Accepted 2026-03-20 10:21:09,428 - lava_callback - INFO - Starting async job submit for node 69ba7c93537ae4d3c8237d56 2026-03-20 10:21:09,429 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:21:09,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7c93537ae4d3c8237d56 HTTP/1.1" 200 None 2026-03-20 10:21:09,446 - lava_callback - DEBUG - Processing node 69ba7c93537ae4d3c8237d56: baseline-arm-baylibre 2026-03-20 10:21:09,447 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7c93537ae4d3c8237d56 2026-03-20 10:21:09,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:21:09,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7c93537ae4d3c8237d56 HTTP/1.1" 200 None 2026-03-20 10:21:09,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:21:09,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:21:09,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-20 10:21:09,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:21:09,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-20 10:21:09,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7c93537ae4d3c8237d56 HTTP/1.1" 200 None 2026-03-20 10:21:09,528 - lava_callback - ERROR - Error processing callback for node 69ba7c93537ae4d3c8237d56: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41484 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:23:09,521 - lava_callback - INFO - Received callback for node 69ba7d08537ae4d3c8237d68 INFO: 172.21.0.1:41488 - "POST /node/69ba7d08537ae4d3c8237d68 HTTP/1.0" 202 Accepted 2026-03-20 10:23:09,527 - lava_callback - INFO - Starting async job submit for node 69ba7d08537ae4d3c8237d68 2026-03-20 10:23:09,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:23:09,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7d08537ae4d3c8237d68 HTTP/1.1" 200 None 2026-03-20 10:23:09,543 - lava_callback - DEBUG - Processing node 69ba7d08537ae4d3c8237d68: baseline-arm-baylibre 2026-03-20 10:23:09,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7d08537ae4d3c8237d68 2026-03-20 10:23:09,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:23:09,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7d08537ae4d3c8237d68 HTTP/1.1" 200 None 2026-03-20 10:23:09,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:23:09,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-20 10:23:09,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:23:09,621 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7d08537ae4d3c8237d68 HTTP/1.1" 200 None 2026-03-20 10:23:09,627 - lava_callback - ERROR - Error processing callback for node 69ba7d08537ae4d3c8237d68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36010 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37298 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:23:49,525 - lava_callback - INFO - Received callback for node 69ba7d2c537ae4d3c8237d73 INFO: 172.21.0.1:37306 - "POST /node/69ba7d2c537ae4d3c8237d73 HTTP/1.0" 202 Accepted 2026-03-20 10:23:49,531 - lava_callback - INFO - Starting async job submit for node 69ba7d2c537ae4d3c8237d73 2026-03-20 10:23:49,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:23:49,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7d2c537ae4d3c8237d73 HTTP/1.1" 200 None 2026-03-20 10:23:49,551 - lava_callback - DEBUG - Processing node 69ba7d2c537ae4d3c8237d73: baseline-arm-baylibre 2026-03-20 10:23:49,551 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7d2c537ae4d3c8237d73 2026-03-20 10:23:49,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:23:49,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7d2c537ae4d3c8237d73 HTTP/1.1" 200 None 2026-03-20 10:23:49,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:23:49,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-20 10:23:49,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:23:49,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7d2c537ae4d3c8237d73 HTTP/1.1" 200 None 2026-03-20 10:23:49,608 - lava_callback - ERROR - Error processing callback for node 69ba7d2c537ae4d3c8237d73: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49220 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56302 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:25:49,745 - lava_callback - INFO - Received callback for node 69ba7da1537ae4d3c8237d89 INFO: 172.21.0.1:54890 - "POST /node/69ba7da1537ae4d3c8237d89 HTTP/1.0" 202 Accepted 2026-03-20 10:25:49,750 - lava_callback - INFO - Starting async job submit for node 69ba7da1537ae4d3c8237d89 2026-03-20 10:25:49,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:25:49,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7da1537ae4d3c8237d89 HTTP/1.1" 200 None 2026-03-20 10:25:49,767 - lava_callback - DEBUG - Processing node 69ba7da1537ae4d3c8237d89: baseline-arm-baylibre 2026-03-20 10:25:49,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7da1537ae4d3c8237d89 2026-03-20 10:25:49,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:25:49,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7da1537ae4d3c8237d89 HTTP/1.1" 200 None 2026-03-20 10:25:49,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:25:49,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-20 10:25:49,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:25:49,851 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7da1537ae4d3c8237d89 HTTP/1.1" 200 None 2026-03-20 10:25:49,853 - lava_callback - ERROR - Error processing callback for node 69ba7da1537ae4d3c8237d89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33222 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39400 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:26:29,684 - lava_callback - INFO - Received callback for node 69ba7dc4537ae4d3c8237d91 INFO: 172.21.0.1:39414 - "POST /node/69ba7dc4537ae4d3c8237d91 HTTP/1.0" 202 Accepted 2026-03-20 10:26:29,689 - lava_callback - INFO - Starting async job submit for node 69ba7dc4537ae4d3c8237d91 2026-03-20 10:26:29,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:26:29,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7dc4537ae4d3c8237d91 HTTP/1.1" 200 None 2026-03-20 10:26:29,705 - lava_callback - DEBUG - Processing node 69ba7dc4537ae4d3c8237d91: baseline-arm-baylibre 2026-03-20 10:26:29,705 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7dc4537ae4d3c8237d91 2026-03-20 10:26:29,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:26:29,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7dc4537ae4d3c8237d91 HTTP/1.1" 200 None 2026-03-20 10:26:29,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:26:29,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-20 10:26:29,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:26:29,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7dc4537ae4d3c8237d91 HTTP/1.1" 200 None 2026-03-20 10:26:29,763 - lava_callback - ERROR - Error processing callback for node 69ba7dc4537ae4d3c8237d91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58514 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:28:50,081 - lava_callback - INFO - Received callback for node 69bd1cd105e4bbd6ba635d5d INFO: 172.21.0.1:36878 - "POST /node/69bd1cd105e4bbd6ba635d5d HTTP/1.0" 202 Accepted 2026-03-20 10:28:50,129 - lava_callback - INFO - Starting async job submit for node 69bd1cd105e4bbd6ba635d5d 2026-03-20 10:28:50,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:28:50,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd1cd105e4bbd6ba635d5d HTTP/1.1" 200 None 2026-03-20 10:28:50,180 - lava_callback - DEBUG - Processing node 69bd1cd105e4bbd6ba635d5d: baseline-arm-pengutronix 2026-03-20 10:28:50,286 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:28:50,458 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:28:50,460 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd1cd105e4bbd6ba635d5d/log.txt.gz 2026-03-20 10:28:50,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:28:50,717 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:28:50,719 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd1cd105e4bbd6ba635d5d/lava-logs.yaml 2026-03-20 10:28:50,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:28:50,864 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:28:50,866 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd1cd105e4bbd6ba635d5d/lava_callback.json.gz DEBUG: Setup failed for 69bd1cd105e4bbd6ba635d5d. Transitting job node result: incomplete -> fail 2026-03-20 10:28:50,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:28:50,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd1cd105e4bbd6ba635d5d HTTP/1.1" 200 None 2026-03-20 10:28:50,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:28:50,958 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 10:28:50,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:28:50,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd1cd105e4bbd6ba635d5d HTTP/1.1" 200 None 2026-03-20 10:28:51,069 - lava_callback - INFO - Completed processing callback for node 69bd1cd105e4bbd6ba635d5d INFO: 172.21.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41612 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:29:09,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:29:09,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42566 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:31:09,049 - lava_callback - INFO - Received callback for node 69bd1d4705e4bbd6ba635d9d INFO: 172.21.0.1:42572 - "POST /node/69bd1d4705e4bbd6ba635d9d HTTP/1.0" 202 Accepted 2026-03-20 10:31:09,057 - lava_callback - INFO - Starting async job submit for node 69bd1d4705e4bbd6ba635d9d 2026-03-20 10:31:09,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:31:09,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd1d4705e4bbd6ba635d9d HTTP/1.1" 200 None 2026-03-20 10:31:09,116 - lava_callback - DEBUG - Processing node 69bd1d4705e4bbd6ba635d9d: baseline-nfs-arm64 2026-03-20 10:31:10,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:31:10,315 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:31:10,317 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd1d4705e4bbd6ba635d9d/log.txt.gz 2026-03-20 10:31:10,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:31:11,187 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:31:11,190 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd1d4705e4bbd6ba635d9d/lava-logs.yaml 2026-03-20 10:31:11,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:31:11,401 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:31:11,403 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd1d4705e4bbd6ba635d9d/lava_callback.json.gz DEBUG: Setup failed for 69bd1d4705e4bbd6ba635d9d. Transitting job node result: incomplete -> fail 2026-03-20 10:31:11,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:31:11,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd1d4705e4bbd6ba635d9d HTTP/1.1" 200 None 2026-03-20 10:31:11,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:31:11,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 10:31:11,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:31:11,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd1d4705e4bbd6ba635d9d HTTP/1.1" 200 None 2026-03-20 10:31:11,647 - lava_callback - INFO - Completed processing callback for node 69bd1d4705e4bbd6ba635d9d INFO: 172.21.0.1:35816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46994 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:31:39,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:31:39,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57898 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:32:08,367 - lava_callback - INFO - Received callback for node 69ba7f22537ae4d3c8237dce INFO: 172.21.0.1:57904 - "POST /node/69ba7f22537ae4d3c8237dce HTTP/1.0" 202 Accepted 2026-03-20 10:32:08,373 - lava_callback - INFO - Starting async job submit for node 69ba7f22537ae4d3c8237dce 2026-03-20 10:32:08,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:32:08,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7f22537ae4d3c8237dce HTTP/1.1" 200 None 2026-03-20 10:32:08,396 - lava_callback - DEBUG - Processing node 69ba7f22537ae4d3c8237dce: baseline-arm-clabbe 2026-03-20 10:32:08,396 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7f22537ae4d3c8237dce 2026-03-20 10:32:08,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:32:08,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7f22537ae4d3c8237dce HTTP/1.1" 200 None 2026-03-20 10:32:08,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:32:08,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-20 10:32:08,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:32:08,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7f22537ae4d3c8237dce HTTP/1.1" 200 None 2026-03-20 10:32:08,457 - lava_callback - ERROR - Error processing callback for node 69ba7f22537ae4d3c8237dce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41376 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:32:48,491 - lava_callback - INFO - Received callback for node 69ba7f46537ae4d3c8237dd9 INFO: 172.21.0.1:41390 - "POST /node/69ba7f46537ae4d3c8237dd9 HTTP/1.0" 202 Accepted 2026-03-20 10:32:48,497 - lava_callback - INFO - Starting async job submit for node 69ba7f46537ae4d3c8237dd9 2026-03-20 10:32:48,498 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:32:48,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7f46537ae4d3c8237dd9 HTTP/1.1" 200 None 2026-03-20 10:32:48,518 - lava_callback - DEBUG - Processing node 69ba7f46537ae4d3c8237dd9: baseline-arm-clabbe 2026-03-20 10:32:48,519 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7f46537ae4d3c8237dd9 2026-03-20 10:32:48,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:32:48,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7f46537ae4d3c8237dd9 HTTP/1.1" 200 None 2026-03-20 10:32:48,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:32:48,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-20 10:32:48,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:32:48,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7f46537ae4d3c8237dd9 HTTP/1.1" 200 None 2026-03-20 10:32:48,575 - lava_callback - ERROR - Error processing callback for node 69ba7f46537ae4d3c8237dd9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:40360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40322 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:33:28,546 - lava_callback - INFO - Received callback for node 69ba7f6a537ae4d3c8237de0 INFO: 172.21.0.1:40338 - "POST /node/69ba7f6a537ae4d3c8237de0 HTTP/1.0" 202 Accepted 2026-03-20 10:33:28,551 - lava_callback - INFO - Starting async job submit for node 69ba7f6a537ae4d3c8237de0 2026-03-20 10:33:28,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:33:28,566 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7f6a537ae4d3c8237de0 HTTP/1.1" 200 None 2026-03-20 10:33:28,567 - lava_callback - DEBUG - Processing node 69ba7f6a537ae4d3c8237de0: baseline-arm-clabbe 2026-03-20 10:33:28,567 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7f6a537ae4d3c8237de0 2026-03-20 10:33:28,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:33:28,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7f6a537ae4d3c8237de0 HTTP/1.1" 200 None 2026-03-20 10:33:28,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:33:28,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-20 10:33:28,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:33:28,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7f6a537ae4d3c8237de0 HTTP/1.1" 200 None 2026-03-20 10:33:28,623 - lava_callback - ERROR - Error processing callback for node 69ba7f6a537ae4d3c8237de0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40300 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:34:08,522 - lava_callback - INFO - Received callback for node 69ba7f8e537ae4d3c8237de9 INFO: 172.21.0.1:40306 - "POST /node/69ba7f8e537ae4d3c8237de9 HTTP/1.0" 202 Accepted 2026-03-20 10:34:08,528 - lava_callback - INFO - Starting async job submit for node 69ba7f8e537ae4d3c8237de9 2026-03-20 10:34:08,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:08,575 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7f8e537ae4d3c8237de9 HTTP/1.1" 200 None 2026-03-20 10:34:08,576 - lava_callback - DEBUG - Processing node 69ba7f8e537ae4d3c8237de9: baseline-arm-clabbe 2026-03-20 10:34:08,576 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7f8e537ae4d3c8237de9 2026-03-20 10:34:08,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:08,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7f8e537ae4d3c8237de9 HTTP/1.1" 200 None 2026-03-20 10:34:08,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:08,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-20 10:34:08,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:08,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7f8e537ae4d3c8237de9 HTTP/1.1" 200 None 2026-03-20 10:34:08,637 - lava_callback - ERROR - Error processing callback for node 69ba7f8e537ae4d3c8237de9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37680 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48396 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:34:48,586 - lava_callback - INFO - Received callback for node 69ba7fbc537ae4d3c8237df2 INFO: 172.21.0.1:48404 - "POST /node/69ba7fbc537ae4d3c8237df2 HTTP/1.0" 202 Accepted 2026-03-20 10:34:48,591 - lava_callback - INFO - Starting async job submit for node 69ba7fbc537ae4d3c8237df2 2026-03-20 10:34:48,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:48,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7fbc537ae4d3c8237df2 HTTP/1.1" 200 None 2026-03-20 10:34:48,613 - lava_callback - DEBUG - Processing node 69ba7fbc537ae4d3c8237df2: baseline-arm-clabbe 2026-03-20 10:34:48,613 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba7fbc537ae4d3c8237df2 2026-03-20 10:34:48,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:48,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba7fbc537ae4d3c8237df2 HTTP/1.1" 200 None 2026-03-20 10:34:48,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:48,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-20 10:34:48,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:48,664 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba7fbc537ae4d3c8237df2 HTTP/1.1" 200 None 2026-03-20 10:34:48,665 - lava_callback - ERROR - Error processing callback for node 69ba7fbc537ae4d3c8237df2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44320 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:34:55,560 - lava_callback - INFO - Received callback for node 69bd211e05e4bbd6ba635e62 INFO: 172.21.0.1:44324 - "POST /node/69bd211e05e4bbd6ba635e62 HTTP/1.0" 202 Accepted 2026-03-20 10:34:55,568 - lava_callback - INFO - Starting async job submit for node 69bd211e05e4bbd6ba635e62 2026-03-20 10:34:55,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:55,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd211e05e4bbd6ba635e62 HTTP/1.1" 200 None 2026-03-20 10:34:55,619 - lava_callback - DEBUG - Processing node 69bd211e05e4bbd6ba635e62: baseline-arm64 2026-03-20 10:34:56,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:34:56,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:34:56,155 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd211e05e4bbd6ba635e62/log.txt.gz 2026-03-20 10:34:56,367 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.21.0.1:44332 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:34:56,613 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:34:56,615 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd211e05e4bbd6ba635e62/lava-logs.yaml 2026-03-20 10:34:56,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:34:56,805 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:34:56,807 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd211e05e4bbd6ba635e62/lava_callback.json.gz DEBUG: Setup failed for 69bd211e05e4bbd6ba635e62. Transitting job node result: incomplete -> fail 2026-03-20 10:34:56,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:56,897 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd211e05e4bbd6ba635e62 HTTP/1.1" 200 None 2026-03-20 10:34:56,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:56,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 10:34:56,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:34:56,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd211e05e4bbd6ba635e62 HTTP/1.1" 200 None 2026-03-20 10:34:57,011 - lava_callback - INFO - Completed processing callback for node 69bd211e05e4bbd6ba635e62 INFO: 172.21.0.1:36952 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:35:09,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:35:09,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:59916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:38:58,852 - lava_callback - INFO - Received callback for node 69bd216a05e4bbd6ba635e75 INFO: 172.21.0.1:50828 - "POST /node/69bd216a05e4bbd6ba635e75 HTTP/1.0" 202 Accepted 2026-03-20 10:38:58,858 - lava_callback - INFO - Starting async job submit for node 69bd216a05e4bbd6ba635e75 2026-03-20 10:38:58,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:38:58,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd216a05e4bbd6ba635e75 HTTP/1.1" 200 None 2026-03-20 10:38:58,910 - lava_callback - DEBUG - Processing node 69bd216a05e4bbd6ba635e75: baseline-arm64 2026-03-20 10:38:59,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:38:59,607 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:38:59,609 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd216a05e4bbd6ba635e75/log.txt.gz 2026-03-20 10:38:59,873 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:39:00,109 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:39:00,111 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd216a05e4bbd6ba635e75/lava-logs.yaml 2026-03-20 10:39:00,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:39:00,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:39:00,300 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bd216a05e4bbd6ba635e75/lava_callback.json.gz 2026-03-20 10:39:00,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:39:00,341 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd216a05e4bbd6ba635e75 HTTP/1.1" 200 None 2026-03-20 10:39:00,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:39:00,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 10:39:00,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:39:00,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd216a05e4bbd6ba635e75 HTTP/1.1" 200 None 2026-03-20 10:39:00,465 - lava_callback - INFO - Completed processing callback for node 69bd216a05e4bbd6ba635e75 INFO: 172.21.0.1:50172 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:39:09,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:39:09,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50746 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46014 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:46:31,989 - lava_callback - INFO - Received callback for node 69bd216405e4bbd6ba635e72 INFO: 172.21.0.1:55230 - "POST /node/69bd216405e4bbd6ba635e72 HTTP/1.0" 202 Accepted 2026-03-20 10:46:31,996 - lava_callback - INFO - Starting async job submit for node 69bd216405e4bbd6ba635e72 2026-03-20 10:46:32,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:46:32,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd216405e4bbd6ba635e72 HTTP/1.1" 200 None 2026-03-20 10:46:32,095 - lava_callback - DEBUG - Processing node 69bd216405e4bbd6ba635e72: ltp-smoke 2026-03-20 10:46:32,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:46:32,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:46:32,773 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd216405e4bbd6ba635e72/log.txt.gz 2026-03-20 10:46:33,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:46:33,290 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:46:33,292 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd216405e4bbd6ba635e72/lava-logs.yaml 2026-03-20 10:46:33,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:46:33,487 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:46:33,489 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bd216405e4bbd6ba635e72/lava_callback.json.gz 2026-03-20 10:46:33,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:46:33,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd216405e4bbd6ba635e72 HTTP/1.1" 200 None 2026-03-20 10:46:33,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:46:33,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027205e4bbd6ba634c5d HTTP/1.1" 200 None 2026-03-20 10:46:33,651 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:46:33,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd216405e4bbd6ba635e72 HTTP/1.1" 200 None 2026-03-20 10:46:33,782 - lava_callback - INFO - Completed processing callback for node 69bd216405e4bbd6ba635e72 INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:46:39,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:46:39,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:48:30,401 - lava_callback - INFO - Received callback for node 69bd237605e4bbd6ba63607b INFO: 172.21.0.1:34502 - "POST /node/69bd237605e4bbd6ba63607b HTTP/1.0" 202 Accepted 2026-03-20 10:48:30,408 - lava_callback - INFO - Starting async job submit for node 69bd237605e4bbd6ba63607b 2026-03-20 10:48:30,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:48:30,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd237605e4bbd6ba63607b HTTP/1.1" 200 None 2026-03-20 10:48:30,472 - lava_callback - DEBUG - Processing node 69bd237605e4bbd6ba63607b: baseline-nfs-arm64 2026-03-20 10:48:31,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:48:31,168 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:48:31,170 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd237605e4bbd6ba63607b/log.txt.gz 2026-03-20 10:48:31,431 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:48:31,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:48:31,657 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd237605e4bbd6ba63607b/lava-logs.yaml 2026-03-20 10:48:31,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:48:31,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:48:31,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd237605e4bbd6ba63607b/lava_callback.json.gz 2026-03-20 10:48:31,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:48:31,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd237605e4bbd6ba63607b HTTP/1.1" 200 None 2026-03-20 10:48:31,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:48:31,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 10:48:31,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:48:31,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd237605e4bbd6ba63607b HTTP/1.1" 200 None 2026-03-20 10:48:32,013 - lava_callback - INFO - Completed processing callback for node 69bd237605e4bbd6ba63607b INFO: 172.21.0.1:34506 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:48:39,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:48:39,634 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48166 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:53:11,413 - lava_callback - INFO - Received callback for node 69ba8407537ae4d3c8237e90 INFO: 172.21.0.1:48084 - "POST /node/69ba8407537ae4d3c8237e90 HTTP/1.0" 202 Accepted 2026-03-20 10:53:11,419 - lava_callback - INFO - Starting async job submit for node 69ba8407537ae4d3c8237e90 2026-03-20 10:53:11,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:53:11,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8407537ae4d3c8237e90 HTTP/1.1" 200 None 2026-03-20 10:53:11,436 - lava_callback - DEBUG - Processing node 69ba8407537ae4d3c8237e90: baseline-arm64-baylibre 2026-03-20 10:53:11,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8407537ae4d3c8237e90 2026-03-20 10:53:11,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:53:11,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8407537ae4d3c8237e90 HTTP/1.1" 200 None 2026-03-20 10:53:11,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:53:11,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 10:53:11,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:53:11,486 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8407537ae4d3c8237e90 HTTP/1.1" 200 None 2026-03-20 10:53:11,487 - lava_callback - ERROR - Error processing callback for node 69ba8407537ae4d3c8237e90: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48090 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51518 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:54:31,369 - lava_callback - INFO - Received callback for node 69ba8459537ae4d3c8237e9e INFO: 172.21.0.1:58314 - "POST /node/69ba8459537ae4d3c8237e9e HTTP/1.0" 202 Accepted 2026-03-20 10:54:31,375 - lava_callback - INFO - Starting async job submit for node 69ba8459537ae4d3c8237e9e 2026-03-20 10:54:31,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:54:31,410 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8459537ae4d3c8237e9e HTTP/1.1" 200 None 2026-03-20 10:54:31,411 - lava_callback - DEBUG - Processing node 69ba8459537ae4d3c8237e9e: baseline-arm64-baylibre 2026-03-20 10:54:31,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8459537ae4d3c8237e9e 2026-03-20 10:54:31,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:54:31,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8459537ae4d3c8237e9e HTTP/1.1" 200 None 2026-03-20 10:54:31,427 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:54:31,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 10:54:31,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:54:31,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8459537ae4d3c8237e9e HTTP/1.1" 200 None 2026-03-20 10:54:31,486 - lava_callback - ERROR - Error processing callback for node 69ba8459537ae4d3c8237e9e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57814 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55688 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:55:51,387 - lava_callback - INFO - Received callback for node 69ba84ab537ae4d3c8237eb5 INFO: 172.21.0.1:33568 - "POST /node/69ba84ab537ae4d3c8237eb5 HTTP/1.0" 202 Accepted 2026-03-20 10:55:51,392 - lava_callback - INFO - Starting async job submit for node 69ba84ab537ae4d3c8237eb5 2026-03-20 10:55:51,393 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:55:51,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba84ab537ae4d3c8237eb5 HTTP/1.1" 200 None 2026-03-20 10:55:51,429 - lava_callback - DEBUG - Processing node 69ba84ab537ae4d3c8237eb5: baseline-arm64-baylibre 2026-03-20 10:55:51,429 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba84ab537ae4d3c8237eb5 2026-03-20 10:55:51,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:33576 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:55:51,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba84ab537ae4d3c8237eb5 HTTP/1.1" 200 None 2026-03-20 10:55:51,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:55:51,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 10:55:51,480 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:55:51,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba84ab537ae4d3c8237eb5 HTTP/1.1" 200 None 2026-03-20 10:55:51,511 - lava_callback - ERROR - Error processing callback for node 69ba84ab537ae4d3c8237eb5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53596 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:56:39,762 - lava_callback - INFO - Received callback for node 69bd240005e4bbd6ba636096 INFO: 172.21.0.1:35924 - "POST /node/69bd240005e4bbd6ba636096 HTTP/1.0" 202 Accepted 2026-03-20 10:56:39,768 - lava_callback - INFO - Starting async job submit for node 69bd240005e4bbd6ba636096 2026-03-20 10:56:39,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:56:39,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd240005e4bbd6ba636096 HTTP/1.1" 200 None 2026-03-20 10:56:39,840 - lava_callback - DEBUG - Processing node 69bd240005e4bbd6ba636096: baseline-arm 2026-03-20 10:56:40,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:56:40,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:56:40,629 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bd240005e4bbd6ba636096/log.txt.gz 2026-03-20 10:56:40,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:56:41,252 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:56:41,254 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bd240005e4bbd6ba636096/lava-logs.yaml 2026-03-20 10:56:41,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 10:56:41,455 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 10:56:41,457 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bd240005e4bbd6ba636096/lava_callback.json.gz DEBUG: Setup failed for 69bd240005e4bbd6ba636096. Transitting job node result: incomplete -> fail 2026-03-20 10:56:41,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:56:41,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd240005e4bbd6ba636096 HTTP/1.1" 200 None 2026-03-20 10:56:41,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:56:41,601 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 10:56:41,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:56:41,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd240005e4bbd6ba636096 HTTP/1.1" 200 None 2026-03-20 10:56:41,746 - lava_callback - INFO - Completed processing callback for node 69bd240005e4bbd6ba636096 INFO: 172.21.0.1:35934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35596 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:57:09,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:57:09,660 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-20 10:57:11,457 - lava_callback - INFO - Received callback for node 69ba84fe537ae4d3c8237ece INFO: 172.21.0.1:47496 - "POST /node/69ba84fe537ae4d3c8237ece HTTP/1.0" 202 Accepted 2026-03-20 10:57:11,462 - lava_callback - INFO - Starting async job submit for node 69ba84fe537ae4d3c8237ece 2026-03-20 10:57:11,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:57:11,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba84fe537ae4d3c8237ece HTTP/1.1" 200 None 2026-03-20 10:57:11,490 - lava_callback - DEBUG - Processing node 69ba84fe537ae4d3c8237ece: baseline-arm64-baylibre 2026-03-20 10:57:11,490 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba84fe537ae4d3c8237ece 2026-03-20 10:57:11,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:57:11,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba84fe537ae4d3c8237ece HTTP/1.1" 200 None 2026-03-20 10:57:11,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:57:11,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 10:57:11,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:57:11,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba84fe537ae4d3c8237ece HTTP/1.1" 200 None 2026-03-20 10:57:11,592 - lava_callback - ERROR - Error processing callback for node 69ba84fe537ae4d3c8237ece: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48368 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36448 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:58:31,655 - lava_callback - INFO - Received callback for node 69ba8550537ae4d3c8237ed9 INFO: 172.21.0.1:42748 - "POST /node/69ba8550537ae4d3c8237ed9 HTTP/1.0" 202 Accepted 2026-03-20 10:58:31,661 - lava_callback - INFO - Starting async job submit for node 69ba8550537ae4d3c8237ed9 2026-03-20 10:58:31,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:58:31,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8550537ae4d3c8237ed9 HTTP/1.1" 200 None 2026-03-20 10:58:31,714 - lava_callback - DEBUG - Processing node 69ba8550537ae4d3c8237ed9: baseline-arm64-baylibre 2026-03-20 10:58:31,714 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8550537ae4d3c8237ed9 2026-03-20 10:58:31,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:58:31,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8550537ae4d3c8237ed9 HTTP/1.1" 200 None 2026-03-20 10:58:31,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:58:31,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 10:58:31,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:58:31,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8550537ae4d3c8237ed9 HTTP/1.1" 200 None 2026-03-20 10:58:31,768 - lava_callback - ERROR - Error processing callback for node 69ba8550537ae4d3c8237ed9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54326 - "GET / HTTP/1.0" 200 OK 2026-03-20 10:59:51,612 - lava_callback - INFO - Received callback for node 69ba859e537ae4d3c8237ee6 INFO: 172.21.0.1:54332 - "POST /node/69ba859e537ae4d3c8237ee6 HTTP/1.0" 202 Accepted 2026-03-20 10:59:51,617 - lava_callback - INFO - Starting async job submit for node 69ba859e537ae4d3c8237ee6 2026-03-20 10:59:51,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:59:51,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba859e537ae4d3c8237ee6 HTTP/1.1" 200 None 2026-03-20 10:59:51,633 - lava_callback - DEBUG - Processing node 69ba859e537ae4d3c8237ee6: baseline-arm64-baylibre 2026-03-20 10:59:51,634 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba859e537ae4d3c8237ee6 2026-03-20 10:59:51,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:59:51,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba859e537ae4d3c8237ee6 HTTP/1.1" 200 None 2026-03-20 10:59:51,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:59:51,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 10:59:51,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 10:59:51,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba859e537ae4d3c8237ee6 HTTP/1.1" 200 None 2026-03-20 10:59:51,715 - lava_callback - ERROR - Error processing callback for node 69ba859e537ae4d3c8237ee6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45974 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:00:11,209 - lava_callback - INFO - Received callback for node 69bd243305e4bbd6ba6360be INFO: 172.21.0.1:52794 - "POST /node/69bd243305e4bbd6ba6360be HTTP/1.0" 202 Accepted 2026-03-20 11:00:11,257 - lava_callback - INFO - Starting async job submit for node 69bd243305e4bbd6ba6360be 2026-03-20 11:00:11,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:00:11,298 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd243305e4bbd6ba6360be HTTP/1.1" 200 None 2026-03-20 11:00:11,299 - lava_callback - DEBUG - Processing node 69bd243305e4bbd6ba6360be: baseline-arm-pengutronix 2026-03-20 11:00:11,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:00:11,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:00:11,555 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd243305e4bbd6ba6360be/log.txt.gz 2026-03-20 11:00:11,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:00:11,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:00:11,797 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd243305e4bbd6ba6360be/lava-logs.yaml 2026-03-20 11:00:11,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:00:11,940 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:00:11,942 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bd243305e4bbd6ba6360be/lava_callback.json.gz DEBUG: Setup failed for 69bd243305e4bbd6ba6360be. Transitting job node result: incomplete -> fail 2026-03-20 11:00:11,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:00:12,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd243305e4bbd6ba6360be HTTP/1.1" 200 None 2026-03-20 11:00:12,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:00:12,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd026d05e4bbd6ba634c57 HTTP/1.1" 200 None 2026-03-20 11:00:12,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:00:12,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd243305e4bbd6ba6360be HTTP/1.1" 200 None 2026-03-20 11:00:12,100 - lava_callback - INFO - Completed processing callback for node 69bd243305e4bbd6ba6360be INFO: 172.21.0.1:52808 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52930 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47986 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:00:39,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:00:39,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:34868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57538 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:01:11,704 - lava_callback - INFO - Received callback for node 69ba85f1537ae4d3c8237eee INFO: 172.21.0.1:38108 - "POST /node/69ba85f1537ae4d3c8237eee HTTP/1.0" 202 Accepted 2026-03-20 11:01:11,709 - lava_callback - INFO - Starting async job submit for node 69ba85f1537ae4d3c8237eee 2026-03-20 11:01:11,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:01:11,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba85f1537ae4d3c8237eee HTTP/1.1" 200 None 2026-03-20 11:01:11,726 - lava_callback - DEBUG - Processing node 69ba85f1537ae4d3c8237eee: baseline-arm64-baylibre 2026-03-20 11:01:11,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba85f1537ae4d3c8237eee 2026-03-20 11:01:11,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:01:11,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba85f1537ae4d3c8237eee HTTP/1.1" 200 None 2026-03-20 11:01:11,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:01:11,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 11:01:11,756 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:01:11,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba85f1537ae4d3c8237eee HTTP/1.1" 200 None 2026-03-20 11:01:11,782 - lava_callback - ERROR - Error processing callback for node 69ba85f1537ae4d3c8237eee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:01:31,228 - lava_callback - INFO - Received callback for node 69bd245805e4bbd6ba6360da INFO: 172.21.0.1:43490 - "POST /node/69bd245805e4bbd6ba6360da HTTP/1.0" 202 Accepted 2026-03-20 11:01:31,236 - lava_callback - INFO - Starting async job submit for node 69bd245805e4bbd6ba6360da 2026-03-20 11:01:31,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:01:31,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd245805e4bbd6ba6360da HTTP/1.1" 200 None 2026-03-20 11:01:31,331 - lava_callback - DEBUG - Processing node 69bd245805e4bbd6ba6360da: baseline-nfs-arm64 2026-03-20 11:01:32,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:01:32,549 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:01:32,551 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd245805e4bbd6ba6360da/log.txt.gz 2026-03-20 11:01:33,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:01:33,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:01:33,388 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd245805e4bbd6ba6360da/lava-logs.yaml 2026-03-20 11:01:33,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:01:33,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:01:33,587 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bd245805e4bbd6ba6360da/lava_callback.json.gz DEBUG: Setup failed for 69bd245805e4bbd6ba6360da. Transitting job node result: incomplete -> fail 2026-03-20 11:01:33,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:01:33,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd245805e4bbd6ba6360da HTTP/1.1" 200 None 2026-03-20 11:01:33,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:01:33,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 11:01:33,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:01:33,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd245805e4bbd6ba6360da HTTP/1.1" 200 None 2026-03-20 11:01:33,840 - lava_callback - INFO - Completed processing callback for node 69bd245805e4bbd6ba6360da INFO: 172.21.0.1:43492 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:01:39,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:01:39,704 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:48760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:02:31,797 - lava_callback - INFO - Received callback for node 69ba8644537ae4d3c8237efa INFO: 172.21.0.1:33248 - "POST /node/69ba8644537ae4d3c8237efa HTTP/1.0" 202 Accepted 2026-03-20 11:02:31,802 - lava_callback - INFO - Starting async job submit for node 69ba8644537ae4d3c8237efa 2026-03-20 11:02:31,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:02:31,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8644537ae4d3c8237efa HTTP/1.1" 200 None 2026-03-20 11:02:31,819 - lava_callback - DEBUG - Processing node 69ba8644537ae4d3c8237efa: baseline-arm64-baylibre 2026-03-20 11:02:31,819 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8644537ae4d3c8237efa 2026-03-20 11:02:31,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:02:31,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8644537ae4d3c8237efa HTTP/1.1" 200 None 2026-03-20 11:02:31,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:02:31,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 11:02:31,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:02:31,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8644537ae4d3c8237efa HTTP/1.1" 200 None 2026-03-20 11:02:31,874 - lava_callback - ERROR - Error processing callback for node 69ba8644537ae4d3c8237efa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47020 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:03:51,800 - lava_callback - INFO - Received callback for node 69ba8696537ae4d3c8237f06 INFO: 172.21.0.1:47028 - "POST /node/69ba8696537ae4d3c8237f06 HTTP/1.0" 202 Accepted 2026-03-20 11:03:51,806 - lava_callback - INFO - Starting async job submit for node 69ba8696537ae4d3c8237f06 2026-03-20 11:03:51,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:03:51,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8696537ae4d3c8237f06 HTTP/1.1" 200 None 2026-03-20 11:03:51,826 - lava_callback - DEBUG - Processing node 69ba8696537ae4d3c8237f06: baseline-arm64-baylibre 2026-03-20 11:03:51,826 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8696537ae4d3c8237f06 2026-03-20 11:03:51,827 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:03:51,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8696537ae4d3c8237f06 HTTP/1.1" 200 None 2026-03-20 11:03:51,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:03:51,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 11:03:51,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:03:51,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8696537ae4d3c8237f06 HTTP/1.1" 200 None 2026-03-20 11:03:51,883 - lava_callback - ERROR - Error processing callback for node 69ba8696537ae4d3c8237f06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36998 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:05:31,876 - lava_callback - INFO - Received callback for node 69ba86e8537ae4d3c8237f13 INFO: 172.21.0.1:41740 - "POST /node/69ba86e8537ae4d3c8237f13 HTTP/1.0" 202 Accepted 2026-03-20 11:05:31,882 - lava_callback - INFO - Starting async job submit for node 69ba86e8537ae4d3c8237f13 2026-03-20 11:05:31,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:05:31,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba86e8537ae4d3c8237f13 HTTP/1.1" 200 None 2026-03-20 11:05:31,899 - lava_callback - DEBUG - Processing node 69ba86e8537ae4d3c8237f13: baseline-arm64-baylibre 2026-03-20 11:05:31,899 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba86e8537ae4d3c8237f13 2026-03-20 11:05:31,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:05:31,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba86e8537ae4d3c8237f13 HTTP/1.1" 200 None 2026-03-20 11:05:31,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:05:31,957 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 11:05:31,959 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:05:31,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba86e8537ae4d3c8237f13 HTTP/1.1" 200 None 2026-03-20 11:05:31,982 - lava_callback - ERROR - Error processing callback for node 69ba86e8537ae4d3c8237f13: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:41754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41314 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39766 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:06:52,011 - lava_callback - INFO - Received callback for node 69ba873b537ae4d3c8237f17 INFO: 172.21.0.1:39770 - "POST /node/69ba873b537ae4d3c8237f17 HTTP/1.0" 202 Accepted 2026-03-20 11:06:52,017 - lava_callback - INFO - Starting async job submit for node 69ba873b537ae4d3c8237f17 2026-03-20 11:06:52,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:06:52,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba873b537ae4d3c8237f17 HTTP/1.1" 200 None 2026-03-20 11:06:52,035 - lava_callback - DEBUG - Processing node 69ba873b537ae4d3c8237f17: baseline-arm64-baylibre 2026-03-20 11:06:52,035 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba873b537ae4d3c8237f17 2026-03-20 11:06:52,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:06:52,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba873b537ae4d3c8237f17 HTTP/1.1" 200 None 2026-03-20 11:06:52,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:06:52,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 11:06:52,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:06:52,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba873b537ae4d3c8237f17 HTTP/1.1" 200 None 2026-03-20 11:06:52,097 - lava_callback - ERROR - Error processing callback for node 69ba873b537ae4d3c8237f17: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53408 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46320 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-20 11:08:16,431 - lava_callback - INFO - Received callback for node 69ba8793537ae4d3c8237f20 INFO: 172.21.0.1:46330 - "POST /node/69ba8793537ae4d3c8237f20 HTTP/1.0" 202 Accepted 2026-03-20 11:08:16,436 - lava_callback - INFO - Starting async job submit for node 69ba8793537ae4d3c8237f20 2026-03-20 11:08:16,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:08:16,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8793537ae4d3c8237f20 HTTP/1.1" 200 None 2026-03-20 11:08:16,453 - lava_callback - DEBUG - Processing node 69ba8793537ae4d3c8237f20: baseline-arm64-clabbe 2026-03-20 11:08:16,453 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8793537ae4d3c8237f20 2026-03-20 11:08:16,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:08:16,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8793537ae4d3c8237f20 HTTP/1.1" 200 None 2026-03-20 11:08:16,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:08:16,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 11:08:16,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:08:16,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8793537ae4d3c8237f20 HTTP/1.1" 200 None 2026-03-20 11:08:16,511 - lava_callback - ERROR - Error processing callback for node 69ba8793537ae4d3c8237f20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58394 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:09:36,431 - lava_callback - INFO - Received callback for node 69ba87e6537ae4d3c8237f2a INFO: 172.21.0.1:56150 - "POST /node/69ba87e6537ae4d3c8237f2a HTTP/1.0" 202 Accepted 2026-03-20 11:09:36,437 - lava_callback - INFO - Starting async job submit for node 69ba87e6537ae4d3c8237f2a 2026-03-20 11:09:36,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:09:36,453 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba87e6537ae4d3c8237f2a HTTP/1.1" 200 None 2026-03-20 11:09:36,453 - lava_callback - DEBUG - Processing node 69ba87e6537ae4d3c8237f2a: baseline-arm64-clabbe 2026-03-20 11:09:36,454 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba87e6537ae4d3c8237f2a 2026-03-20 11:09:36,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:09:36,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba87e6537ae4d3c8237f2a HTTP/1.1" 200 None 2026-03-20 11:09:36,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:09:36,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 11:09:36,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:56164 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:09:36,564 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba87e6537ae4d3c8237f2a HTTP/1.1" 200 None 2026-03-20 11:09:36,569 - lava_callback - ERROR - Error processing callback for node 69ba87e6537ae4d3c8237f2a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52970 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:10:56,487 - lava_callback - INFO - Received callback for node 69ba883a537ae4d3c8237f33 INFO: 172.21.0.1:52980 - "POST /node/69ba883a537ae4d3c8237f33 HTTP/1.0" 202 Accepted 2026-03-20 11:10:56,493 - lava_callback - INFO - Starting async job submit for node 69ba883a537ae4d3c8237f33 2026-03-20 11:10:56,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:10:56,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba883a537ae4d3c8237f33 HTTP/1.1" 200 None 2026-03-20 11:10:56,509 - lava_callback - DEBUG - Processing node 69ba883a537ae4d3c8237f33: baseline-arm64-clabbe 2026-03-20 11:10:56,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba883a537ae4d3c8237f33 2026-03-20 11:10:56,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:10:56,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba883a537ae4d3c8237f33 HTTP/1.1" 200 None 2026-03-20 11:10:56,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:10:56,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 11:10:56,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:52992 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:10:56,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba883a537ae4d3c8237f33 HTTP/1.1" 200 None 2026-03-20 11:10:56,567 - lava_callback - ERROR - Error processing callback for node 69ba883a537ae4d3c8237f33: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56470 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:11:33,252 - lava_callback - INFO - Received callback for node 69bd23c705e4bbd6ba636088 INFO: 172.21.0.1:45962 - "POST /node/69bd23c705e4bbd6ba636088 HTTP/1.0" 202 Accepted 2026-03-20 11:11:33,257 - lava_callback - INFO - Starting async job submit for node 69bd23c705e4bbd6ba636088 2026-03-20 11:11:33,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:11:33,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd23c705e4bbd6ba636088 HTTP/1.1" 200 None 2026-03-20 11:11:33,292 - lava_callback - DEBUG - Processing node 69bd23c705e4bbd6ba636088: baseline-arm64-broonie 2026-03-20 11:11:33,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:11:33,502 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:11:33,504 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd23c705e4bbd6ba636088/log.txt.gz 2026-03-20 11:11:33,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:11:33,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:11:33,721 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd23c705e4bbd6ba636088/lava-logs.yaml 2026-03-20 11:11:33,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:11:33,861 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:11:33,863 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd23c705e4bbd6ba636088/lava_callback.json.gz 2026-03-20 11:11:33,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:11:33,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd23c705e4bbd6ba636088 HTTP/1.1" 200 None 2026-03-20 11:11:33,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:11:33,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 11:11:33,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:11:33,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd23c705e4bbd6ba636088 HTTP/1.1" 200 None 2026-03-20 11:11:34,037 - lava_callback - INFO - Completed processing callback for node 69bd23c705e4bbd6ba636088 INFO: 172.21.0.1:45964 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:11:39,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:11:39,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:54194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44016 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-20 11:12:16,526 - lava_callback - INFO - Received callback for node 69ba888c537ae4d3c8237f41 INFO: 172.21.0.1:44018 - "POST /node/69ba888c537ae4d3c8237f41 HTTP/1.0" 202 Accepted 2026-03-20 11:12:16,532 - lava_callback - INFO - Starting async job submit for node 69ba888c537ae4d3c8237f41 2026-03-20 11:12:16,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.21.0.1:44024 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:12:16,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba888c537ae4d3c8237f41 HTTP/1.1" 200 None 2026-03-20 11:12:16,548 - lava_callback - DEBUG - Processing node 69ba888c537ae4d3c8237f41: baseline-arm64-clabbe 2026-03-20 11:12:16,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba888c537ae4d3c8237f41 2026-03-20 11:12:16,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:12:16,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba888c537ae4d3c8237f41 HTTP/1.1" 200 None 2026-03-20 11:12:16,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:12:16,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 11:12:16,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:12:16,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba888c537ae4d3c8237f41 HTTP/1.1" 200 None 2026-03-20 11:12:16,600 - lava_callback - ERROR - Error processing callback for node 69ba888c537ae4d3c8237f41: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58106 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57150 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:13:56,586 - lava_callback - INFO - Received callback for node 69ba88de537ae4d3c8237f46 INFO: 172.21.0.1:57164 - "POST /node/69ba88de537ae4d3c8237f46 HTTP/1.0" 202 Accepted 2026-03-20 11:13:56,592 - lava_callback - INFO - Starting async job submit for node 69ba88de537ae4d3c8237f46 2026-03-20 11:13:56,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:13:56,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba88de537ae4d3c8237f46 HTTP/1.1" 200 None 2026-03-20 11:13:56,608 - lava_callback - DEBUG - Processing node 69ba88de537ae4d3c8237f46: baseline-arm64-clabbe 2026-03-20 11:13:56,608 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba88de537ae4d3c8237f46 2026-03-20 11:13:56,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:13:56,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba88de537ae4d3c8237f46 HTTP/1.1" 200 None 2026-03-20 11:13:56,625 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:13:56,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 11:13:56,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:13:56,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba88de537ae4d3c8237f46 HTTP/1.1" 200 None 2026-03-20 11:13:56,662 - lava_callback - ERROR - Error processing callback for node 69ba88de537ae4d3c8237f46: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:15:16,611 - lava_callback - INFO - Received callback for node 69ba8930537ae4d3c8237f50 INFO: 172.21.0.1:51284 - "POST /node/69ba8930537ae4d3c8237f50 HTTP/1.0" 202 Accepted 2026-03-20 11:15:16,616 - lava_callback - INFO - Starting async job submit for node 69ba8930537ae4d3c8237f50 2026-03-20 11:15:16,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:15:16,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8930537ae4d3c8237f50 HTTP/1.1" 200 None 2026-03-20 11:15:16,631 - lava_callback - DEBUG - Processing node 69ba8930537ae4d3c8237f50: baseline-arm64-clabbe 2026-03-20 11:15:16,632 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8930537ae4d3c8237f50 2026-03-20 11:15:16,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:15:16,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8930537ae4d3c8237f50 HTTP/1.1" 200 None 2026-03-20 11:15:16,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:15:16,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd7000b80c8ffdcb82ae HTTP/1.1" 200 None 2026-03-20 11:15:16,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:15:16,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8930537ae4d3c8237f50 HTTP/1.1" 200 None 2026-03-20 11:15:16,684 - lava_callback - ERROR - Error processing callback for node 69ba8930537ae4d3c8237f50: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38250 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:16:32,617 - lava_callback - INFO - Received callback for node 69ba897b537ae4d3c8237f59 INFO: 172.21.0.1:39756 - "POST /node/69ba897b537ae4d3c8237f59 HTTP/1.0" 202 Accepted 2026-03-20 11:16:32,623 - lava_callback - INFO - Starting async job submit for node 69ba897b537ae4d3c8237f59 2026-03-20 11:16:32,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:16:32,639 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba897b537ae4d3c8237f59 HTTP/1.1" 200 None 2026-03-20 11:16:32,639 - lava_callback - DEBUG - Processing node 69ba897b537ae4d3c8237f59: baseline-arm64-baylibre 2026-03-20 11:16:32,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba897b537ae4d3c8237f59 2026-03-20 11:16:32,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:16:32,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba897b537ae4d3c8237f59 HTTP/1.1" 200 None 2026-03-20 11:16:32,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:16:32,680 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 11:16:32,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:16:32,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba897b537ae4d3c8237f59 HTTP/1.1" 200 None 2026-03-20 11:16:32,703 - lava_callback - ERROR - Error processing callback for node 69ba897b537ae4d3c8237f59: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:39770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52422 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:17:56,780 - lava_callback - INFO - Received callback for node 69ba89d3537ae4d3c8237f62 INFO: 172.21.0.1:52432 - "POST /node/69ba89d3537ae4d3c8237f62 HTTP/1.0" 202 Accepted 2026-03-20 11:17:56,786 - lava_callback - INFO - Starting async job submit for node 69ba89d3537ae4d3c8237f62 2026-03-20 11:17:56,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:17:56,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba89d3537ae4d3c8237f62 HTTP/1.1" 200 None 2026-03-20 11:17:56,802 - lava_callback - DEBUG - Processing node 69ba89d3537ae4d3c8237f62: baseline-arm64-clabbe 2026-03-20 11:17:56,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba89d3537ae4d3c8237f62 2026-03-20 11:17:56,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:17:56,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba89d3537ae4d3c8237f62 HTTP/1.1" 200 None 2026-03-20 11:17:56,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:17:56,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 11:17:56,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:17:56,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba89d3537ae4d3c8237f62 HTTP/1.1" 200 None 2026-03-20 11:17:56,878 - lava_callback - ERROR - Error processing callback for node 69ba89d3537ae4d3c8237f62: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32770 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:19:16,831 - lava_callback - INFO - Received callback for node 69ba8a25537ae4d3c8237f67 INFO: 172.21.0.1:32792 - "POST /node/69ba8a25537ae4d3c8237f67 HTTP/1.0" 202 Accepted 2026-03-20 11:19:16,837 - lava_callback - INFO - Starting async job submit for node 69ba8a25537ae4d3c8237f67 2026-03-20 11:19:16,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:19:16,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8a25537ae4d3c8237f67 HTTP/1.1" 200 None 2026-03-20 11:19:16,865 - lava_callback - DEBUG - Processing node 69ba8a25537ae4d3c8237f67: baseline-arm64-clabbe 2026-03-20 11:19:16,865 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8a25537ae4d3c8237f67 2026-03-20 11:19:16,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:19:16,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8a25537ae4d3c8237f67 HTTP/1.1" 200 None 2026-03-20 11:19:16,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:19:16,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 11:19:16,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:19:16,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8a25537ae4d3c8237f67 HTTP/1.1" 200 None 2026-03-20 11:19:16,964 - lava_callback - ERROR - Error processing callback for node 69ba8a25537ae4d3c8237f67: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58768 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55742 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:20:36,816 - lava_callback - INFO - Received callback for node 69ba8a78537ae4d3c8237f71 INFO: 172.21.0.1:55744 - "POST /node/69ba8a78537ae4d3c8237f71 HTTP/1.0" 202 Accepted 2026-03-20 11:20:36,821 - lava_callback - INFO - Starting async job submit for node 69ba8a78537ae4d3c8237f71 2026-03-20 11:20:36,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:20:36,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8a78537ae4d3c8237f71 HTTP/1.1" 200 None 2026-03-20 11:20:36,837 - lava_callback - DEBUG - Processing node 69ba8a78537ae4d3c8237f71: baseline-arm64-clabbe 2026-03-20 11:20:36,838 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8a78537ae4d3c8237f71 2026-03-20 11:20:36,838 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:20:36,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8a78537ae4d3c8237f71 HTTP/1.1" 200 None 2026-03-20 11:20:36,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:20:36,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 11:20:36,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:20:36,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8a78537ae4d3c8237f71 HTTP/1.1" 200 None 2026-03-20 11:20:36,892 - lava_callback - ERROR - Error processing callback for node 69ba8a78537ae4d3c8237f71: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49236 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48300 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:21:56,894 - lava_callback - INFO - Received callback for node 69ba8aca537ae4d3c8237f7a INFO: 172.21.0.1:48316 - "POST /node/69ba8aca537ae4d3c8237f7a HTTP/1.0" 202 Accepted 2026-03-20 11:21:56,900 - lava_callback - INFO - Starting async job submit for node 69ba8aca537ae4d3c8237f7a 2026-03-20 11:21:56,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:21:56,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8aca537ae4d3c8237f7a HTTP/1.1" 200 None 2026-03-20 11:21:56,938 - lava_callback - DEBUG - Processing node 69ba8aca537ae4d3c8237f7a: baseline-arm64-clabbe 2026-03-20 11:21:56,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8aca537ae4d3c8237f7a 2026-03-20 11:21:56,939 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:21:56,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8aca537ae4d3c8237f7a HTTP/1.1" 200 None 2026-03-20 11:21:56,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:21:57,012 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 11:21:57,014 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:21:57,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8aca537ae4d3c8237f7a HTTP/1.1" 200 None 2026-03-20 11:21:57,063 - lava_callback - ERROR - Error processing callback for node 69ba8aca537ae4d3c8237f7a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46524 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:23:16,943 - lava_callback - INFO - Received callback for node 69ba8b1c537ae4d3c8237f7f INFO: 172.21.0.1:46534 - "POST /node/69ba8b1c537ae4d3c8237f7f HTTP/1.0" 202 Accepted 2026-03-20 11:23:16,949 - lava_callback - INFO - Starting async job submit for node 69ba8b1c537ae4d3c8237f7f 2026-03-20 11:23:16,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:23:16,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8b1c537ae4d3c8237f7f HTTP/1.1" 200 None 2026-03-20 11:23:16,965 - lava_callback - DEBUG - Processing node 69ba8b1c537ae4d3c8237f7f: baseline-arm64-clabbe 2026-03-20 11:23:16,965 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8b1c537ae4d3c8237f7f 2026-03-20 11:23:16,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:23:16,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8b1c537ae4d3c8237f7f HTTP/1.1" 200 None 2026-03-20 11:23:16,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:23:16,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 11:23:16,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:23:17,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8b1c537ae4d3c8237f7f HTTP/1.1" 200 None 2026-03-20 11:23:17,022 - lava_callback - ERROR - Error processing callback for node 69ba8b1c537ae4d3c8237f7f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46606 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52428 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:24:37,025 - lava_callback - INFO - Received callback for node 69ba8b6e537ae4d3c8237f88 INFO: 172.21.0.1:52438 - "POST /node/69ba8b6e537ae4d3c8237f88 HTTP/1.0" 202 Accepted 2026-03-20 11:24:37,031 - lava_callback - INFO - Starting async job submit for node 69ba8b6e537ae4d3c8237f88 2026-03-20 11:24:37,032 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:24:37,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8b6e537ae4d3c8237f88 HTTP/1.1" 200 None 2026-03-20 11:24:37,070 - lava_callback - DEBUG - Processing node 69ba8b6e537ae4d3c8237f88: baseline-arm64-clabbe 2026-03-20 11:24:37,070 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba8b6e537ae4d3c8237f88 2026-03-20 11:24:37,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:24:37,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba8b6e537ae4d3c8237f88 HTTP/1.1" 200 None 2026-03-20 11:24:37,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:24:37,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9748e151254d948eee9ff HTTP/1.1" 200 None 2026-03-20 11:24:37,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:24:37,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba8b6e537ae4d3c8237f88 HTTP/1.1" 200 None 2026-03-20 11:24:37,134 - lava_callback - ERROR - Error processing callback for node 69ba8b6e537ae4d3c8237f88: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36196 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51148 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54534 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39732 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48958 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35978 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57952 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45824 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34744 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:43:34,952 - lava_callback - INFO - Received callback for node 69bd2b9e05e4bbd6ba63619a INFO: 172.21.0.1:56670 - "POST /node/69bd2b9e05e4bbd6ba63619a HTTP/1.0" 202 Accepted 2026-03-20 11:43:34,957 - lava_callback - INFO - Starting async job submit for node 69bd2b9e05e4bbd6ba63619a 2026-03-20 11:43:34,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:43:35,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd2b9e05e4bbd6ba63619a HTTP/1.1" 200 None 2026-03-20 11:43:35,010 - lava_callback - DEBUG - Processing node 69bd2b9e05e4bbd6ba63619a: baseline-arm64-broonie 2026-03-20 11:43:35,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:43:35,254 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:43:35,256 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd2b9e05e4bbd6ba63619a/log.txt.gz 2026-03-20 11:43:35,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:43:35,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:43:35,451 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd2b9e05e4bbd6ba63619a/lava-logs.yaml 2026-03-20 11:43:35,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 11:43:35,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 11:43:35,594 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bd2b9e05e4bbd6ba63619a/lava_callback.json.gz 2026-03-20 11:43:35,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:43:35,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd2b9e05e4bbd6ba63619a HTTP/1.1" 200 None 2026-03-20 11:43:35,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:43:35,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bd027905e4bbd6ba634c66 HTTP/1.1" 200 None 2026-03-20 11:43:35,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:43:35,695 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bd2b9e05e4bbd6ba63619a HTTP/1.1" 200 None 2026-03-20 11:43:35,741 - lava_callback - INFO - Completed processing callback for node 69bd2b9e05e4bbd6ba63619a INFO: 172.21.0.1:56684 - "GET / HTTP/1.0" 200 OK 2026-03-20 11:43:39,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 11:43:39,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:53662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40068 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49884 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60052 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55500 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59844 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43920 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59446 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60258 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51668 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59626 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39942 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58600 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34926 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35034 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60486 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34150 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43178 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55732 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36350 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51536 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36250 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54402 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53988 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46470 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35056 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49042 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55346 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39280 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42614 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55032 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46274 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54214 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45802 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48526 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:48:37,662 - lava_callback - INFO - Received callback for node 69ba9f17537ae4d3c8237fb2 INFO: 172.21.0.1:48534 - "POST /node/69ba9f17537ae4d3c8237fb2 HTTP/1.0" 202 Accepted 2026-03-20 12:48:37,667 - lava_callback - INFO - Starting async job submit for node 69ba9f17537ae4d3c8237fb2 2026-03-20 12:48:37,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:48:37,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9f17537ae4d3c8237fb2 HTTP/1.1" 200 None 2026-03-20 12:48:37,684 - lava_callback - DEBUG - Processing node 69ba9f17537ae4d3c8237fb2: baseline-arm-baylibre 2026-03-20 12:48:37,684 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba9f17537ae4d3c8237fb2 2026-03-20 12:48:37,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:48:37,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9f17537ae4d3c8237fb2 HTTP/1.1" 200 None 2026-03-20 12:48:37,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:48:37,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-20 12:48:37,731 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:48:37,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba9f17537ae4d3c8237fb2 HTTP/1.1" 200 None 2026-03-20 12:48:37,754 - lava_callback - ERROR - Error processing callback for node 69ba9f17537ae4d3c8237fb2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40694 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:49:17,614 - lava_callback - INFO - Received callback for node 69ba9f3c537ae4d3c8237fcf INFO: 172.21.0.1:40708 - "POST /node/69ba9f3c537ae4d3c8237fcf HTTP/1.0" 202 Accepted 2026-03-20 12:49:17,620 - lava_callback - INFO - Starting async job submit for node 69ba9f3c537ae4d3c8237fcf 2026-03-20 12:49:17,621 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:49:17,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9f3c537ae4d3c8237fcf HTTP/1.1" 200 None 2026-03-20 12:49:17,636 - lava_callback - DEBUG - Processing node 69ba9f3c537ae4d3c8237fcf: baseline-arm-baylibre 2026-03-20 12:49:17,636 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba9f3c537ae4d3c8237fcf 2026-03-20 12:49:17,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:49:17,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9f3c537ae4d3c8237fcf HTTP/1.1" 200 None 2026-03-20 12:49:17,655 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:49:17,673 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-20 12:49:17,675 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:49:17,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba9f3c537ae4d3c8237fcf HTTP/1.1" 200 None 2026-03-20 12:49:17,708 - lava_callback - ERROR - Error processing callback for node 69ba9f3c537ae4d3c8237fcf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40758 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:49:57,940 - lava_callback - INFO - Received callback for node 69ba9f60537ae4d3c8237fd7 INFO: 172.21.0.1:40772 - "POST /node/69ba9f60537ae4d3c8237fd7 HTTP/1.0" 202 Accepted 2026-03-20 12:49:57,945 - lava_callback - INFO - Starting async job submit for node 69ba9f60537ae4d3c8237fd7 2026-03-20 12:49:57,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:49:57,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9f60537ae4d3c8237fd7 HTTP/1.1" 200 None 2026-03-20 12:49:57,961 - lava_callback - DEBUG - Processing node 69ba9f60537ae4d3c8237fd7: baseline-arm-baylibre 2026-03-20 12:49:57,961 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba9f60537ae4d3c8237fd7 2026-03-20 12:49:57,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:49:57,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9f60537ae4d3c8237fd7 HTTP/1.1" 200 None 2026-03-20 12:49:57,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:49:57,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-20 12:49:57,991 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:49:58,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba9f60537ae4d3c8237fd7 HTTP/1.1" 200 None 2026-03-20 12:49:58,015 - lava_callback - ERROR - Error processing callback for node 69ba9f60537ae4d3c8237fd7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50264 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50280 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:50:17,647 - lava_callback - INFO - Received callback for node 69ba9f84537ae4d3c8237fe2 INFO: 172.21.0.1:50290 - "POST /node/69ba9f84537ae4d3c8237fe2 HTTP/1.0" 202 Accepted 2026-03-20 12:50:17,653 - lava_callback - INFO - Starting async job submit for node 69ba9f84537ae4d3c8237fe2 2026-03-20 12:50:17,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:50:17,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9f84537ae4d3c8237fe2 HTTP/1.1" 200 None 2026-03-20 12:50:17,685 - lava_callback - DEBUG - Processing node 69ba9f84537ae4d3c8237fe2: baseline-arm-baylibre 2026-03-20 12:50:17,685 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba9f84537ae4d3c8237fe2 2026-03-20 12:50:17,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:50:17,699 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9f84537ae4d3c8237fe2 HTTP/1.1" 200 None 2026-03-20 12:50:17,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:50:17,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-20 12:50:17,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:50:17,736 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba9f84537ae4d3c8237fe2 HTTP/1.1" 200 None 2026-03-20 12:50:17,745 - lava_callback - ERROR - Error processing callback for node 69ba9f84537ae4d3c8237fe2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51978 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:50:57,686 - lava_callback - INFO - Received callback for node 69ba9fa8537ae4d3c8237feb INFO: 172.21.0.1:51984 - "POST /node/69ba9fa8537ae4d3c8237feb HTTP/1.0" 202 Accepted 2026-03-20 12:50:57,691 - lava_callback - INFO - Starting async job submit for node 69ba9fa8537ae4d3c8237feb 2026-03-20 12:50:57,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:50:57,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9fa8537ae4d3c8237feb HTTP/1.1" 200 None 2026-03-20 12:50:57,707 - lava_callback - DEBUG - Processing node 69ba9fa8537ae4d3c8237feb: baseline-arm-baylibre 2026-03-20 12:50:57,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba9fa8537ae4d3c8237feb 2026-03-20 12:50:57,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:50:57,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9fa8537ae4d3c8237feb HTTP/1.1" 200 None 2026-03-20 12:50:57,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:50:57,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-20 12:50:57,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:50:57,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba9fa8537ae4d3c8237feb HTTP/1.1" 200 None 2026-03-20 12:50:57,762 - lava_callback - ERROR - Error processing callback for node 69ba9fa8537ae4d3c8237feb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48086 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36662 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:51:37,792 - lava_callback - INFO - Received callback for node 69ba9fcd537ae4d3c8237ff4 INFO: 172.21.0.1:36664 - "POST /node/69ba9fcd537ae4d3c8237ff4 HTTP/1.0" 202 Accepted 2026-03-20 12:51:37,797 - lava_callback - INFO - Starting async job submit for node 69ba9fcd537ae4d3c8237ff4 2026-03-20 12:51:37,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:51:37,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9fcd537ae4d3c8237ff4 HTTP/1.1" 200 None 2026-03-20 12:51:37,824 - lava_callback - DEBUG - Processing node 69ba9fcd537ae4d3c8237ff4: baseline-arm-baylibre 2026-03-20 12:51:37,824 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba9fcd537ae4d3c8237ff4 2026-03-20 12:51:37,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:51:37,868 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9fcd537ae4d3c8237ff4 HTTP/1.1" 200 None 2026-03-20 12:51:37,869 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:51:37,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-20 12:51:37,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:51:37,913 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba9fcd537ae4d3c8237ff4 HTTP/1.1" 200 None 2026-03-20 12:51:37,922 - lava_callback - ERROR - Error processing callback for node 69ba9fcd537ae4d3c8237ff4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34788 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:52:20,550 - lava_callback - INFO - Received callback for node 69ba9ff2537ae4d3c8237ffd INFO: 172.21.0.1:55910 - "POST /node/69ba9ff2537ae4d3c8237ffd HTTP/1.0" 202 Accepted 2026-03-20 12:52:20,555 - lava_callback - INFO - Starting async job submit for node 69ba9ff2537ae4d3c8237ffd 2026-03-20 12:52:20,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:52:20,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9ff2537ae4d3c8237ffd HTTP/1.1" 200 None 2026-03-20 12:52:20,572 - lava_callback - DEBUG - Processing node 69ba9ff2537ae4d3c8237ffd: baseline-arm-clabbe 2026-03-20 12:52:20,572 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69ba9ff2537ae4d3c8237ffd 2026-03-20 12:52:20,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:52:20,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba9ff2537ae4d3c8237ffd HTTP/1.1" 200 None 2026-03-20 12:52:20,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:52:20,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-20 12:52:20,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:52:20,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69ba9ff2537ae4d3c8237ffd HTTP/1.1" 200 None 2026-03-20 12:52:20,646 - lava_callback - ERROR - Error processing callback for node 69ba9ff2537ae4d3c8237ffd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41580 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:53:00,520 - lava_callback - INFO - Received callback for node 69baa016537ae4d3c8238006 INFO: 172.21.0.1:47370 - "POST /node/69baa016537ae4d3c8238006 HTTP/1.0" 202 Accepted 2026-03-20 12:53:00,525 - lava_callback - INFO - Starting async job submit for node 69baa016537ae4d3c8238006 2026-03-20 12:53:00,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:53:00,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa016537ae4d3c8238006 HTTP/1.1" 200 None 2026-03-20 12:53:00,582 - lava_callback - DEBUG - Processing node 69baa016537ae4d3c8238006: baseline-arm-clabbe 2026-03-20 12:53:00,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa016537ae4d3c8238006 2026-03-20 12:53:00,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:53:00,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa016537ae4d3c8238006 HTTP/1.1" 200 None 2026-03-20 12:53:00,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:53:00,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-20 12:53:00,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:53:00,633 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa016537ae4d3c8238006 HTTP/1.1" 200 None 2026-03-20 12:53:00,643 - lava_callback - ERROR - Error processing callback for node 69baa016537ae4d3c8238006: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47372 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59078 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:53:20,770 - lava_callback - INFO - Received callback for node 69baa03a537ae4d3c8238013 INFO: 172.21.0.1:35400 - "POST /node/69baa03a537ae4d3c8238013 HTTP/1.0" 202 Accepted 2026-03-20 12:53:20,776 - lava_callback - INFO - Starting async job submit for node 69baa03a537ae4d3c8238013 2026-03-20 12:53:20,776 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:53:20,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa03a537ae4d3c8238013 HTTP/1.1" 200 None 2026-03-20 12:53:20,793 - lava_callback - DEBUG - Processing node 69baa03a537ae4d3c8238013: baseline-arm-clabbe 2026-03-20 12:53:20,793 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa03a537ae4d3c8238013 2026-03-20 12:53:20,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:53:20,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa03a537ae4d3c8238013 HTTP/1.1" 200 None 2026-03-20 12:53:20,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:53:20,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-20 12:53:20,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:53:20,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa03a537ae4d3c8238013 HTTP/1.1" 200 None 2026-03-20 12:53:20,847 - lava_callback - ERROR - Error processing callback for node 69baa03a537ae4d3c8238013: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47818 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:54:00,569 - lava_callback - INFO - Received callback for node 69baa05e537ae4d3c823801a INFO: 172.21.0.1:44354 - "POST /node/69baa05e537ae4d3c823801a HTTP/1.0" 202 Accepted 2026-03-20 12:54:00,575 - lava_callback - INFO - Starting async job submit for node 69baa05e537ae4d3c823801a 2026-03-20 12:54:00,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:54:00,591 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa05e537ae4d3c823801a HTTP/1.1" 200 None 2026-03-20 12:54:00,591 - lava_callback - DEBUG - Processing node 69baa05e537ae4d3c823801a: baseline-arm-clabbe 2026-03-20 12:54:00,592 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa05e537ae4d3c823801a 2026-03-20 12:54:00,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:54:00,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa05e537ae4d3c823801a HTTP/1.1" 200 None 2026-03-20 12:54:00,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:54:00,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-20 12:54:00,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:54:00,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa05e537ae4d3c823801a HTTP/1.1" 200 None 2026-03-20 12:54:00,661 - lava_callback - ERROR - Error processing callback for node 69baa05e537ae4d3c823801a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37020 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:54:40,624 - lava_callback - INFO - Received callback for node 69baa082537ae4d3c8238025 INFO: 172.21.0.1:52650 - "POST /node/69baa082537ae4d3c8238025 HTTP/1.0" 202 Accepted 2026-03-20 12:54:40,630 - lava_callback - INFO - Starting async job submit for node 69baa082537ae4d3c8238025 2026-03-20 12:54:40,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:54:40,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa082537ae4d3c8238025 HTTP/1.1" 200 None 2026-03-20 12:54:40,647 - lava_callback - DEBUG - Processing node 69baa082537ae4d3c8238025: baseline-arm-clabbe 2026-03-20 12:54:40,647 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa082537ae4d3c8238025 2026-03-20 12:54:40,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:54:40,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa082537ae4d3c8238025 HTTP/1.1" 200 None 2026-03-20 12:54:40,663 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:54:40,686 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e96f113612b7716b9dee HTTP/1.1" 200 None 2026-03-20 12:54:40,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:54:40,708 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa082537ae4d3c8238025 HTTP/1.1" 200 None 2026-03-20 12:54:40,709 - lava_callback - ERROR - Error processing callback for node 69baa082537ae4d3c8238025: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42944 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47888 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:56:18,035 - lava_callback - INFO - Received callback for node 69baa0e6537ae4d3c8238046 INFO: 172.21.0.1:47898 - "POST /node/69baa0e6537ae4d3c8238046 HTTP/1.0" 202 Accepted 2026-03-20 12:56:18,041 - lava_callback - INFO - Starting async job submit for node 69baa0e6537ae4d3c8238046 2026-03-20 12:56:18,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:56:18,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa0e6537ae4d3c8238046 HTTP/1.1" 200 None 2026-03-20 12:56:18,058 - lava_callback - DEBUG - Processing node 69baa0e6537ae4d3c8238046: baseline-arm-baylibre 2026-03-20 12:56:18,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa0e6537ae4d3c8238046 2026-03-20 12:56:18,058 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:56:18,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa0e6537ae4d3c8238046 HTTP/1.1" 200 None 2026-03-20 12:56:18,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:56:18,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None 2026-03-20 12:56:18,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:56:18,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa0e6537ae4d3c8238046 HTTP/1.1" 200 None 2026-03-20 12:56:18,123 - lava_callback - ERROR - Error processing callback for node 69baa0e6537ae4d3c8238046: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:36346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42004 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43902 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:56:57,999 - lava_callback - INFO - Received callback for node 69baa10a537ae4d3c8238053 INFO: 172.21.0.1:43910 - "POST /node/69baa10a537ae4d3c8238053 HTTP/1.0" 202 Accepted 2026-03-20 12:56:58,005 - lava_callback - INFO - Starting async job submit for node 69baa10a537ae4d3c8238053 2026-03-20 12:56:58,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:56:58,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa10a537ae4d3c8238053 HTTP/1.1" 200 None 2026-03-20 12:56:58,021 - lava_callback - DEBUG - Processing node 69baa10a537ae4d3c8238053: baseline-arm-baylibre 2026-03-20 12:56:58,021 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa10a537ae4d3c8238053 2026-03-20 12:56:58,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:56:58,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa10a537ae4d3c8238053 HTTP/1.1" 200 None 2026-03-20 12:56:58,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:56:58,050 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None 2026-03-20 12:56:58,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:56:58,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa10a537ae4d3c8238053 HTTP/1.1" 200 None 2026-03-20 12:56:58,074 - lava_callback - ERROR - Error processing callback for node 69baa10a537ae4d3c8238053: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58972 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:57:38,092 - lava_callback - INFO - Received callback for node 69baa138537ae4d3c8238060 INFO: 172.21.0.1:58978 - "POST /node/69baa138537ae4d3c8238060 HTTP/1.0" 202 Accepted 2026-03-20 12:57:38,097 - lava_callback - INFO - Starting async job submit for node 69baa138537ae4d3c8238060 2026-03-20 12:57:38,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:57:38,131 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa138537ae4d3c8238060 HTTP/1.1" 200 None 2026-03-20 12:57:38,132 - lava_callback - DEBUG - Processing node 69baa138537ae4d3c8238060: baseline-arm-baylibre 2026-03-20 12:57:38,132 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa138537ae4d3c8238060 2026-03-20 12:57:38,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:57:38,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa138537ae4d3c8238060 HTTP/1.1" 200 None 2026-03-20 12:57:38,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:57:38,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None 2026-03-20 12:57:38,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:57:38,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa138537ae4d3c8238060 HTTP/1.1" 200 None 2026-03-20 12:57:38,193 - lava_callback - ERROR - Error processing callback for node 69baa138537ae4d3c8238060: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38484 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41968 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:58:18,048 - lava_callback - INFO - Received callback for node 69baa15b537ae4d3c823806b INFO: 172.21.0.1:41980 - "POST /node/69baa15b537ae4d3c823806b HTTP/1.0" 202 Accepted 2026-03-20 12:58:18,053 - lava_callback - INFO - Starting async job submit for node 69baa15b537ae4d3c823806b 2026-03-20 12:58:18,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:58:18,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa15b537ae4d3c823806b HTTP/1.1" 200 None 2026-03-20 12:58:18,071 - lava_callback - DEBUG - Processing node 69baa15b537ae4d3c823806b: baseline-arm-baylibre 2026-03-20 12:58:18,072 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa15b537ae4d3c823806b 2026-03-20 12:58:18,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:58:18,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa15b537ae4d3c823806b HTTP/1.1" 200 None 2026-03-20 12:58:18,089 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:58:18,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None 2026-03-20 12:58:18,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:58:18,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa15b537ae4d3c823806b HTTP/1.1" 200 None 2026-03-20 12:58:18,130 - lava_callback - ERROR - Error processing callback for node 69baa15b537ae4d3c823806b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:58:58,247 - lava_callback - INFO - Received callback for node 69baa180537ae4d3c823807c INFO: 172.21.0.1:60964 - "POST /node/69baa180537ae4d3c823807c HTTP/1.0" 202 Accepted 2026-03-20 12:58:58,252 - lava_callback - INFO - Starting async job submit for node 69baa180537ae4d3c823807c 2026-03-20 12:58:58,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:58:58,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa180537ae4d3c823807c HTTP/1.1" 200 None 2026-03-20 12:58:58,268 - lava_callback - DEBUG - Processing node 69baa180537ae4d3c823807c: baseline-arm-baylibre 2026-03-20 12:58:58,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa180537ae4d3c823807c 2026-03-20 12:58:58,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:58:58,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa180537ae4d3c823807c HTTP/1.1" 200 None 2026-03-20 12:58:58,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:58:58,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None 2026-03-20 12:58:58,300 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:58:58,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa180537ae4d3c823807c HTTP/1.1" 200 None 2026-03-20 12:58:58,329 - lava_callback - ERROR - Error processing callback for node 69baa180537ae4d3c823807c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59208 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59218 - "GET / HTTP/1.0" 200 OK 2026-03-20 12:59:18,126 - lava_callback - INFO - Received callback for node 69baa1a4537ae4d3c8238083 INFO: 172.21.0.1:59230 - "POST /node/69baa1a4537ae4d3c8238083 HTTP/1.0" 202 Accepted 2026-03-20 12:59:18,131 - lava_callback - INFO - Starting async job submit for node 69baa1a4537ae4d3c8238083 2026-03-20 12:59:18,132 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:59:18,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa1a4537ae4d3c8238083 HTTP/1.1" 200 None 2026-03-20 12:59:18,148 - lava_callback - DEBUG - Processing node 69baa1a4537ae4d3c8238083: baseline-arm-baylibre 2026-03-20 12:59:18,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa1a4537ae4d3c8238083 2026-03-20 12:59:18,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:59:18,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa1a4537ae4d3c8238083 HTTP/1.1" 200 None 2026-03-20 12:59:18,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:59:18,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None 2026-03-20 12:59:18,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 12:59:18,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa1a4537ae4d3c8238083 HTTP/1.1" 200 None 2026-03-20 12:59:18,207 - lava_callback - ERROR - Error processing callback for node 69baa1a4537ae4d3c8238083: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34504 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33536 - "GET / HTTP/1.0" 200 OK 2026-03-20 13:01:20,892 - lava_callback - INFO - Received callback for node 69baa212537ae4d3c82380a7 INFO: 172.21.0.1:34450 - "POST /node/69baa212537ae4d3c82380a7 HTTP/1.0" 202 Accepted 2026-03-20 13:01:20,897 - lava_callback - INFO - Starting async job submit for node 69baa212537ae4d3c82380a7 2026-03-20 13:01:20,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:01:20,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa212537ae4d3c82380a7 HTTP/1.1" 200 None 2026-03-20 13:01:20,913 - lava_callback - DEBUG - Processing node 69baa212537ae4d3c82380a7: baseline-arm-clabbe 2026-03-20 13:01:20,914 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa212537ae4d3c82380a7 2026-03-20 13:01:20,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:01:20,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa212537ae4d3c82380a7 HTTP/1.1" 200 None 2026-03-20 13:01:20,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:01:20,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None 2026-03-20 13:01:20,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:01:20,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa212537ae4d3c82380a7 HTTP/1.1" 200 None 2026-03-20 13:01:20,968 - lava_callback - ERROR - Error processing callback for node 69baa212537ae4d3c82380a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58296 - "GET / HTTP/1.0" 200 OK 2026-03-20 13:02:00,857 - lava_callback - INFO - Received callback for node 69baa237537ae4d3c82380b8 INFO: 172.21.0.1:56572 - "POST /node/69baa237537ae4d3c82380b8 HTTP/1.0" 202 Accepted 2026-03-20 13:02:00,862 - lava_callback - INFO - Starting async job submit for node 69baa237537ae4d3c82380b8 2026-03-20 13:02:00,863 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:02:00,878 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa237537ae4d3c82380b8 HTTP/1.1" 200 None 2026-03-20 13:02:00,879 - lava_callback - DEBUG - Processing node 69baa237537ae4d3c82380b8: baseline-arm-clabbe 2026-03-20 13:02:00,879 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa237537ae4d3c82380b8 2026-03-20 13:02:00,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:02:00,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa237537ae4d3c82380b8 HTTP/1.1" 200 None 2026-03-20 13:02:00,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:02:00,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None 2026-03-20 13:02:00,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:02:00,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa237537ae4d3c82380b8 HTTP/1.1" 200 None 2026-03-20 13:02:00,942 - lava_callback - ERROR - Error processing callback for node 69baa237537ae4d3c82380b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40280 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36532 - "GET / HTTP/1.0" 200 OK 2026-03-20 13:02:40,965 - lava_callback - INFO - Received callback for node 69baa25b537ae4d3c82380bf INFO: 172.21.0.1:46038 - "POST /node/69baa25b537ae4d3c82380bf HTTP/1.0" 202 Accepted 2026-03-20 13:02:40,971 - lava_callback - INFO - Starting async job submit for node 69baa25b537ae4d3c82380bf 2026-03-20 13:02:40,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:02:40,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa25b537ae4d3c82380bf HTTP/1.1" 200 None 2026-03-20 13:02:40,986 - lava_callback - DEBUG - Processing node 69baa25b537ae4d3c82380bf: baseline-arm-clabbe 2026-03-20 13:02:40,986 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa25b537ae4d3c82380bf 2026-03-20 13:02:40,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:02:41,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa25b537ae4d3c82380bf HTTP/1.1" 200 None 2026-03-20 13:02:41,002 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:02:41,015 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None 2026-03-20 13:02:41,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:02:41,041 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa25b537ae4d3c82380bf HTTP/1.1" 200 None 2026-03-20 13:02:41,043 - lava_callback - ERROR - Error processing callback for node 69baa25b537ae4d3c82380bf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34674 - "GET / HTTP/1.0" 200 OK 2026-03-20 13:03:00,917 - lava_callback - INFO - Received callback for node 69baa27f537ae4d3c82380cb INFO: 172.21.0.1:52202 - "POST /node/69baa27f537ae4d3c82380cb HTTP/1.0" 202 Accepted 2026-03-20 13:03:00,924 - lava_callback - INFO - Starting async job submit for node 69baa27f537ae4d3c82380cb 2026-03-20 13:03:00,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:03:00,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa27f537ae4d3c82380cb HTTP/1.1" 200 None 2026-03-20 13:03:00,946 - lava_callback - DEBUG - Processing node 69baa27f537ae4d3c82380cb: baseline-arm-clabbe 2026-03-20 13:03:00,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa27f537ae4d3c82380cb 2026-03-20 13:03:00,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:03:00,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa27f537ae4d3c82380cb HTTP/1.1" 200 None 2026-03-20 13:03:00,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:03:00,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None 2026-03-20 13:03:00,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:03:00,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa27f537ae4d3c82380cb HTTP/1.1" 200 None 2026-03-20 13:03:01,004 - lava_callback - ERROR - Error processing callback for node 69baa27f537ae4d3c82380cb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:52212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56810 - "GET / HTTP/1.0" 200 OK 2026-03-20 13:03:40,947 - lava_callback - INFO - Received callback for node 69baa2a5537ae4d3c82380d8 INFO: 172.21.0.1:60592 - "POST /node/69baa2a5537ae4d3c82380d8 HTTP/1.0" 202 Accepted 2026-03-20 13:03:40,952 - lava_callback - INFO - Starting async job submit for node 69baa2a5537ae4d3c82380d8 2026-03-20 13:03:40,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:03:40,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa2a5537ae4d3c82380d8 HTTP/1.1" 200 None 2026-03-20 13:03:40,969 - lava_callback - DEBUG - Processing node 69baa2a5537ae4d3c82380d8: baseline-arm-clabbe 2026-03-20 13:03:40,969 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baa2a5537ae4d3c82380d8 2026-03-20 13:03:40,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:03:40,989 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baa2a5537ae4d3c82380d8 HTTP/1.1" 200 None 2026-03-20 13:03:40,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:03:41,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef76d5731cbd74145fb9 HTTP/1.1" 200 None 2026-03-20 13:03:41,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 13:03:41,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baa2a5537ae4d3c82380d8 HTTP/1.1" 200 None 2026-03-20 13:03:41,026 - lava_callback - ERROR - Error processing callback for node 69baa2a5537ae4d3c82380d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35498 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55324 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45430 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45434 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42708 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44242 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40180 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60044 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50620 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42146 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47624 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50252 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51478 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50388 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33008 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49850 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53768 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57114 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49096 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52244 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35170 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38514 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52552 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58790 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41284 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50826 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58752 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35346 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35676 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39146 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43856 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34290 - "GET /robots.txt HTTP/1.0" 404 Not Found INFO: 172.21.0.1:34298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54090 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47842 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40304 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58232 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40292 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35342 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45582 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49278 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36932 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35404 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57528 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49406 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41286 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34010 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32990 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59038 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58786 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40692 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51068 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43522 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48558 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58046 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60616 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51616 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37918 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56554 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57764 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59730 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52674 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40088 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53022 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53026 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47876 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42248 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37398 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44982 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44986 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36064 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47820 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33780 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47320 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41462 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39376 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59354 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46852 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50754 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51032 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47860 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39178 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46516 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46468 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59330 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44632 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54222 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42910 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56252 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38588 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38572 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52202 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59950 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60670 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53536 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38236 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49154 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47128 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56636 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58872 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33858 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44606 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51598 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44550 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37360 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36628 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57048 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35936 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57190 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59784 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51702 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37194 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52778 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35288 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48766 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48776 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47868 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45518 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35140 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56574 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35830 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33480 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33482 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58292 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35102 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56644 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60272 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46602 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51568 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54640 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42810 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:40:23,718 - lava_callback - INFO - Received callback for node 69bab945537ae4d3c823819e INFO: 172.21.0.1:34868 - "POST /node/69bab945537ae4d3c823819e HTTP/1.0" 202 Accepted 2026-03-20 14:40:23,724 - lava_callback - INFO - Starting async job submit for node 69bab945537ae4d3c823819e 2026-03-20 14:40:23,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:40:23,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bab945537ae4d3c823819e HTTP/1.1" 200 None 2026-03-20 14:40:23,740 - lava_callback - DEBUG - Processing node 69bab945537ae4d3c823819e: baseline-arm-baylibre 2026-03-20 14:40:23,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bab945537ae4d3c823819e 2026-03-20 14:40:23,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:40:23,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bab945537ae4d3c823819e HTTP/1.1" 200 None 2026-03-20 14:40:23,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:40:23,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 14:40:23,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:40:23,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bab945537ae4d3c823819e HTTP/1.1" 200 None 2026-03-20 14:40:23,802 - lava_callback - ERROR - Error processing callback for node 69bab945537ae4d3c823819e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50612 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:41:03,703 - lava_callback - INFO - Received callback for node 69bab972537ae4d3c82381a7 INFO: 172.21.0.1:35966 - "POST /node/69bab972537ae4d3c82381a7 HTTP/1.0" 202 Accepted 2026-03-20 14:41:03,709 - lava_callback - INFO - Starting async job submit for node 69bab972537ae4d3c82381a7 2026-03-20 14:41:03,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:41:03,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bab972537ae4d3c82381a7 HTTP/1.1" 200 None 2026-03-20 14:41:03,725 - lava_callback - DEBUG - Processing node 69bab972537ae4d3c82381a7: baseline-arm-baylibre 2026-03-20 14:41:03,726 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bab972537ae4d3c82381a7 2026-03-20 14:41:03,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:41:03,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bab972537ae4d3c82381a7 HTTP/1.1" 200 None 2026-03-20 14:41:03,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:41:03,755 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 14:41:03,757 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:41:03,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bab972537ae4d3c82381a7 HTTP/1.1" 200 None 2026-03-20 14:41:03,778 - lava_callback - ERROR - Error processing callback for node 69bab972537ae4d3c82381a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36634 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43358 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51356 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:41:43,822 - lava_callback - INFO - Received callback for node 69bab99d537ae4d3c82381b0 INFO: 172.21.0.1:56874 - "POST /node/69bab99d537ae4d3c82381b0 HTTP/1.0" 202 Accepted 2026-03-20 14:41:43,828 - lava_callback - INFO - Starting async job submit for node 69bab99d537ae4d3c82381b0 2026-03-20 14:41:43,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:41:43,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bab99d537ae4d3c82381b0 HTTP/1.1" 200 None 2026-03-20 14:41:43,844 - lava_callback - DEBUG - Processing node 69bab99d537ae4d3c82381b0: baseline-arm-baylibre 2026-03-20 14:41:43,844 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bab99d537ae4d3c82381b0 2026-03-20 14:41:43,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:41:43,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bab99d537ae4d3c82381b0 HTTP/1.1" 200 None 2026-03-20 14:41:43,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:41:43,874 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 14:41:43,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:41:43,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bab99d537ae4d3c82381b0 HTTP/1.1" 200 None 2026-03-20 14:41:43,906 - lava_callback - ERROR - Error processing callback for node 69bab99d537ae4d3c82381b0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56882 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59110 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41834 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:42:23,782 - lava_callback - INFO - Received callback for node 69bab9c8537ae4d3c82381b9 INFO: 172.21.0.1:42794 - "POST /node/69bab9c8537ae4d3c82381b9 HTTP/1.0" 202 Accepted 2026-03-20 14:42:23,787 - lava_callback - INFO - Starting async job submit for node 69bab9c8537ae4d3c82381b9 2026-03-20 14:42:23,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:42:23,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bab9c8537ae4d3c82381b9 HTTP/1.1" 200 None 2026-03-20 14:42:23,815 - lava_callback - DEBUG - Processing node 69bab9c8537ae4d3c82381b9: baseline-arm-baylibre 2026-03-20 14:42:23,815 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bab9c8537ae4d3c82381b9 2026-03-20 14:42:23,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:42:23,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bab9c8537ae4d3c82381b9 HTTP/1.1" 200 None 2026-03-20 14:42:23,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:42:23,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 14:42:23,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:42:23,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bab9c8537ae4d3c82381b9 HTTP/1.1" 200 None 2026-03-20 14:42:23,887 - lava_callback - ERROR - Error processing callback for node 69bab9c8537ae4d3c82381b9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:42796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40566 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:43:03,869 - lava_callback - INFO - Received callback for node 69bab9f4537ae4d3c82381c2 INFO: 172.21.0.1:49322 - "POST /node/69bab9f4537ae4d3c82381c2 HTTP/1.0" 202 Accepted 2026-03-20 14:43:03,875 - lava_callback - INFO - Starting async job submit for node 69bab9f4537ae4d3c82381c2 2026-03-20 14:43:03,876 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:43:03,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bab9f4537ae4d3c82381c2 HTTP/1.1" 200 None 2026-03-20 14:43:03,893 - lava_callback - DEBUG - Processing node 69bab9f4537ae4d3c82381c2: baseline-arm-baylibre 2026-03-20 14:43:03,893 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bab9f4537ae4d3c82381c2 2026-03-20 14:43:03,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:43:03,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bab9f4537ae4d3c82381c2 HTTP/1.1" 200 None 2026-03-20 14:43:03,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:43:03,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 14:43:03,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:43:03,969 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bab9f4537ae4d3c82381c2 HTTP/1.1" 200 None 2026-03-20 14:43:03,970 - lava_callback - ERROR - Error processing callback for node 69bab9f4537ae4d3c82381c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49336 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58552 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:58560 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34228 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:44:03,880 - lava_callback - INFO - Received callback for node 69baba1f537ae4d3c82381cd INFO: 172.21.0.1:58792 - "POST /node/69baba1f537ae4d3c82381cd HTTP/1.0" 202 Accepted 2026-03-20 14:44:03,886 - lava_callback - INFO - Starting async job submit for node 69baba1f537ae4d3c82381cd 2026-03-20 14:44:03,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:44:03,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baba1f537ae4d3c82381cd HTTP/1.1" 200 None 2026-03-20 14:44:03,902 - lava_callback - DEBUG - Processing node 69baba1f537ae4d3c82381cd: baseline-arm-baylibre 2026-03-20 14:44:03,903 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baba1f537ae4d3c82381cd 2026-03-20 14:44:03,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:44:03,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baba1f537ae4d3c82381cd HTTP/1.1" 200 None 2026-03-20 14:44:03,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:44:03,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 14:44:03,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:44:03,967 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baba1f537ae4d3c82381cd HTTP/1.1" 200 None 2026-03-20 14:44:03,968 - lava_callback - ERROR - Error processing callback for node 69baba1f537ae4d3c82381cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50596 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39234 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39238 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37286 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39060 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48654 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:46:05,148 - lava_callback - INFO - Received callback for node 69babaa0537ae4d3c82381e6 INFO: 172.21.0.1:44918 - "POST /node/69babaa0537ae4d3c82381e6 HTTP/1.0" 202 Accepted 2026-03-20 14:46:05,154 - lava_callback - INFO - Starting async job submit for node 69babaa0537ae4d3c82381e6 2026-03-20 14:46:05,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:46:05,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babaa0537ae4d3c82381e6 HTTP/1.1" 200 None 2026-03-20 14:46:05,170 - lava_callback - DEBUG - Processing node 69babaa0537ae4d3c82381e6: baseline-arm-clabbe 2026-03-20 14:46:05,170 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babaa0537ae4d3c82381e6 2026-03-20 14:46:05,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:46:05,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babaa0537ae4d3c82381e6 HTTP/1.1" 200 None 2026-03-20 14:46:05,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:46:05,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 14:46:05,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:46:05,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babaa0537ae4d3c82381e6 HTTP/1.1" 200 None 2026-03-20 14:46:05,225 - lava_callback - ERROR - Error processing callback for node 69babaa0537ae4d3c82381e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46514 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:46:45,133 - lava_callback - INFO - Received callback for node 69babacb537ae4d3c82381f0 INFO: 172.21.0.1:57554 - "POST /node/69babacb537ae4d3c82381f0 HTTP/1.0" 202 Accepted 2026-03-20 14:46:45,139 - lava_callback - INFO - Starting async job submit for node 69babacb537ae4d3c82381f0 2026-03-20 14:46:45,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:46:45,155 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babacb537ae4d3c82381f0 HTTP/1.1" 200 None 2026-03-20 14:46:45,156 - lava_callback - DEBUG - Processing node 69babacb537ae4d3c82381f0: baseline-arm-clabbe 2026-03-20 14:46:45,156 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babacb537ae4d3c82381f0 2026-03-20 14:46:45,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:46:45,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babacb537ae4d3c82381f0 HTTP/1.1" 200 None 2026-03-20 14:46:45,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:46:45,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 14:46:45,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:46:45,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babacb537ae4d3c82381f0 HTTP/1.1" 200 None 2026-03-20 14:46:45,218 - lava_callback - ERROR - Error processing callback for node 69babacb537ae4d3c82381f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57566 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50188 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46960 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56776 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56780 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:47:25,187 - lava_callback - INFO - Received callback for node 69babaf7537ae4d3c82381fa INFO: 172.21.0.1:32792 - "POST /node/69babaf7537ae4d3c82381fa HTTP/1.0" 202 Accepted 2026-03-20 14:47:25,193 - lava_callback - INFO - Starting async job submit for node 69babaf7537ae4d3c82381fa 2026-03-20 14:47:25,193 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:47:25,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babaf7537ae4d3c82381fa HTTP/1.1" 200 None 2026-03-20 14:47:25,209 - lava_callback - DEBUG - Processing node 69babaf7537ae4d3c82381fa: baseline-arm-clabbe 2026-03-20 14:47:25,209 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babaf7537ae4d3c82381fa 2026-03-20 14:47:25,210 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:47:25,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babaf7537ae4d3c82381fa HTTP/1.1" 200 None 2026-03-20 14:47:25,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:47:25,243 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 14:47:25,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:47:25,277 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babaf7537ae4d3c82381fa HTTP/1.1" 200 None 2026-03-20 14:47:25,279 - lava_callback - ERROR - Error processing callback for node 69babaf7537ae4d3c82381fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55152 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50510 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42350 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42360 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:48:05,175 - lava_callback - INFO - Received callback for node 69babb21537ae4d3c8238204 INFO: 172.21.0.1:33614 - "POST /node/69babb21537ae4d3c8238204 HTTP/1.0" 202 Accepted 2026-03-20 14:48:05,181 - lava_callback - INFO - Starting async job submit for node 69babb21537ae4d3c8238204 2026-03-20 14:48:05,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:48:05,209 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babb21537ae4d3c8238204 HTTP/1.1" 200 None 2026-03-20 14:48:05,210 - lava_callback - DEBUG - Processing node 69babb21537ae4d3c8238204: baseline-arm-clabbe 2026-03-20 14:48:05,210 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babb21537ae4d3c8238204 2026-03-20 14:48:05,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:48:05,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babb21537ae4d3c8238204 HTTP/1.1" 200 None 2026-03-20 14:48:05,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:48:05,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 14:48:05,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:48:05,291 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babb21537ae4d3c8238204 HTTP/1.1" 200 None 2026-03-20 14:48:05,300 - lava_callback - ERROR - Error processing callback for node 69babb21537ae4d3c8238204: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47198 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38380 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48374 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:49:05,265 - lava_callback - INFO - Received callback for node 69babb4d537ae4d3c8238211 INFO: 172.21.0.1:33510 - "POST /node/69babb4d537ae4d3c8238211 HTTP/1.0" 202 Accepted 2026-03-20 14:49:05,271 - lava_callback - INFO - Starting async job submit for node 69babb4d537ae4d3c8238211 2026-03-20 14:49:05,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:49:05,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babb4d537ae4d3c8238211 HTTP/1.1" 200 None 2026-03-20 14:49:05,311 - lava_callback - DEBUG - Processing node 69babb4d537ae4d3c8238211: baseline-arm-clabbe 2026-03-20 14:49:05,311 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babb4d537ae4d3c8238211 2026-03-20 14:49:05,312 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:49:05,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babb4d537ae4d3c8238211 HTTP/1.1" 200 None 2026-03-20 14:49:05,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:49:05,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f6d537ae4d3c8236e46 HTTP/1.1" 200 None 2026-03-20 14:49:05,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:49:05,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babb4d537ae4d3c8238211 HTTP/1.1" 200 None 2026-03-20 14:49:05,372 - lava_callback - ERROR - Error processing callback for node 69babb4d537ae4d3c8238211: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:33524 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42864 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53794 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51436 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36384 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42300 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44684 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43530 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35754 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50672 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43728 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:54:04,743 - lava_callback - INFO - Received callback for node 69babc77537ae4d3c8238239 INFO: 172.21.0.1:57750 - "POST /node/69babc77537ae4d3c8238239 HTTP/1.0" 202 Accepted 2026-03-20 14:54:04,749 - lava_callback - INFO - Starting async job submit for node 69babc77537ae4d3c8238239 2026-03-20 14:54:04,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:54:04,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babc77537ae4d3c8238239 HTTP/1.1" 200 None 2026-03-20 14:54:04,767 - lava_callback - DEBUG - Processing node 69babc77537ae4d3c8238239: baseline-arm64-baylibre 2026-03-20 14:54:04,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babc77537ae4d3c8238239 2026-03-20 14:54:04,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:54:04,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babc77537ae4d3c8238239 HTTP/1.1" 200 None 2026-03-20 14:54:04,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:54:04,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 14:54:04,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:54:04,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babc77537ae4d3c8238239 HTTP/1.1" 200 None 2026-03-20 14:54:04,834 - lava_callback - ERROR - Error processing callback for node 69babc77537ae4d3c8238239: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:57758 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37972 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:50402 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:55:24,554 - lava_callback - INFO - Received callback for node 69babcd0537ae4d3c823825c INFO: 172.21.0.1:50182 - "POST /node/69babcd0537ae4d3c823825c HTTP/1.0" 202 Accepted 2026-03-20 14:55:24,559 - lava_callback - INFO - Starting async job submit for node 69babcd0537ae4d3c823825c 2026-03-20 14:55:24,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:55:24,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babcd0537ae4d3c823825c HTTP/1.1" 200 None 2026-03-20 14:55:24,575 - lava_callback - DEBUG - Processing node 69babcd0537ae4d3c823825c: baseline-arm64-baylibre 2026-03-20 14:55:24,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babcd0537ae4d3c823825c 2026-03-20 14:55:24,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:55:24,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babcd0537ae4d3c823825c HTTP/1.1" 200 None 2026-03-20 14:55:24,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:55:24,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 14:55:24,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:55:24,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babcd0537ae4d3c823825c HTTP/1.1" 200 None 2026-03-20 14:55:24,647 - lava_callback - ERROR - Error processing callback for node 69babcd0537ae4d3c823825c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46028 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55260 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39308 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38186 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43766 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:56:44,627 - lava_callback - INFO - Received callback for node 69babd28537ae4d3c8238273 INFO: 172.21.0.1:48458 - "POST /node/69babd28537ae4d3c8238273 HTTP/1.0" 202 Accepted 2026-03-20 14:56:44,633 - lava_callback - INFO - Starting async job submit for node 69babd28537ae4d3c8238273 2026-03-20 14:56:44,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:56:44,674 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babd28537ae4d3c8238273 HTTP/1.1" 200 None 2026-03-20 14:56:44,676 - lava_callback - DEBUG - Processing node 69babd28537ae4d3c8238273: baseline-arm64-baylibre 2026-03-20 14:56:44,676 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babd28537ae4d3c8238273 2026-03-20 14:56:44,676 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:56:44,691 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babd28537ae4d3c8238273 HTTP/1.1" 200 None 2026-03-20 14:56:44,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:56:44,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 14:56:44,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:56:44,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babd28537ae4d3c8238273 HTTP/1.1" 200 None 2026-03-20 14:56:44,746 - lava_callback - ERROR - Error processing callback for node 69babd28537ae4d3c8238273: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52650 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52654 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49970 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36636 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:58:24,717 - lava_callback - INFO - Received callback for node 69babd7f537ae4d3c823827c INFO: 172.21.0.1:53108 - "POST /node/69babd7f537ae4d3c823827c HTTP/1.0" 202 Accepted 2026-03-20 14:58:24,722 - lava_callback - INFO - Starting async job submit for node 69babd7f537ae4d3c823827c 2026-03-20 14:58:24,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:58:24,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babd7f537ae4d3c823827c HTTP/1.1" 200 None 2026-03-20 14:58:24,739 - lava_callback - DEBUG - Processing node 69babd7f537ae4d3c823827c: baseline-arm64-baylibre 2026-03-20 14:58:24,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babd7f537ae4d3c823827c 2026-03-20 14:58:24,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:58:24,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babd7f537ae4d3c823827c HTTP/1.1" 200 None 2026-03-20 14:58:24,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:58:24,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 14:58:24,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:58:24,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babd7f537ae4d3c823827c HTTP/1.1" 200 None 2026-03-20 14:58:24,800 - lava_callback - ERROR - Error processing callback for node 69babd7f537ae4d3c823827c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53124 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58130 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49468 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49474 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55532 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41120 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37812 - "GET / HTTP/1.0" 200 OK 2026-03-20 14:59:44,912 - lava_callback - INFO - Received callback for node 69babdd0537ae4d3c8238285 INFO: 172.21.0.1:59314 - "POST /node/69babdd0537ae4d3c8238285 HTTP/1.0" 202 Accepted 2026-03-20 14:59:44,918 - lava_callback - INFO - Starting async job submit for node 69babdd0537ae4d3c8238285 2026-03-20 14:59:44,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:59:44,933 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babdd0537ae4d3c8238285 HTTP/1.1" 200 None 2026-03-20 14:59:44,934 - lava_callback - DEBUG - Processing node 69babdd0537ae4d3c8238285: baseline-arm64-baylibre 2026-03-20 14:59:44,934 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babdd0537ae4d3c8238285 2026-03-20 14:59:44,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:59:44,948 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babdd0537ae4d3c8238285 HTTP/1.1" 200 None 2026-03-20 14:59:44,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:59:44,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 14:59:44,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 14:59:44,987 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babdd0537ae4d3c8238285 HTTP/1.1" 200 None 2026-03-20 14:59:44,993 - lava_callback - ERROR - Error processing callback for node 69babdd0537ae4d3c8238285: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:59328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59760 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41390 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57622 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:01:04,856 - lava_callback - INFO - Received callback for node 69babe21537ae4d3c823828f INFO: 172.21.0.1:50360 - "POST /node/69babe21537ae4d3c823828f HTTP/1.0" 202 Accepted 2026-03-20 15:01:04,861 - lava_callback - INFO - Starting async job submit for node 69babe21537ae4d3c823828f 2026-03-20 15:01:04,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:01:04,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babe21537ae4d3c823828f HTTP/1.1" 200 None 2026-03-20 15:01:04,877 - lava_callback - DEBUG - Processing node 69babe21537ae4d3c823828f: baseline-arm64-baylibre 2026-03-20 15:01:04,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babe21537ae4d3c823828f 2026-03-20 15:01:04,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:01:04,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babe21537ae4d3c823828f HTTP/1.1" 200 None 2026-03-20 15:01:04,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:01:04,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 15:01:04,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:01:04,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babe21537ae4d3c823828f HTTP/1.1" 200 None 2026-03-20 15:01:04,940 - lava_callback - ERROR - Error processing callback for node 69babe21537ae4d3c823828f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50376 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40040 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54686 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55158 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:02:25,828 - lava_callback - INFO - Received callback for node 69babe7e537ae4d3c8238298 INFO: 172.21.0.1:34768 - "POST /node/69babe7e537ae4d3c8238298 HTTP/1.0" 202 Accepted 2026-03-20 15:02:25,834 - lava_callback - INFO - Starting async job submit for node 69babe7e537ae4d3c8238298 2026-03-20 15:02:25,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:02:25,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babe7e537ae4d3c8238298 HTTP/1.1" 200 None 2026-03-20 15:02:25,850 - lava_callback - DEBUG - Processing node 69babe7e537ae4d3c8238298: baseline-arm64-clabbe 2026-03-20 15:02:25,850 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babe7e537ae4d3c8238298 2026-03-20 15:02:25,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:02:25,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babe7e537ae4d3c8238298 HTTP/1.1" 200 None 2026-03-20 15:02:25,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:02:25,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 15:02:25,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:02:25,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babe7e537ae4d3c8238298 HTTP/1.1" 200 None 2026-03-20 15:02:25,934 - lava_callback - ERROR - Error processing callback for node 69babe7e537ae4d3c8238298: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49104 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51792 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59466 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60528 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:04:05,905 - lava_callback - INFO - Received callback for node 69babed4537ae4d3c82382a0 INFO: 172.21.0.1:35430 - "POST /node/69babed4537ae4d3c82382a0 HTTP/1.0" 202 Accepted 2026-03-20 15:04:05,911 - lava_callback - INFO - Starting async job submit for node 69babed4537ae4d3c82382a0 2026-03-20 15:04:05,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:04:05,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babed4537ae4d3c82382a0 HTTP/1.1" 200 None 2026-03-20 15:04:05,936 - lava_callback - DEBUG - Processing node 69babed4537ae4d3c82382a0: baseline-arm64-clabbe 2026-03-20 15:04:05,936 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babed4537ae4d3c82382a0 2026-03-20 15:04:05,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:04:05,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babed4537ae4d3c82382a0 HTTP/1.1" 200 None 2026-03-20 15:04:05,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:04:05,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 15:04:05,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:04:05,991 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babed4537ae4d3c82382a0 HTTP/1.1" 200 None 2026-03-20 15:04:05,994 - lava_callback - ERROR - Error processing callback for node 69babed4537ae4d3c82382a0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45676 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33788 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49646 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51392 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:05:25,966 - lava_callback - INFO - Received callback for node 69babf32537ae4d3c82382ab INFO: 172.21.0.1:46714 - "POST /node/69babf32537ae4d3c82382ab HTTP/1.0" 202 Accepted 2026-03-20 15:05:25,972 - lava_callback - INFO - Starting async job submit for node 69babf32537ae4d3c82382ab 2026-03-20 15:05:25,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:05:25,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babf32537ae4d3c82382ab HTTP/1.1" 200 None 2026-03-20 15:05:25,994 - lava_callback - DEBUG - Processing node 69babf32537ae4d3c82382ab: baseline-arm64-clabbe 2026-03-20 15:05:25,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babf32537ae4d3c82382ab 2026-03-20 15:05:25,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:05:26,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babf32537ae4d3c82382ab HTTP/1.1" 200 None 2026-03-20 15:05:26,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:05:26,026 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 15:05:26,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:05:26,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babf32537ae4d3c82382ab HTTP/1.1" 200 None 2026-03-20 15:05:26,050 - lava_callback - ERROR - Error processing callback for node 69babf32537ae4d3c82382ab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:46722 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36682 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36696 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51630 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35108 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36168 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55246 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36982 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:07:06,029 - lava_callback - INFO - Received callback for node 69babf89537ae4d3c82382b6 INFO: 172.21.0.1:53976 - "POST /node/69babf89537ae4d3c82382b6 HTTP/1.0" 202 Accepted 2026-03-20 15:07:06,035 - lava_callback - INFO - Starting async job submit for node 69babf89537ae4d3c82382b6 2026-03-20 15:07:06,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:07:06,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babf89537ae4d3c82382b6 HTTP/1.1" 200 None 2026-03-20 15:07:06,054 - lava_callback - DEBUG - Processing node 69babf89537ae4d3c82382b6: baseline-arm64-clabbe 2026-03-20 15:07:06,055 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babf89537ae4d3c82382b6 2026-03-20 15:07:06,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:07:06,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babf89537ae4d3c82382b6 HTTP/1.1" 200 None 2026-03-20 15:07:06,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:07:06,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 15:07:06,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:07:06,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babf89537ae4d3c82382b6 HTTP/1.1" 200 None 2026-03-20 15:07:06,115 - lava_callback - ERROR - Error processing callback for node 69babf89537ae4d3c82382b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44710 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44722 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:08:26,131 - lava_callback - INFO - Received callback for node 69babfe3537ae4d3c82382be INFO: 172.21.0.1:58272 - "POST /node/69babfe3537ae4d3c82382be HTTP/1.0" 202 Accepted 2026-03-20 15:08:26,136 - lava_callback - INFO - Starting async job submit for node 69babfe3537ae4d3c82382be 2026-03-20 15:08:26,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:08:26,152 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babfe3537ae4d3c82382be HTTP/1.1" 200 None 2026-03-20 15:08:26,152 - lava_callback - DEBUG - Processing node 69babfe3537ae4d3c82382be: baseline-arm64-clabbe 2026-03-20 15:08:26,153 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69babfe3537ae4d3c82382be 2026-03-20 15:08:26,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:08:26,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69babfe3537ae4d3c82382be HTTP/1.1" 200 None 2026-03-20 15:08:26,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:08:26,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 15:08:26,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:08:26,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69babfe3537ae4d3c82382be HTTP/1.1" 200 None 2026-03-20 15:08:26,222 - lava_callback - ERROR - Error processing callback for node 69babfe3537ae4d3c82382be: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33492 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33508 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54338 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41966 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35480 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35482 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:10:06,325 - lava_callback - INFO - Received callback for node 69bac03a537ae4d3c82382c6 INFO: 172.21.0.1:58652 - "POST /node/69bac03a537ae4d3c82382c6 HTTP/1.0" 202 Accepted 2026-03-20 15:10:06,330 - lava_callback - INFO - Starting async job submit for node 69bac03a537ae4d3c82382c6 2026-03-20 15:10:06,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:10:06,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac03a537ae4d3c82382c6 HTTP/1.1" 200 None 2026-03-20 15:10:06,346 - lava_callback - DEBUG - Processing node 69bac03a537ae4d3c82382c6: baseline-arm64-clabbe 2026-03-20 15:10:06,346 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac03a537ae4d3c82382c6 2026-03-20 15:10:06,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:10:06,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac03a537ae4d3c82382c6 HTTP/1.1" 200 None 2026-03-20 15:10:06,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:10:06,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-20 15:10:06,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:10:06,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac03a537ae4d3c82382c6 HTTP/1.1" 200 None 2026-03-20 15:10:06,412 - lava_callback - ERROR - Error processing callback for node 69bac03a537ae4d3c82382c6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56016 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45840 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55604 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49622 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41144 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52912 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39928 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56600 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51490 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39790 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41488 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57946 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34118 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56200 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:13:17,221 - lava_callback - INFO - Received callback for node 69bac0fb537ae4d3c82382d3 INFO: 172.21.0.1:56212 - "POST /node/69bac0fb537ae4d3c82382d3 HTTP/1.0" 202 Accepted 2026-03-20 15:13:17,226 - lava_callback - INFO - Starting async job submit for node 69bac0fb537ae4d3c82382d3 2026-03-20 15:13:17,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:13:17,242 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac0fb537ae4d3c82382d3 HTTP/1.1" 200 None 2026-03-20 15:13:17,244 - lava_callback - DEBUG - Processing node 69bac0fb537ae4d3c82382d3: baseline-x86 2026-03-20 15:13:17,244 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac0fb537ae4d3c82382d3 2026-03-20 15:13:17,245 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:13:17,258 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac0fb537ae4d3c82382d3 HTTP/1.1" 200 None 2026-03-20 15:13:17,260 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:13:17,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None 2026-03-20 15:13:17,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:13:17,295 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac0fb537ae4d3c82382d3 HTTP/1.1" 200 None 2026-03-20 15:13:17,296 - lava_callback - ERROR - Error processing callback for node 69bac0fb537ae4d3c82382d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:60500 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54818 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45212 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44440 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44444 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57218 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53884 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56296 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58562 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47838 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43540 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39694 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53052 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60700 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32786 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43430 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34438 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49716 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49656 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49800 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49544 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36110 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:36116 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:21:26,030 - lava_callback - INFO - Received callback for node 69bac2e5537ae4d3c8238314 INFO: 172.21.0.1:47706 - "POST /node/69bac2e5537ae4d3c8238314 HTTP/1.0" 202 Accepted 2026-03-20 15:21:26,036 - lava_callback - INFO - Starting async job submit for node 69bac2e5537ae4d3c8238314 2026-03-20 15:21:26,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:21:26,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac2e5537ae4d3c8238314 HTTP/1.1" 200 None 2026-03-20 15:21:26,057 - lava_callback - DEBUG - Processing node 69bac2e5537ae4d3c8238314: baseline-arm64-baylibre 2026-03-20 15:21:26,057 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac2e5537ae4d3c8238314 2026-03-20 15:21:26,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:21:26,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac2e5537ae4d3c8238314 HTTP/1.1" 200 None 2026-03-20 15:21:26,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:21:26,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:21:26,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:21:26,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac2e5537ae4d3c8238314 HTTP/1.1" 200 None 2026-03-20 15:21:26,115 - lava_callback - ERROR - Error processing callback for node 69bac2e5537ae4d3c8238314: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40082 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53934 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53938 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46270 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48858 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48870 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38210 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46692 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:22:46,126 - lava_callback - INFO - Received callback for node 69bac33c537ae4d3c8238321 INFO: 172.21.0.1:51186 - "POST /node/69bac33c537ae4d3c8238321 HTTP/1.0" 202 Accepted 2026-03-20 15:22:46,132 - lava_callback - INFO - Starting async job submit for node 69bac33c537ae4d3c8238321 2026-03-20 15:22:46,133 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:22:46,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac33c537ae4d3c8238321 HTTP/1.1" 200 None 2026-03-20 15:22:46,148 - lava_callback - DEBUG - Processing node 69bac33c537ae4d3c8238321: baseline-arm64-baylibre 2026-03-20 15:22:46,148 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac33c537ae4d3c8238321 2026-03-20 15:22:46,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:22:46,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac33c537ae4d3c8238321 HTTP/1.1" 200 None 2026-03-20 15:22:46,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:22:46,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:22:46,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:22:46,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac33c537ae4d3c8238321 HTTP/1.1" 200 None 2026-03-20 15:22:46,212 - lava_callback - ERROR - Error processing callback for node 69bac33c537ae4d3c8238321: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:51192 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46806 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46810 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37274 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:24:06,235 - lava_callback - INFO - Received callback for node 69bac394537ae4d3c823832d INFO: 172.21.0.1:50716 - "POST /node/69bac394537ae4d3c823832d HTTP/1.0" 202 Accepted 2026-03-20 15:24:06,241 - lava_callback - INFO - Starting async job submit for node 69bac394537ae4d3c823832d 2026-03-20 15:24:06,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:24:06,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac394537ae4d3c823832d HTTP/1.1" 200 None 2026-03-20 15:24:06,257 - lava_callback - DEBUG - Processing node 69bac394537ae4d3c823832d: baseline-arm64-baylibre 2026-03-20 15:24:06,257 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac394537ae4d3c823832d 2026-03-20 15:24:06,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:24:06,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac394537ae4d3c823832d HTTP/1.1" 200 None 2026-03-20 15:24:06,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:24:06,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:24:06,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:24:06,313 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac394537ae4d3c823832d HTTP/1.1" 200 None 2026-03-20 15:24:06,314 - lava_callback - ERROR - Error processing callback for node 69bac394537ae4d3c823832d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:50726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32992 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41548 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33580 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44702 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36526 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36528 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33456 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33206 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52050 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:25:46,259 - lava_callback - INFO - Received callback for node 69bac3eb537ae4d3c8238339 INFO: 172.21.0.1:43764 - "POST /node/69bac3eb537ae4d3c8238339 HTTP/1.0" 202 Accepted 2026-03-20 15:25:46,265 - lava_callback - INFO - Starting async job submit for node 69bac3eb537ae4d3c8238339 2026-03-20 15:25:46,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:25:46,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac3eb537ae4d3c8238339 HTTP/1.1" 200 None 2026-03-20 15:25:46,281 - lava_callback - DEBUG - Processing node 69bac3eb537ae4d3c8238339: baseline-arm64-baylibre 2026-03-20 15:25:46,281 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac3eb537ae4d3c8238339 2026-03-20 15:25:46,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:25:46,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac3eb537ae4d3c8238339 HTTP/1.1" 200 None 2026-03-20 15:25:46,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:25:46,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:25:46,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:25:46,333 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac3eb537ae4d3c8238339 HTTP/1.1" 200 None 2026-03-20 15:25:46,335 - lava_callback - ERROR - Error processing callback for node 69bac3eb537ae4d3c8238339: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33420 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33422 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54878 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46846 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48102 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54520 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54530 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:27:06,383 - lava_callback - INFO - Received callback for node 69bac442537ae4d3c8238346 INFO: 172.21.0.1:44350 - "POST /node/69bac442537ae4d3c8238346 HTTP/1.0" 202 Accepted 2026-03-20 15:27:06,389 - lava_callback - INFO - Starting async job submit for node 69bac442537ae4d3c8238346 2026-03-20 15:27:06,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:27:06,404 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac442537ae4d3c8238346 HTTP/1.1" 200 None 2026-03-20 15:27:06,405 - lava_callback - DEBUG - Processing node 69bac442537ae4d3c8238346: baseline-arm64-baylibre 2026-03-20 15:27:06,405 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac442537ae4d3c8238346 2026-03-20 15:27:06,406 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:27:06,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac442537ae4d3c8238346 HTTP/1.1" 200 None 2026-03-20 15:27:06,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:27:06,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:27:06,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:27:06,460 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac442537ae4d3c8238346 HTTP/1.1" 200 None 2026-03-20 15:27:06,466 - lava_callback - ERROR - Error processing callback for node 69bac442537ae4d3c8238346: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49994 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55268 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56128 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:28:46,411 - lava_callback - INFO - Received callback for node 69bac49b537ae4d3c8238352 INFO: 172.21.0.1:34074 - "POST /node/69bac49b537ae4d3c8238352 HTTP/1.0" 202 Accepted 2026-03-20 15:28:46,416 - lava_callback - INFO - Starting async job submit for node 69bac49b537ae4d3c8238352 2026-03-20 15:28:46,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:28:46,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac49b537ae4d3c8238352 HTTP/1.1" 200 None 2026-03-20 15:28:46,432 - lava_callback - DEBUG - Processing node 69bac49b537ae4d3c8238352: baseline-arm64-baylibre 2026-03-20 15:28:46,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac49b537ae4d3c8238352 2026-03-20 15:28:46,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:28:46,446 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac49b537ae4d3c8238352 HTTP/1.1" 200 None 2026-03-20 15:28:46,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:28:46,461 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:28:46,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:28:46,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac49b537ae4d3c8238352 HTTP/1.1" 200 None 2026-03-20 15:28:46,487 - lava_callback - ERROR - Error processing callback for node 69bac49b537ae4d3c8238352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:34084 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33258 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53426 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34578 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:34590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46364 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37400 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37408 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41448 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42138 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59540 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:32:07,148 - lava_callback - INFO - Received callback for node 69bac572537ae4d3c823836a INFO: 172.21.0.1:59546 - "POST /node/69bac572537ae4d3c823836a HTTP/1.0" 202 Accepted 2026-03-20 15:32:07,154 - lava_callback - INFO - Starting async job submit for node 69bac572537ae4d3c823836a 2026-03-20 15:32:07,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:32:07,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac572537ae4d3c823836a HTTP/1.1" 200 None 2026-03-20 15:32:07,173 - lava_callback - DEBUG - Processing node 69bac572537ae4d3c823836a: baseline-arm64-clabbe 2026-03-20 15:32:07,174 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac572537ae4d3c823836a 2026-03-20 15:32:07,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:32:07,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac572537ae4d3c823836a HTTP/1.1" 200 None 2026-03-20 15:32:07,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:32:07,202 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:32:07,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:32:07,225 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac572537ae4d3c823836a HTTP/1.1" 200 None 2026-03-20 15:32:07,226 - lava_callback - ERROR - Error processing callback for node 69bac572537ae4d3c823836a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:54092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60948 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49392 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44254 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44264 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33316 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59964 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58506 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:34:07,211 - lava_callback - INFO - Received callback for node 69bac5ea537ae4d3c8238375 INFO: 172.21.0.1:58518 - "POST /node/69bac5ea537ae4d3c8238375 HTTP/1.0" 202 Accepted 2026-03-20 15:34:07,217 - lava_callback - INFO - Starting async job submit for node 69bac5ea537ae4d3c8238375 2026-03-20 15:34:07,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:34:07,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac5ea537ae4d3c8238375 HTTP/1.1" 200 None 2026-03-20 15:34:07,235 - lava_callback - DEBUG - Processing node 69bac5ea537ae4d3c8238375: baseline-arm64-clabbe 2026-03-20 15:34:07,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac5ea537ae4d3c8238375 2026-03-20 15:34:07,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:34:07,250 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac5ea537ae4d3c8238375 HTTP/1.1" 200 None 2026-03-20 15:34:07,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:34:07,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:34:07,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:34:07,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac5ea537ae4d3c8238375 HTTP/1.1" 200 None 2026-03-20 15:34:07,304 - lava_callback - ERROR - Error processing callback for node 69bac5ea537ae4d3c8238375: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40182 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36428 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58726 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49112 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49126 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41550 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:35:47,266 - lava_callback - INFO - Received callback for node 69bac63e537ae4d3c8238383 INFO: 172.21.0.1:41560 - "POST /node/69bac63e537ae4d3c8238383 HTTP/1.0" 202 Accepted 2026-03-20 15:35:47,272 - lava_callback - INFO - Starting async job submit for node 69bac63e537ae4d3c8238383 2026-03-20 15:35:47,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:35:47,288 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac63e537ae4d3c8238383 HTTP/1.1" 200 None 2026-03-20 15:35:47,289 - lava_callback - DEBUG - Processing node 69bac63e537ae4d3c8238383: baseline-arm64-clabbe 2026-03-20 15:35:47,289 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac63e537ae4d3c8238383 2026-03-20 15:35:47,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:35:47,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac63e537ae4d3c8238383 HTTP/1.1" 200 None 2026-03-20 15:35:47,318 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:35:47,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:35:47,332 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:35:47,352 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac63e537ae4d3c8238383 HTTP/1.1" 200 None 2026-03-20 15:35:47,356 - lava_callback - ERROR - Error processing callback for node 69bac63e537ae4d3c8238383: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:58656 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58658 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47498 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59076 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52874 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60070 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60072 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50272 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:37:07,351 - lava_callback - INFO - Received callback for node 69bac69e537ae4d3c823838d INFO: 172.21.0.1:50284 - "POST /node/69bac69e537ae4d3c823838d HTTP/1.0" 202 Accepted 2026-03-20 15:37:07,357 - lava_callback - INFO - Starting async job submit for node 69bac69e537ae4d3c823838d 2026-03-20 15:37:07,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:37:07,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac69e537ae4d3c823838d HTTP/1.1" 200 None 2026-03-20 15:37:07,373 - lava_callback - DEBUG - Processing node 69bac69e537ae4d3c823838d: baseline-arm64-clabbe 2026-03-20 15:37:07,374 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac69e537ae4d3c823838d 2026-03-20 15:37:07,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:37:07,387 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac69e537ae4d3c823838d HTTP/1.1" 200 None 2026-03-20 15:37:07,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:37:07,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:37:07,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:37:07,424 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac69e537ae4d3c823838d HTTP/1.1" 200 None 2026-03-20 15:37:07,426 - lava_callback - ERROR - Error processing callback for node 69bac69e537ae4d3c823838d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:43088 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:43098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53136 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34496 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38674 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52322 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53912 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.21.0.1:53926 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:38:47,414 - lava_callback - INFO - Received callback for node 69bac6f5537ae4d3c823839c INFO: 172.21.0.1:53928 - "POST /node/69bac6f5537ae4d3c823839c HTTP/1.0" 202 Accepted 2026-03-20 15:38:47,420 - lava_callback - INFO - Starting async job submit for node 69bac6f5537ae4d3c823839c 2026-03-20 15:38:47,420 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:38:47,435 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac6f5537ae4d3c823839c HTTP/1.1" 200 None 2026-03-20 15:38:47,435 - lava_callback - DEBUG - Processing node 69bac6f5537ae4d3c823839c: baseline-arm64-clabbe 2026-03-20 15:38:47,436 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac6f5537ae4d3c823839c 2026-03-20 15:38:47,436 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:38:47,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac6f5537ae4d3c823839c HTTP/1.1" 200 None 2026-03-20 15:38:47,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:38:47,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:38:47,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:38:47,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac6f5537ae4d3c823839c HTTP/1.1" 200 None 2026-03-20 15:38:47,502 - lava_callback - ERROR - Error processing callback for node 69bac6f5537ae4d3c823839c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:32982 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49416 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:59638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56014 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38094 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38106 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53942 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:40:07,462 - lava_callback - INFO - Received callback for node 69bac74a537ae4d3c82383a9 INFO: 172.21.0.1:53950 - "POST /node/69bac74a537ae4d3c82383a9 HTTP/1.0" 202 Accepted 2026-03-20 15:40:07,468 - lava_callback - INFO - Starting async job submit for node 69bac74a537ae4d3c82383a9 2026-03-20 15:40:07,469 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:40:07,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac74a537ae4d3c82383a9 HTTP/1.1" 200 None 2026-03-20 15:40:07,493 - lava_callback - DEBUG - Processing node 69bac74a537ae4d3c82383a9: baseline-arm64-clabbe 2026-03-20 15:40:07,493 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac74a537ae4d3c82383a9 2026-03-20 15:40:07,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:40:07,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac74a537ae4d3c82383a9 HTTP/1.1" 200 None 2026-03-20 15:40:07,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:40:07,540 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9ef90d5731cbd74145fce HTTP/1.1" 200 None 2026-03-20 15:40:07,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:40:07,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac74a537ae4d3c82383a9 HTTP/1.1" 200 None 2026-03-20 15:40:07,570 - lava_callback - ERROR - Error processing callback for node 69bac74a537ae4d3c82383a9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40952 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35766 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:39660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40266 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60926 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47100 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36262 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46512 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46226 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40030 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55166 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37294 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41822 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40770 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47356 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53276 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60662 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39720 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44224 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32914 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:32922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39054 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39642 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40366 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40332 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38974 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38984 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56064 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56066 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56382 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56386 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44442 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34664 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43162 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48924 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54828 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46914 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46922 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48908 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:50:07,672 - lava_callback - INFO - Received callback for node 69bac9a2537ae4d3c8238423 INFO: 172.21.0.1:48916 - "POST /node/69bac9a2537ae4d3c8238423 HTTP/1.0" 202 Accepted 2026-03-20 15:50:07,678 - lava_callback - INFO - Starting async job submit for node 69bac9a2537ae4d3c8238423 2026-03-20 15:50:07,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:50:07,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac9a2537ae4d3c8238423 HTTP/1.1" 200 None 2026-03-20 15:50:07,693 - lava_callback - DEBUG - Processing node 69bac9a2537ae4d3c8238423: baseline-arm64-baylibre 2026-03-20 15:50:07,694 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac9a2537ae4d3c8238423 2026-03-20 15:50:07,694 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:50:07,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac9a2537ae4d3c8238423 HTTP/1.1" 200 None 2026-03-20 15:50:07,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:50:07,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 15:50:07,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:50:07,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac9a2537ae4d3c8238423 HTTP/1.1" 200 None 2026-03-20 15:50:07,751 - lava_callback - ERROR - Error processing callback for node 69bac9a2537ae4d3c8238423: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:56598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:56608 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42940 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35344 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60798 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42166 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:51:27,656 - lava_callback - INFO - Received callback for node 69bac9f4537ae4d3c823842d INFO: 172.21.0.1:42168 - "POST /node/69bac9f4537ae4d3c823842d HTTP/1.0" 202 Accepted 2026-03-20 15:51:27,661 - lava_callback - INFO - Starting async job submit for node 69bac9f4537ae4d3c823842d 2026-03-20 15:51:27,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:51:27,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac9f4537ae4d3c823842d HTTP/1.1" 200 None 2026-03-20 15:51:27,678 - lava_callback - DEBUG - Processing node 69bac9f4537ae4d3c823842d: baseline-arm64-baylibre 2026-03-20 15:51:27,678 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bac9f4537ae4d3c823842d 2026-03-20 15:51:27,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:51:27,692 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bac9f4537ae4d3c823842d HTTP/1.1" 200 None 2026-03-20 15:51:27,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:51:27,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 15:51:27,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:51:27,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bac9f4537ae4d3c823842d HTTP/1.1" 200 None 2026-03-20 15:51:27,739 - lava_callback - ERROR - Error processing callback for node 69bac9f4537ae4d3c823842d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50638 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38020 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37074 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51144 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47814 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51286 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:52:47,738 - lava_callback - INFO - Received callback for node 69baca47537ae4d3c8238435 INFO: 172.21.0.1:51296 - "POST /node/69baca47537ae4d3c8238435 HTTP/1.0" 202 Accepted 2026-03-20 15:52:47,744 - lava_callback - INFO - Starting async job submit for node 69baca47537ae4d3c8238435 2026-03-20 15:52:47,745 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:52:47,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baca47537ae4d3c8238435 HTTP/1.1" 200 None 2026-03-20 15:52:47,760 - lava_callback - DEBUG - Processing node 69baca47537ae4d3c8238435: baseline-arm64-baylibre 2026-03-20 15:52:47,760 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baca47537ae4d3c8238435 2026-03-20 15:52:47,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:52:47,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baca47537ae4d3c8238435 HTTP/1.1" 200 None 2026-03-20 15:52:47,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:52:47,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 15:52:47,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:52:47,846 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baca47537ae4d3c8238435 HTTP/1.1" 200 None 2026-03-20 15:52:47,848 - lava_callback - ERROR - Error processing callback for node 69baca47537ae4d3c8238435: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:49172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34888 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:38308 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:38312 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37962 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46486 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44378 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32894 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:32904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40814 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:54:07,757 - lava_callback - INFO - Received callback for node 69baca9b537ae4d3c8238440 INFO: 172.21.0.1:40826 - "POST /node/69baca9b537ae4d3c8238440 HTTP/1.0" 202 Accepted 2026-03-20 15:54:07,763 - lava_callback - INFO - Starting async job submit for node 69baca9b537ae4d3c8238440 2026-03-20 15:54:07,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:54:07,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baca9b537ae4d3c8238440 HTTP/1.1" 200 None 2026-03-20 15:54:07,785 - lava_callback - DEBUG - Processing node 69baca9b537ae4d3c8238440: baseline-arm64-baylibre 2026-03-20 15:54:07,785 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baca9b537ae4d3c8238440 2026-03-20 15:54:07,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:54:07,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baca9b537ae4d3c8238440 HTTP/1.1" 200 None 2026-03-20 15:54:07,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:54:07,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 15:54:07,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:54:07,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baca9b537ae4d3c8238440 HTTP/1.1" 200 None 2026-03-20 15:54:07,849 - lava_callback - ERROR - Error processing callback for node 69baca9b537ae4d3c8238440: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:47698 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:47706 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42678 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35976 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:40306 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56340 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56342 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37240 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:44892 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58916 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48538 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52882 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:55:48,192 - lava_callback - INFO - Received callback for node 69bacaf0537ae4d3c823844c INFO: 172.21.0.1:52884 - "POST /node/69bacaf0537ae4d3c823844c HTTP/1.0" 202 Accepted 2026-03-20 15:55:48,198 - lava_callback - INFO - Starting async job submit for node 69bacaf0537ae4d3c823844c 2026-03-20 15:55:48,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:55:48,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacaf0537ae4d3c823844c HTTP/1.1" 200 None 2026-03-20 15:55:48,216 - lava_callback - DEBUG - Processing node 69bacaf0537ae4d3c823844c: baseline-arm64-baylibre 2026-03-20 15:55:48,217 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bacaf0537ae4d3c823844c 2026-03-20 15:55:48,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:55:48,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacaf0537ae4d3c823844c HTTP/1.1" 200 None 2026-03-20 15:55:48,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:55:48,245 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 15:55:48,247 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:55:48,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bacaf0537ae4d3c823844c HTTP/1.1" 200 None 2026-03-20 15:55:48,272 - lava_callback - ERROR - Error processing callback for node 69bacaf0537ae4d3c823844c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55762 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43196 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44078 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50812 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43930 - "GET / HTTP/1.0" 200 OK 2026-03-20 15:57:07,971 - lava_callback - INFO - Received callback for node 69bacb44537ae4d3c823845a INFO: 172.21.0.1:43940 - "POST /node/69bacb44537ae4d3c823845a HTTP/1.0" 202 Accepted 2026-03-20 15:57:07,976 - lava_callback - INFO - Starting async job submit for node 69bacb44537ae4d3c823845a 2026-03-20 15:57:07,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:57:07,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacb44537ae4d3c823845a HTTP/1.1" 200 None 2026-03-20 15:57:07,993 - lava_callback - DEBUG - Processing node 69bacb44537ae4d3c823845a: baseline-arm64-baylibre 2026-03-20 15:57:07,993 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bacb44537ae4d3c823845a 2026-03-20 15:57:07,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:57:08,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacb44537ae4d3c823845a HTTP/1.1" 200 None 2026-03-20 15:57:08,013 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:57:08,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 15:57:08,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 15:57:08,058 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bacb44537ae4d3c823845a HTTP/1.1" 200 None 2026-03-20 15:57:08,063 - lava_callback - ERROR - Error processing callback for node 69bacb44537ae4d3c823845a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:45542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53132 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42690 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51718 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54576 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:45864 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52352 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41502 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41506 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:51466 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:51472 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53450 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41590 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46782 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53980 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46666 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35836 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46172 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46180 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:60412 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49012 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:34542 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:01:28,377 - lava_callback - INFO - Received callback for node 69bacc44537ae4d3c8238478 INFO: 172.21.0.1:34552 - "POST /node/69bacc44537ae4d3c8238478 HTTP/1.0" 202 Accepted 2026-03-20 16:01:28,383 - lava_callback - INFO - Starting async job submit for node 69bacc44537ae4d3c8238478 2026-03-20 16:01:28,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:01:28,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacc44537ae4d3c8238478 HTTP/1.1" 200 None 2026-03-20 16:01:28,400 - lava_callback - DEBUG - Processing node 69bacc44537ae4d3c8238478: baseline-arm64-clabbe 2026-03-20 16:01:28,400 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bacc44537ae4d3c8238478 2026-03-20 16:01:28,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:01:28,457 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacc44537ae4d3c8238478 HTTP/1.1" 200 None 2026-03-20 16:01:28,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:01:28,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 16:01:28,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:01:28,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bacc44537ae4d3c8238478 HTTP/1.1" 200 None 2026-03-20 16:01:28,521 - lava_callback - ERROR - Error processing callback for node 69bacc44537ae4d3c8238478: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:38290 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47956 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42688 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43256 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:49730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:49736 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:43542 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44744 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53158 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:02:48,642 - lava_callback - INFO - Received callback for node 69bacc9a537ae4d3c8238485 INFO: 172.21.0.1:53168 - "POST /node/69bacc9a537ae4d3c8238485 HTTP/1.0" 202 Accepted 2026-03-20 16:02:48,647 - lava_callback - INFO - Starting async job submit for node 69bacc9a537ae4d3c8238485 2026-03-20 16:02:48,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:02:48,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacc9a537ae4d3c8238485 HTTP/1.1" 200 None 2026-03-20 16:02:48,667 - lava_callback - DEBUG - Processing node 69bacc9a537ae4d3c8238485: baseline-arm64-clabbe 2026-03-20 16:02:48,667 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bacc9a537ae4d3c8238485 2026-03-20 16:02:48,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:02:48,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacc9a537ae4d3c8238485 HTTP/1.1" 200 None 2026-03-20 16:02:48,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:02:48,702 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 16:02:48,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:02:48,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bacc9a537ae4d3c8238485 HTTP/1.1" 200 None 2026-03-20 16:02:48,725 - lava_callback - ERROR - Error processing callback for node 69bacc9a537ae4d3c8238485: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 16:02:55,077 - lava_callback - INFO - Received callback for node 69bad75d21a77312e222137d INFO: 172.21.0.1:42786 - "POST /node/69bad75d21a77312e222137d HTTP/1.0" 202 Accepted 2026-03-20 16:02:55,083 - lava_callback - INFO - Starting async job submit for node 69bad75d21a77312e222137d 2026-03-20 16:02:55,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:02:55,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad75d21a77312e222137d HTTP/1.1" 200 None 2026-03-20 16:02:55,116 - lava_callback - DEBUG - Processing node 69bad75d21a77312e222137d: baseline-x86 2026-03-20 16:02:55,408 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:02:55,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:02:55,575 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bad75d21a77312e222137d/log.txt.gz 2026-03-20 16:02:55,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:02:55,977 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:02:55,979 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bad75d21a77312e222137d/lava-logs.yaml INFO: 172.21.0.1:42802 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:02:55,988 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:02:56,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:02:56,135 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bad75d21a77312e222137d/lava_callback.json.gz 2026-03-20 16:02:56,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:02:56,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad75d21a77312e222137d HTTP/1.1" 200 None 2026-03-20 16:02:56,170 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:02:56,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0c221a77312e2220f0b HTTP/1.1" 200 None 2026-03-20 16:02:56,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:02:56,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bad75d21a77312e222137d HTTP/1.1" 200 None 2026-03-20 16:02:56,215 - lava_callback - INFO - Completed processing callback for node 69bad75d21a77312e222137d INFO: 172.21.0.1:42808 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53708 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:03:09,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:03:09,825 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:33818 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:33824 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57460 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58058 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55050 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37898 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37908 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39262 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:04:08,455 - lava_callback - INFO - Received callback for node 69baccef537ae4d3c8238492 INFO: 172.21.0.1:39276 - "POST /node/69baccef537ae4d3c8238492 HTTP/1.0" 202 Accepted 2026-03-20 16:04:08,461 - lava_callback - INFO - Starting async job submit for node 69baccef537ae4d3c8238492 2026-03-20 16:04:08,462 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:04:08,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baccef537ae4d3c8238492 HTTP/1.1" 200 None 2026-03-20 16:04:08,486 - lava_callback - DEBUG - Processing node 69baccef537ae4d3c8238492: baseline-arm64-clabbe 2026-03-20 16:04:08,486 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baccef537ae4d3c8238492 2026-03-20 16:04:08,487 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:04:08,500 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baccef537ae4d3c8238492 HTTP/1.1" 200 None 2026-03-20 16:04:08,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:04:08,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 16:04:08,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:04:08,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baccef537ae4d3c8238492 HTTP/1.1" 200 None 2026-03-20 16:04:08,548 - lava_callback - ERROR - Error processing callback for node 69baccef537ae4d3c8238492: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37618 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37628 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33614 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48900 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:52228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48570 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48578 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59458 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:48354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:48370 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:58770 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:05:48,586 - lava_callback - INFO - Received callback for node 69bacd47537ae4d3c823849b INFO: 172.21.0.1:58782 - "POST /node/69bacd47537ae4d3c823849b HTTP/1.0" 202 Accepted 2026-03-20 16:05:48,592 - lava_callback - INFO - Starting async job submit for node 69bacd47537ae4d3c823849b 2026-03-20 16:05:48,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:05:48,606 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacd47537ae4d3c823849b HTTP/1.1" 200 None 2026-03-20 16:05:48,607 - lava_callback - DEBUG - Processing node 69bacd47537ae4d3c823849b: baseline-arm64-clabbe 2026-03-20 16:05:48,607 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bacd47537ae4d3c823849b 2026-03-20 16:05:48,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:05:48,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacd47537ae4d3c823849b HTTP/1.1" 200 None 2026-03-20 16:05:48,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:05:48,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 16:05:48,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:05:48,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bacd47537ae4d3c823849b HTTP/1.1" 200 None 2026-03-20 16:05:48,669 - lava_callback - ERROR - Error processing callback for node 69bacd47537ae4d3c823849b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:55200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55208 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33098 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53240 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:53244 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57834 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53862 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47216 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:47228 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:33114 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:07:08,664 - lava_callback - INFO - Received callback for node 69bacd9d537ae4d3c82384ac INFO: 172.21.0.1:33122 - "POST /node/69bacd9d537ae4d3c82384ac HTTP/1.0" 202 Accepted 2026-03-20 16:07:08,670 - lava_callback - INFO - Starting async job submit for node 69bacd9d537ae4d3c82384ac 2026-03-20 16:07:08,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:07:08,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacd9d537ae4d3c82384ac HTTP/1.1" 200 None 2026-03-20 16:07:08,687 - lava_callback - DEBUG - Processing node 69bacd9d537ae4d3c82384ac: baseline-arm64-clabbe 2026-03-20 16:07:08,688 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bacd9d537ae4d3c82384ac 2026-03-20 16:07:08,688 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:07:08,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacd9d537ae4d3c82384ac HTTP/1.1" 200 None 2026-03-20 16:07:08,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:07:08,716 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 16:07:08,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:07:08,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bacd9d537ae4d3c82384ac HTTP/1.1" 200 None 2026-03-20 16:07:08,750 - lava_callback - ERROR - Error processing callback for node 69bacd9d537ae4d3c82384ac: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:37714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46284 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:07:33,089 - lava_callback - INFO - Received callback for node 69bb196421a77312e22220aa INFO: 172.21.0.1:35392 - "POST /node/69bb196421a77312e22220aa HTTP/1.0" 202 Accepted 2026-03-20 16:07:33,095 - lava_callback - INFO - Starting async job submit for node 69bb196421a77312e22220aa 2026-03-20 16:07:33,113 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:07:33,138 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb196421a77312e22220aa HTTP/1.1" 200 None 2026-03-20 16:07:33,139 - lava_callback - DEBUG - Processing node 69bb196421a77312e22220aa: baseline-x86 2026-03-20 16:07:33,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:07:33,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:07:33,595 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bb196421a77312e22220aa/log.txt.gz 2026-03-20 16:07:33,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:07:33,989 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:07:33,991 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bb196421a77312e22220aa/lava-logs.yaml 2026-03-20 16:07:33,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:07:34,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:07:34,157 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bb196421a77312e22220aa/lava_callback.json.gz 2026-03-20 16:07:34,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:07:34,189 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb196421a77312e22220aa HTTP/1.1" 200 None 2026-03-20 16:07:34,191 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:07:34,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f95537ae4d3c8236e6f HTTP/1.1" 200 None 2026-03-20 16:07:34,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:07:34,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb196421a77312e22220aa HTTP/1.1" 200 None 2026-03-20 16:07:34,239 - lava_callback - INFO - Completed processing callback for node 69bb196421a77312e22220aa INFO: 172.21.0.1:35396 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:07:39,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:07:39,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:41002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42200 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:39998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:40002 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53482 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:08:28,679 - lava_callback - INFO - Received callback for node 69bacdf2537ae4d3c82384bb INFO: 172.21.0.1:53488 - "POST /node/69bacdf2537ae4d3c82384bb HTTP/1.0" 202 Accepted 2026-03-20 16:08:28,685 - lava_callback - INFO - Starting async job submit for node 69bacdf2537ae4d3c82384bb 2026-03-20 16:08:28,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:08:28,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacdf2537ae4d3c82384bb HTTP/1.1" 200 None 2026-03-20 16:08:28,724 - lava_callback - DEBUG - Processing node 69bacdf2537ae4d3c82384bb: baseline-arm64-clabbe 2026-03-20 16:08:28,725 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bacdf2537ae4d3c82384bb 2026-03-20 16:08:28,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:08:28,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bacdf2537ae4d3c82384bb HTTP/1.1" 200 None 2026-03-20 16:08:28,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:08:28,752 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69ba5f7e537ae4d3c8236e55 HTTP/1.1" 200 None 2026-03-20 16:08:28,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:08:28,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bacdf2537ae4d3c82384bb HTTP/1.1" 200 None 2026-03-20 16:08:28,776 - lava_callback - ERROR - Error processing callback for node 69bacdf2537ae4d3c82384bb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55866 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35018 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35020 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:09:02,790 - lava_callback - INFO - Received callback for node 69bb2f3921a77312e22224ea INFO: 172.21.0.1:46156 - "POST /node/69bb2f3921a77312e22224ea HTTP/1.0" 202 Accepted 2026-03-20 16:09:02,796 - lava_callback - INFO - Starting async job submit for node 69bb2f3921a77312e22224ea 2026-03-20 16:09:02,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:09:02,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2f3921a77312e22224ea HTTP/1.1" 200 None 2026-03-20 16:09:02,828 - lava_callback - DEBUG - Processing node 69bb2f3921a77312e22224ea: baseline-x86 2026-03-20 16:09:03,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:09:03,308 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:09:03,310 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bb2f3921a77312e22224ea/log.txt.gz 2026-03-20 16:09:03,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:09:03,688 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:09:03,690 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bb2f3921a77312e22224ea/lava-logs.yaml 2026-03-20 16:09:03,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:09:03,849 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:09:03,850 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bb2f3921a77312e22224ea/lava_callback.json.gz 2026-03-20 16:09:03,868 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:09:03,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb2f3921a77312e22224ea HTTP/1.1" 200 None 2026-03-20 16:09:03,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:09:03,896 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bad0c221a77312e2220f0b HTTP/1.1" 200 None 2026-03-20 16:09:03,898 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:09:03,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb2f3921a77312e22224ea HTTP/1.1" 200 None 2026-03-20 16:09:03,933 - lava_callback - INFO - Completed processing callback for node 69bb2f3921a77312e22224ea INFO: 172.21.0.1:46164 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:09:09,846 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:09:09,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:37730 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:37740 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:59544 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:09:28,691 - lava_callback - INFO - Received callback for node 69bace34537ae4d3c82384c3 INFO: 172.21.0.1:59550 - "POST /node/69bace34537ae4d3c82384c3 HTTP/1.0" 202 Accepted 2026-03-20 16:09:28,697 - lava_callback - INFO - Starting async job submit for node 69bace34537ae4d3c82384c3 2026-03-20 16:09:28,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:09:28,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bace34537ae4d3c82384c3 HTTP/1.1" 200 None 2026-03-20 16:09:28,713 - lava_callback - DEBUG - Processing node 69bace34537ae4d3c82384c3: baseline-arm-baylibre 2026-03-20 16:09:28,713 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bace34537ae4d3c82384c3 2026-03-20 16:09:28,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:09:28,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bace34537ae4d3c82384c3 HTTP/1.1" 200 None 2026-03-20 16:09:28,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:09:28,764 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 16:09:28,765 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:09:28,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bace34537ae4d3c82384c3 HTTP/1.1" 200 None 2026-03-20 16:09:28,793 - lava_callback - ERROR - Error processing callback for node 69bace34537ae4d3c82384c3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:45710 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46368 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50874 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:50886 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42564 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:41980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:41996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:35780 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:10:28,700 - lava_callback - INFO - Received callback for node 69bace60537ae4d3c82384d3 INFO: 172.21.0.1:35794 - "POST /node/69bace60537ae4d3c82384d3 HTTP/1.0" 202 Accepted 2026-03-20 16:10:28,705 - lava_callback - INFO - Starting async job submit for node 69bace60537ae4d3c82384d3 2026-03-20 16:10:28,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:10:28,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bace60537ae4d3c82384d3 HTTP/1.1" 200 None 2026-03-20 16:10:28,723 - lava_callback - DEBUG - Processing node 69bace60537ae4d3c82384d3: baseline-arm-baylibre 2026-03-20 16:10:28,723 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bace60537ae4d3c82384d3 2026-03-20 16:10:28,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:10:28,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bace60537ae4d3c82384d3 HTTP/1.1" 200 None 2026-03-20 16:10:28,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:10:28,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 16:10:28,760 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:10:28,781 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bace60537ae4d3c82384d3 HTTP/1.1" 200 None 2026-03-20 16:10:28,783 - lava_callback - ERROR - Error processing callback for node 69bace60537ae4d3c82384d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:53610 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:36996 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:37006 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:42894 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:11:08,737 - lava_callback - INFO - Received callback for node 69bace8b537ae4d3c82384e0 INFO: 172.21.0.1:42906 - "POST /node/69bace8b537ae4d3c82384e0 HTTP/1.0" 202 Accepted 2026-03-20 16:11:08,743 - lava_callback - INFO - Starting async job submit for node 69bace8b537ae4d3c82384e0 2026-03-20 16:11:08,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:08,758 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bace8b537ae4d3c82384e0 HTTP/1.1" 200 None 2026-03-20 16:11:08,759 - lava_callback - DEBUG - Processing node 69bace8b537ae4d3c82384e0: baseline-arm-baylibre 2026-03-20 16:11:08,759 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69bace8b537ae4d3c82384e0 2026-03-20 16:11:08,759 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:08,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bace8b537ae4d3c82384e0 HTTP/1.1" 200 None 2026-03-20 16:11:08,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:08,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 16:11:08,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:08,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bace8b537ae4d3c82384e0 HTTP/1.1" 200 None 2026-03-20 16:11:08,818 - lava_callback - ERROR - Error processing callback for node 69bace8b537ae4d3c82384e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-20 16:11:10,887 - lava_callback - INFO - Received callback for node 69bb44eba1e2bfb1b3346a03 INFO: 172.21.0.1:55144 - "POST /node/69bb44eba1e2bfb1b3346a03 HTTP/1.0" 202 Accepted 2026-03-20 16:11:10,893 - lava_callback - INFO - Starting async job submit for node 69bb44eba1e2bfb1b3346a03 2026-03-20 16:11:10,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:10,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb44eba1e2bfb1b3346a03 HTTP/1.1" 200 None 2026-03-20 16:11:10,926 - lava_callback - DEBUG - Processing node 69bb44eba1e2bfb1b3346a03: baseline-x86 2026-03-20 16:11:11,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:11:11,366 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:11:11,367 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bb44eba1e2bfb1b3346a03/log.txt.gz 2026-03-20 16:11:11,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:11:11,790 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:11:11,792 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bb44eba1e2bfb1b3346a03/lava-logs.yaml 2026-03-20 16:11:11,799 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-20 16:11:11,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-20 16:11:11,963 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bb44eba1e2bfb1b3346a03/lava_callback.json.gz 2026-03-20 16:11:11,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:11,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb44eba1e2bfb1b3346a03 HTTP/1.1" 200 None 2026-03-20 16:11:11,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:12,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bb40e5a1e2bfb1b3344416 HTTP/1.1" 200 None 2026-03-20 16:11:12,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:12,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bb44eba1e2bfb1b3346a03 HTTP/1.1" 200 None 2026-03-20 16:11:12,043 - lava_callback - INFO - Completed processing callback for node 69bb44eba1e2bfb1b3346a03 INFO: 172.21.0.1:55148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:55156 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:55302 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:57660 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:11:39,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:39,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.21.0.1:50530 - "GET / HTTP/1.0" 200 OK 2026-03-20 16:11:48,742 - lava_callback - INFO - Received callback for node 69baceb7537ae4d3c82384eb INFO: 172.21.0.1:50538 - "POST /node/69baceb7537ae4d3c82384eb HTTP/1.0" 202 Accepted 2026-03-20 16:11:48,748 - lava_callback - INFO - Starting async job submit for node 69baceb7537ae4d3c82384eb 2026-03-20 16:11:48,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:48,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baceb7537ae4d3c82384eb HTTP/1.1" 200 None 2026-03-20 16:11:48,767 - lava_callback - DEBUG - Processing node 69baceb7537ae4d3c82384eb: baseline-arm-baylibre 2026-03-20 16:11:48,767 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69baceb7537ae4d3c82384eb 2026-03-20 16:11:48,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:48,783 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69baceb7537ae4d3c82384eb HTTP/1.1" 200 None 2026-03-20 16:11:48,784 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:48,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7cd6400b80c8ffdcb829f HTTP/1.1" 200 None 2026-03-20 16:11:48,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-20 16:11:48,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69baceb7537ae4d3c82384eb HTTP/1.1" 200 None 2026-03-20 16:11:48,845 - lava_callback - ERROR - Error processing callback for node 69baceb7537ae4d3c82384eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.21.0.1:44322 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:44334 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.21.0.1:46050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.21.0.1:46062 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]