INFO: Started server process [1] INFO: Waiting for application startup. INFO: Application startup complete. INFO: Uvicorn running on http://0.0.0.0:8000 (Press CTRL+C to quit) INFO: 172.20.0.1:35594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37332 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58080 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49074 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36448 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58460 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60082 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44996 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33486 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:31:11,474 - lava_callback - INFO - Received callback for node 69bbb3d1ec3f435d20d51ae6 2026-03-19 08:31:11,482 - lava_callback - INFO - Starting async job submit for node 69bbb3d1ec3f435d20d51ae6 INFO: 172.20.0.1:36222 - "POST /node/69bbb3d1ec3f435d20d51ae6 HTTP/1.0" 202 Accepted 2026-03-19 08:31:11,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:31:11,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb3d1ec3f435d20d51ae6 HTTP/1.1" 200 None 2026-03-19 08:31:11,528 - lava_callback - DEBUG - Processing node 69bbb3d1ec3f435d20d51ae6: baseline-arm 2026-03-19 08:31:11,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:31:11,951 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:31:11,953 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb3d1ec3f435d20d51ae6/log.txt.gz 2026-03-19 08:31:12,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:31:12,278 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:31:12,280 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb3d1ec3f435d20d51ae6/lava-logs.yaml 2026-03-19 08:31:12,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:31:12,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:31:12,507 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb3d1ec3f435d20d51ae6/lava_callback.json.gz 2026-03-19 08:31:12,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:31:12,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb3d1ec3f435d20d51ae6 HTTP/1.1" 200 None 2026-03-19 08:31:12,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:31:12,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb135ec3f435d20d51a9e HTTP/1.1" 200 None 2026-03-19 08:31:12,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:31:12,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb3d1ec3f435d20d51ae6 HTTP/1.1" 200 None 2026-03-19 08:31:12,597 - lava_callback - INFO - Completed processing callback for node 69bbb3d1ec3f435d20d51ae6 INFO: 172.20.0.1:36234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42998 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:31:42,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:31:42,616 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37020 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41266 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47612 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39212 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52372 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:37:44,726 - lava_callback - INFO - Received callback for node 69b912cb0ec88e58bad0d80e INFO: 172.20.0.1:37722 - "POST /node/69b912cb0ec88e58bad0d80e HTTP/1.0" 202 Accepted 2026-03-19 08:37:44,732 - lava_callback - INFO - Starting async job submit for node 69b912cb0ec88e58bad0d80e 2026-03-19 08:37:44,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:37:44,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912cb0ec88e58bad0d80e HTTP/1.1" 200 None 2026-03-19 08:37:44,779 - lava_callback - DEBUG - Processing node 69b912cb0ec88e58bad0d80e: baseline-arm-baylibre 2026-03-19 08:37:44,780 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b912cb0ec88e58bad0d80e 2026-03-19 08:37:44,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:37:44,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912cb0ec88e58bad0d80e HTTP/1.1" 200 None 2026-03-19 08:37:44,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:37:44,857 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 08:37:44,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:37:44,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912cb0ec88e58bad0d80e HTTP/1.1" 200 None 2026-03-19 08:37:44,888 - lava_callback - ERROR - Error processing callback for node 69b912cb0ec88e58bad0d80e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44516 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:38:24,560 - lava_callback - INFO - Received callback for node 69b912f30ec88e58bad0d83b INFO: 172.20.0.1:35370 - "POST /node/69b912f30ec88e58bad0d83b HTTP/1.0" 202 Accepted 2026-03-19 08:38:24,566 - lava_callback - INFO - Starting async job submit for node 69b912f30ec88e58bad0d83b 2026-03-19 08:38:24,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:24,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f30ec88e58bad0d83b HTTP/1.1" 200 None 2026-03-19 08:38:24,582 - lava_callback - DEBUG - Processing node 69b912f30ec88e58bad0d83b: baseline-arm-baylibre 2026-03-19 08:38:24,583 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b912f30ec88e58bad0d83b 2026-03-19 08:38:24,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:24,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f30ec88e58bad0d83b HTTP/1.1" 200 None 2026-03-19 08:38:24,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:24,611 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 08:38:24,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:24,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912f30ec88e58bad0d83b HTTP/1.1" 200 None 2026-03-19 08:38:24,644 - lava_callback - ERROR - Error processing callback for node 69b912f30ec88e58bad0d83b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:38:25,211 - lava_callback - INFO - Received callback for node 69b912f30ec88e58bad0d83d INFO: 172.20.0.1:35384 - "POST /node/69b912f30ec88e58bad0d83d HTTP/1.0" 202 Accepted 2026-03-19 08:38:25,216 - lava_callback - INFO - Starting async job submit for node 69b912f30ec88e58bad0d83d 2026-03-19 08:38:25,217 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:25,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f30ec88e58bad0d83d HTTP/1.1" 200 None 2026-03-19 08:38:25,235 - lava_callback - DEBUG - Processing node 69b912f30ec88e58bad0d83d: baseline-arm-baylibre 2026-03-19 08:38:25,235 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b912f30ec88e58bad0d83d 2026-03-19 08:38:25,236 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:25,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f30ec88e58bad0d83d HTTP/1.1" 200 None 2026-03-19 08:38:25,251 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:25,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 08:38:25,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:25,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912f30ec88e58bad0d83d HTTP/1.1" 200 None 2026-03-19 08:38:25,318 - lava_callback - ERROR - Error processing callback for node 69b912f30ec88e58bad0d83d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:38:25,894 - lava_callback - INFO - Received callback for node 69b912f40ec88e58bad0d841 INFO: 172.20.0.1:35392 - "POST /node/69b912f40ec88e58bad0d841 HTTP/1.0" 202 Accepted 2026-03-19 08:38:25,900 - lava_callback - INFO - Starting async job submit for node 69b912f40ec88e58bad0d841 2026-03-19 08:38:25,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:25,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f40ec88e58bad0d841 HTTP/1.1" 200 None 2026-03-19 08:38:25,946 - lava_callback - DEBUG - Processing node 69b912f40ec88e58bad0d841: baseline-arm-baylibre 2026-03-19 08:38:25,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b912f40ec88e58bad0d841 2026-03-19 08:38:25,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:25,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f40ec88e58bad0d841 HTTP/1.1" 200 None 2026-03-19 08:38:25,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:25,980 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 08:38:25,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:26,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912f40ec88e58bad0d841 HTTP/1.1" 200 None 2026-03-19 08:38:26,008 - lava_callback - ERROR - Error processing callback for node 69b912f40ec88e58bad0d841: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35400 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:38:26,543 - lava_callback - INFO - Received callback for node 69b912f60ec88e58bad0d844 INFO: 172.20.0.1:35416 - "POST /node/69b912f60ec88e58bad0d844 HTTP/1.0" 202 Accepted 2026-03-19 08:38:26,549 - lava_callback - INFO - Starting async job submit for node 69b912f60ec88e58bad0d844 2026-03-19 08:38:26,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:26,570 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f60ec88e58bad0d844 HTTP/1.1" 200 None 2026-03-19 08:38:26,571 - lava_callback - DEBUG - Processing node 69b912f60ec88e58bad0d844: baseline-arm-baylibre 2026-03-19 08:38:26,571 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b912f60ec88e58bad0d844 2026-03-19 08:38:26,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:26,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f60ec88e58bad0d844 HTTP/1.1" 200 None 2026-03-19 08:38:26,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:26,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 08:38:26,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:26,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912f60ec88e58bad0d844 HTTP/1.1" 200 None 2026-03-19 08:38:26,627 - lava_callback - ERROR - Error processing callback for node 69b912f60ec88e58bad0d844: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35420 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:38:27,244 - lava_callback - INFO - Received callback for node 69b912f70ec88e58bad0d847 INFO: 172.20.0.1:35434 - "POST /node/69b912f70ec88e58bad0d847 HTTP/1.0" 202 Accepted 2026-03-19 08:38:27,249 - lava_callback - INFO - Starting async job submit for node 69b912f70ec88e58bad0d847 2026-03-19 08:38:27,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:27,265 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f70ec88e58bad0d847 HTTP/1.1" 200 None 2026-03-19 08:38:27,266 - lava_callback - DEBUG - Processing node 69b912f70ec88e58bad0d847: baseline-arm-baylibre 2026-03-19 08:38:27,266 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b912f70ec88e58bad0d847 2026-03-19 08:38:27,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:27,280 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912f70ec88e58bad0d847 HTTP/1.1" 200 None 2026-03-19 08:38:27,281 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:27,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 08:38:27,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:27,316 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912f70ec88e58bad0d847 HTTP/1.1" 200 None 2026-03-19 08:38:27,321 - lava_callback - ERROR - Error processing callback for node 69b912f70ec88e58bad0d847: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:38:27,906 - lava_callback - INFO - Received callback for node 69b912fa0ec88e58bad0d865 INFO: 172.20.0.1:35448 - "POST /node/69b912fa0ec88e58bad0d865 HTTP/1.0" 202 Accepted 2026-03-19 08:38:27,911 - lava_callback - INFO - Starting async job submit for node 69b912fa0ec88e58bad0d865 2026-03-19 08:38:27,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:27,930 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912fa0ec88e58bad0d865 HTTP/1.1" 200 None 2026-03-19 08:38:27,931 - lava_callback - DEBUG - Processing node 69b912fa0ec88e58bad0d865: baseline-arm-baylibre 2026-03-19 08:38:27,931 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b912fa0ec88e58bad0d865 2026-03-19 08:38:27,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:27,945 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912fa0ec88e58bad0d865 HTTP/1.1" 200 None 2026-03-19 08:38:27,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:27,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 08:38:27,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:27,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912fa0ec88e58bad0d865 HTTP/1.1" 200 None 2026-03-19 08:38:27,986 - lava_callback - ERROR - Error processing callback for node 69b912fa0ec88e58bad0d865: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:38:28,584 - lava_callback - INFO - Received callback for node 69b912fb0ec88e58bad0d868 INFO: 172.20.0.1:35454 - "POST /node/69b912fb0ec88e58bad0d868 HTTP/1.0" 202 Accepted 2026-03-19 08:38:28,590 - lava_callback - INFO - Starting async job submit for node 69b912fb0ec88e58bad0d868 2026-03-19 08:38:28,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:28,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912fb0ec88e58bad0d868 HTTP/1.1" 200 None 2026-03-19 08:38:28,606 - lava_callback - DEBUG - Processing node 69b912fb0ec88e58bad0d868: baseline-arm-baylibre 2026-03-19 08:38:28,606 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b912fb0ec88e58bad0d868 2026-03-19 08:38:28,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:28,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b912fb0ec88e58bad0d868 HTTP/1.1" 200 None 2026-03-19 08:38:28,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:28,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 08:38:28,636 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:28,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b912fb0ec88e58bad0d868 HTTP/1.1" 200 None 2026-03-19 08:38:28,659 - lava_callback - ERROR - Error processing callback for node 69b912fb0ec88e58bad0d868: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44136 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:38:40,897 - lava_callback - INFO - Received callback for node 69b913030ec88e58bad0d87d INFO: 172.20.0.1:52336 - "POST /node/69b913030ec88e58bad0d87d HTTP/1.0" 202 Accepted 2026-03-19 08:38:40,902 - lava_callback - INFO - Starting async job submit for node 69b913030ec88e58bad0d87d 2026-03-19 08:38:40,903 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:40,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913030ec88e58bad0d87d HTTP/1.1" 200 None 2026-03-19 08:38:40,919 - lava_callback - DEBUG - Processing node 69b913030ec88e58bad0d87d: baseline-arm-clabbe 2026-03-19 08:38:40,919 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b913030ec88e58bad0d87d 2026-03-19 08:38:40,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:40,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913030ec88e58bad0d87d HTTP/1.1" 200 None 2026-03-19 08:38:40,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:40,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 08:38:40,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:40,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913030ec88e58bad0d87d HTTP/1.1" 200 None 2026-03-19 08:38:40,983 - lava_callback - ERROR - Error processing callback for node 69b913030ec88e58bad0d87d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:38:41,564 - lava_callback - INFO - Received callback for node 69b913070ec88e58bad0d88c INFO: 172.20.0.1:52342 - "POST /node/69b913070ec88e58bad0d88c HTTP/1.0" 202 Accepted 2026-03-19 08:38:41,569 - lava_callback - INFO - Starting async job submit for node 69b913070ec88e58bad0d88c 2026-03-19 08:38:41,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:41,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913070ec88e58bad0d88c HTTP/1.1" 200 None 2026-03-19 08:38:41,586 - lava_callback - DEBUG - Processing node 69b913070ec88e58bad0d88c: baseline-arm-clabbe 2026-03-19 08:38:41,586 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b913070ec88e58bad0d88c 2026-03-19 08:38:41,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:41,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913070ec88e58bad0d88c HTTP/1.1" 200 None 2026-03-19 08:38:41,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:41,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 08:38:41,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:41,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913070ec88e58bad0d88c HTTP/1.1" 200 None 2026-03-19 08:38:41,645 - lava_callback - ERROR - Error processing callback for node 69b913070ec88e58bad0d88c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:38:42,221 - lava_callback - INFO - Received callback for node 69b913080ec88e58bad0d88f INFO: 172.20.0.1:52354 - "POST /node/69b913080ec88e58bad0d88f HTTP/1.0" 202 Accepted 2026-03-19 08:38:42,226 - lava_callback - INFO - Starting async job submit for node 69b913080ec88e58bad0d88f 2026-03-19 08:38:42,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:42,241 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913080ec88e58bad0d88f HTTP/1.1" 200 None 2026-03-19 08:38:42,242 - lava_callback - DEBUG - Processing node 69b913080ec88e58bad0d88f: baseline-arm-clabbe 2026-03-19 08:38:42,242 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b913080ec88e58bad0d88f 2026-03-19 08:38:42,243 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:42,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913080ec88e58bad0d88f HTTP/1.1" 200 None 2026-03-19 08:38:42,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:42,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 08:38:42,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:42,294 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913080ec88e58bad0d88f HTTP/1.1" 200 None 2026-03-19 08:38:42,295 - lava_callback - ERROR - Error processing callback for node 69b913080ec88e58bad0d88f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:38:42,879 - lava_callback - INFO - Received callback for node 69b913080ec88e58bad0d892 INFO: 172.20.0.1:52368 - "POST /node/69b913080ec88e58bad0d892 HTTP/1.0" 202 Accepted 2026-03-19 08:38:42,885 - lava_callback - INFO - Starting async job submit for node 69b913080ec88e58bad0d892 2026-03-19 08:38:42,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:42,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913080ec88e58bad0d892 HTTP/1.1" 200 None 2026-03-19 08:38:42,905 - lava_callback - DEBUG - Processing node 69b913080ec88e58bad0d892: baseline-arm-clabbe 2026-03-19 08:38:42,905 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b913080ec88e58bad0d892 2026-03-19 08:38:42,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:42,927 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b913080ec88e58bad0d892 HTTP/1.1" 200 None 2026-03-19 08:38:42,928 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:42,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 08:38:42,942 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:42,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b913080ec88e58bad0d892 HTTP/1.1" 200 None 2026-03-19 08:38:42,964 - lava_callback - ERROR - Error processing callback for node 69b913080ec88e58bad0d892: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:38:43,536 - lava_callback - INFO - Received callback for node 69b9130b0ec88e58bad0d89b INFO: 172.20.0.1:52384 - "POST /node/69b9130b0ec88e58bad0d89b HTTP/1.0" 202 Accepted 2026-03-19 08:38:43,541 - lava_callback - INFO - Starting async job submit for node 69b9130b0ec88e58bad0d89b 2026-03-19 08:38:43,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:43,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9130b0ec88e58bad0d89b HTTP/1.1" 200 None 2026-03-19 08:38:43,557 - lava_callback - DEBUG - Processing node 69b9130b0ec88e58bad0d89b: baseline-arm-clabbe 2026-03-19 08:38:43,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9130b0ec88e58bad0d89b 2026-03-19 08:38:43,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:43,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9130b0ec88e58bad0d89b HTTP/1.1" 200 None 2026-03-19 08:38:43,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:43,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 08:38:43,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:38:43,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9130b0ec88e58bad0d89b HTTP/1.1" 200 None 2026-03-19 08:38:43,616 - lava_callback - ERROR - Error processing callback for node 69b9130b0ec88e58bad0d89b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34264 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:40:47,729 - lava_callback - INFO - Received callback for node 69bbb686ec3f435d20d51b4f INFO: 172.20.0.1:34278 - "POST /node/69bbb686ec3f435d20d51b4f HTTP/1.0" 202 Accepted 2026-03-19 08:40:47,735 - lava_callback - INFO - Starting async job submit for node 69bbb686ec3f435d20d51b4f 2026-03-19 08:40:47,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:40:47,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb686ec3f435d20d51b4f HTTP/1.1" 200 None 2026-03-19 08:40:47,754 - lava_callback - DEBUG - Processing node 69bbb686ec3f435d20d51b4f: baseline-x86 2026-03-19 08:40:47,759 - lava_callback - WARNING - Failed to upload log 2026-03-19 08:40:47,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:40:48,044 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:40:48,046 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb686ec3f435d20d51b4f/lava-logs.yaml 2026-03-19 08:40:48,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:40:48,184 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:40:48,186 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb686ec3f435d20d51b4f/lava_callback.json.gz 2026-03-19 08:40:48,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:40:48,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb686ec3f435d20d51b4f HTTP/1.1" 200 None 2026-03-19 08:40:48,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:40:48,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb14fec3f435d20d51ac2 HTTP/1.1" 200 None 2026-03-19 08:40:48,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:40:48,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb686ec3f435d20d51b4f HTTP/1.1" 200 None 2026-03-19 08:40:48,280 - lava_callback - INFO - Completed processing callback for node 69bbb686ec3f435d20d51b4f INFO: 172.20.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38340 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:41:12,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:41:12,641 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-19 08:41:13,826 - lava_callback - INFO - Received callback for node 69bbb688ec3f435d20d51b58 INFO: 172.20.0.1:49266 - "POST /node/69bbb688ec3f435d20d51b58 HTTP/1.0" 202 Accepted 2026-03-19 08:41:13,832 - lava_callback - INFO - Starting async job submit for node 69bbb688ec3f435d20d51b58 2026-03-19 08:41:13,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:41:13,865 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb688ec3f435d20d51b58 HTTP/1.1" 200 None 2026-03-19 08:41:13,866 - lava_callback - DEBUG - Processing node 69bbb688ec3f435d20d51b58: baseline-x86 2026-03-19 08:41:14,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:41:14,173 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:41:14,175 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb688ec3f435d20d51b58/log.txt.gz 2026-03-19 08:41:14,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:41:14,452 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:41:14,454 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb688ec3f435d20d51b58/lava-logs.yaml 2026-03-19 08:41:14,459 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:41:14,605 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:41:14,607 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb688ec3f435d20d51b58/lava_callback.json.gz 2026-03-19 08:41:14,629 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:41:14,644 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb688ec3f435d20d51b58 HTTP/1.1" 200 None 2026-03-19 08:41:14,645 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:41:14,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb14fec3f435d20d51ac2 HTTP/1.1" 200 None 2026-03-19 08:41:14,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:41:14,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb688ec3f435d20d51b58 HTTP/1.1" 200 None 2026-03-19 08:41:14,691 - lava_callback - INFO - Completed processing callback for node 69bbb688ec3f435d20d51b58 INFO: 172.20.0.1:49268 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33430 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:41:42,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:41:42,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60774 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:41:58,083 - lava_callback - INFO - Received callback for node 69bbb687ec3f435d20d51b55 INFO: 172.20.0.1:60788 - "POST /node/69bbb687ec3f435d20d51b55 HTTP/1.0" 202 Accepted 2026-03-19 08:41:58,093 - lava_callback - INFO - Starting async job submit for node 69bbb687ec3f435d20d51b55 2026-03-19 08:41:58,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:41:58,157 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb687ec3f435d20d51b55 HTTP/1.1" 200 None 2026-03-19 08:41:58,159 - lava_callback - DEBUG - Processing node 69bbb687ec3f435d20d51b55: baseline-x86 2026-03-19 08:41:58,478 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:41:58,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:41:58,860 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb687ec3f435d20d51b55/log.txt.gz 2026-03-19 08:41:59,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:41:59,560 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:41:59,563 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb687ec3f435d20d51b55/lava-logs.yaml 2026-03-19 08:41:59,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:41:59,765 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:41:59,768 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb687ec3f435d20d51b55/lava_callback.json.gz 2026-03-19 08:41:59,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:41:59,813 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb687ec3f435d20d51b55 HTTP/1.1" 200 None 2026-03-19 08:41:59,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:41:59,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb14fec3f435d20d51ac2 HTTP/1.1" 200 None 2026-03-19 08:41:59,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:41:59,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb687ec3f435d20d51b55 HTTP/1.1" 200 None 2026-03-19 08:41:59,861 - lava_callback - INFO - Completed processing callback for node 69bbb687ec3f435d20d51b55 INFO: 172.20.0.1:35720 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:42:12,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:42:12,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60676 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:42:34,873 - lava_callback - INFO - Received callback for node 69bbb686ec3f435d20d51b52 INFO: 172.20.0.1:60636 - "POST /node/69bbb686ec3f435d20d51b52 HTTP/1.0" 202 Accepted 2026-03-19 08:42:34,883 - lava_callback - INFO - Starting async job submit for node 69bbb686ec3f435d20d51b52 2026-03-19 08:42:34,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:42:34,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb686ec3f435d20d51b52 HTTP/1.1" 200 None 2026-03-19 08:42:34,953 - lava_callback - DEBUG - Processing node 69bbb686ec3f435d20d51b52: baseline-x86 2026-03-19 08:42:35,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:42:35,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:42:35,653 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb686ec3f435d20d51b52/log.txt.gz 2026-03-19 08:42:35,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:42:36,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:42:36,360 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb686ec3f435d20d51b52/lava-logs.yaml 2026-03-19 08:42:36,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:60646 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:42:36,546 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:42:36,547 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb686ec3f435d20d51b52/lava_callback.json.gz 2026-03-19 08:42:36,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:42:36,580 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb686ec3f435d20d51b52 HTTP/1.1" 200 None 2026-03-19 08:42:36,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:42:36,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb14fec3f435d20d51ac2 HTTP/1.1" 200 None 2026-03-19 08:42:36,596 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:42:36,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb686ec3f435d20d51b52 HTTP/1.1" 200 None 2026-03-19 08:42:36,622 - lava_callback - INFO - Completed processing callback for node 69bbb686ec3f435d20d51b52 2026-03-19 08:42:42,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:42:42,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:52786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39752 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:43:24,917 - lava_callback - INFO - Received callback for node 69b9141c0ec88e58bad0da49 INFO: 172.20.0.1:40318 - "POST /node/69b9141c0ec88e58bad0da49 HTTP/1.0" 202 Accepted 2026-03-19 08:43:24,924 - lava_callback - INFO - Starting async job submit for node 69b9141c0ec88e58bad0da49 2026-03-19 08:43:24,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:43:24,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9141c0ec88e58bad0da49 HTTP/1.1" 200 None 2026-03-19 08:43:24,943 - lava_callback - DEBUG - Processing node 69b9141c0ec88e58bad0da49: baseline-arm-baylibre 2026-03-19 08:43:24,943 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9141c0ec88e58bad0da49 2026-03-19 08:43:24,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:43:24,962 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9141c0ec88e58bad0da49 HTTP/1.1" 200 None 2026-03-19 08:43:24,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:43:24,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 08:43:24,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:43:25,009 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9141c0ec88e58bad0da49 HTTP/1.1" 200 None 2026-03-19 08:43:25,012 - lava_callback - ERROR - Error processing callback for node 69b9141c0ec88e58bad0da49: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43348 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43350 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:44:24,916 - lava_callback - INFO - Received callback for node 69b914670ec88e58bad0da81 INFO: 172.20.0.1:39700 - "POST /node/69b914670ec88e58bad0da81 HTTP/1.0" 202 Accepted 2026-03-19 08:44:24,926 - lava_callback - INFO - Starting async job submit for node 69b914670ec88e58bad0da81 2026-03-19 08:44:24,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:44:24,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914670ec88e58bad0da81 HTTP/1.1" 200 None 2026-03-19 08:44:24,955 - lava_callback - DEBUG - Processing node 69b914670ec88e58bad0da81: baseline-arm-baylibre 2026-03-19 08:44:24,955 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b914670ec88e58bad0da81 2026-03-19 08:44:24,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:44:24,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914670ec88e58bad0da81 HTTP/1.1" 200 None 2026-03-19 08:44:24,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:44:25,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 08:44:25,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:44:25,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b914670ec88e58bad0da81 HTTP/1.1" 200 None 2026-03-19 08:44:25,066 - lava_callback - ERROR - Error processing callback for node 69b914670ec88e58bad0da81: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55936 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:45:13,968 - lava_callback - INFO - Received callback for node 69bbb791ec3f435d20d51bd7 INFO: 172.20.0.1:40922 - "POST /node/69bbb791ec3f435d20d51bd7 HTTP/1.0" 202 Accepted 2026-03-19 08:45:13,974 - lava_callback - INFO - Starting async job submit for node 69bbb791ec3f435d20d51bd7 2026-03-19 08:45:13,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:45:13,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb791ec3f435d20d51bd7 HTTP/1.1" 200 None 2026-03-19 08:45:13,994 - lava_callback - DEBUG - Processing node 69bbb791ec3f435d20d51bd7: baseline-arm 2026-03-19 08:45:13,999 - lava_callback - WARNING - Failed to upload log 2026-03-19 08:45:14,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:45:14,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:45:14,125 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb791ec3f435d20d51bd7/lava-logs.yaml 2026-03-19 08:45:14,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:45:14,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:45:14,330 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb791ec3f435d20d51bd7/lava_callback.json.gz 2026-03-19 08:45:14,333 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:45:14,347 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb791ec3f435d20d51bd7 HTTP/1.1" 200 None 2026-03-19 08:45:14,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:45:14,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:45:14,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:45:14,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb791ec3f435d20d51bd7 HTTP/1.1" 200 None 2026-03-19 08:45:14,397 - lava_callback - INFO - Completed processing callback for node 69bbb791ec3f435d20d51bd7 INFO: 172.20.0.1:40934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56028 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:45:39,290 - lava_callback - INFO - Received callback for node 69bbb792ec3f435d20d51bda INFO: 172.20.0.1:56040 - "POST /node/69bbb792ec3f435d20d51bda HTTP/1.0" 202 Accepted 2026-03-19 08:45:39,338 - lava_callback - INFO - Starting async job submit for node 69bbb792ec3f435d20d51bda 2026-03-19 08:45:39,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:45:39,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb792ec3f435d20d51bda HTTP/1.1" 200 None 2026-03-19 08:45:39,374 - lava_callback - DEBUG - Processing node 69bbb792ec3f435d20d51bda: baseline-arm 2026-03-19 08:45:39,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:45:39,711 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:45:39,712 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb792ec3f435d20d51bda/log.txt.gz 2026-03-19 08:45:39,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:45:40,035 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:45:40,037 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb792ec3f435d20d51bda/lava-logs.yaml 2026-03-19 08:45:40,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:45:40,158 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:45:40,160 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb792ec3f435d20d51bda/lava_callback.json.gz 2026-03-19 08:45:40,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:45:40,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb792ec3f435d20d51bda HTTP/1.1" 200 None 2026-03-19 08:45:40,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:45:40,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:45:40,212 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:45:40,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb792ec3f435d20d51bda HTTP/1.1" 200 None 2026-03-19 08:45:40,239 - lava_callback - INFO - Completed processing callback for node 69bbb792ec3f435d20d51bda 2026-03-19 08:45:42,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:45:42,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43596 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:46:01,088 - lava_callback - INFO - Received callback for node 69b914b40ec88e58bad0dacf INFO: 172.20.0.1:50330 - "POST /node/69b914b40ec88e58bad0dacf HTTP/1.0" 202 Accepted 2026-03-19 08:46:01,100 - lava_callback - INFO - Starting async job submit for node 69b914b40ec88e58bad0dacf 2026-03-19 08:46:01,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:01,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914b40ec88e58bad0dacf HTTP/1.1" 200 None 2026-03-19 08:46:01,129 - lava_callback - DEBUG - Processing node 69b914b40ec88e58bad0dacf: baseline-arm-clabbe 2026-03-19 08:46:01,129 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b914b40ec88e58bad0dacf 2026-03-19 08:46:01,130 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:01,145 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914b40ec88e58bad0dacf HTTP/1.1" 200 None 2026-03-19 08:46:01,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:01,160 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 08:46:01,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:01,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b914b40ec88e58bad0dacf HTTP/1.1" 200 None 2026-03-19 08:46:01,189 - lava_callback - ERROR - Error processing callback for node 69b914b40ec88e58bad0dacf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:46:01,269 - lava_callback - INFO - Received callback for node 69bbb795ec3f435d20d51bed INFO: 172.20.0.1:50346 - "POST /node/69bbb795ec3f435d20d51bed HTTP/1.0" 202 Accepted 2026-03-19 08:46:01,322 - lava_callback - INFO - Starting async job submit for node 69bbb795ec3f435d20d51bed 2026-03-19 08:46:01,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:01,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb795ec3f435d20d51bed HTTP/1.1" 200 None 2026-03-19 08:46:01,361 - lava_callback - DEBUG - Processing node 69bbb795ec3f435d20d51bed: baseline-arm 2026-03-19 08:46:01,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:01,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:01,674 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb795ec3f435d20d51bed/log.txt.gz 2026-03-19 08:46:01,783 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:01,988 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:01,990 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb795ec3f435d20d51bed/lava-logs.yaml 2026-03-19 08:46:01,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:02,130 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:02,132 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb795ec3f435d20d51bed/lava_callback.json.gz 2026-03-19 08:46:02,150 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:02,165 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb795ec3f435d20d51bed HTTP/1.1" 200 None 2026-03-19 08:46:02,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:02,179 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:46:02,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:02,205 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb795ec3f435d20d51bed HTTP/1.1" 200 None 2026-03-19 08:46:02,206 - lava_callback - INFO - Completed processing callback for node 69bbb795ec3f435d20d51bed INFO: 172.20.0.1:50358 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:46:12,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:12,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59538 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:46:19,569 - lava_callback - INFO - Received callback for node 69bbb790ec3f435d20d51bd2 INFO: 172.20.0.1:59542 - "POST /node/69bbb790ec3f435d20d51bd2 HTTP/1.0" 202 Accepted 2026-03-19 08:46:19,575 - lava_callback - INFO - Starting async job submit for node 69bbb790ec3f435d20d51bd2 2026-03-19 08:46:19,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:19,612 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb790ec3f435d20d51bd2 HTTP/1.1" 200 None 2026-03-19 08:46:19,613 - lava_callback - DEBUG - Processing node 69bbb790ec3f435d20d51bd2: baseline-arm 2026-03-19 08:46:19,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:19,963 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:19,966 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb790ec3f435d20d51bd2/log.txt.gz 2026-03-19 08:46:20,123 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:20,298 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:20,299 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb790ec3f435d20d51bd2/lava-logs.yaml 2026-03-19 08:46:20,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:20,448 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:20,450 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb790ec3f435d20d51bd2/lava_callback.json.gz 2026-03-19 08:46:20,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:20,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb790ec3f435d20d51bd2 HTTP/1.1" 200 None 2026-03-19 08:46:20,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:20,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:46:20,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:20,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb790ec3f435d20d51bd2 HTTP/1.1" 200 None 2026-03-19 08:46:20,529 - lava_callback - INFO - Completed processing callback for node 69bbb790ec3f435d20d51bd2 INFO: 172.20.0.1:42882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42896 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:46:29,875 - lava_callback - INFO - Received callback for node 69bbb794ec3f435d20d51bea INFO: 172.20.0.1:38698 - "POST /node/69bbb794ec3f435d20d51bea HTTP/1.0" 202 Accepted 2026-03-19 08:46:29,881 - lava_callback - INFO - Starting async job submit for node 69bbb794ec3f435d20d51bea 2026-03-19 08:46:29,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:29,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb794ec3f435d20d51bea HTTP/1.1" 200 None 2026-03-19 08:46:29,922 - lava_callback - DEBUG - Processing node 69bbb794ec3f435d20d51bea: baseline-arm 2026-03-19 08:46:30,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:30,269 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:30,271 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb794ec3f435d20d51bea/log.txt.gz 2026-03-19 08:46:30,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:30,651 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:30,653 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb794ec3f435d20d51bea/lava-logs.yaml 2026-03-19 08:46:30,659 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:30,801 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:30,802 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb794ec3f435d20d51bea/lava_callback.json.gz 2026-03-19 08:46:30,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:30,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb794ec3f435d20d51bea HTTP/1.1" 200 None 2026-03-19 08:46:30,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:30,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:46:30,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:30,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb794ec3f435d20d51bea HTTP/1.1" 200 None 2026-03-19 08:46:30,886 - lava_callback - INFO - Completed processing callback for node 69bbb794ec3f435d20d51bea INFO: 172.20.0.1:38706 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:46:42,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:42,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-19 08:46:46,187 - lava_callback - INFO - Received callback for node 69bbb7b5ec3f435d20d51c75 INFO: 172.20.0.1:41704 - "POST /node/69bbb7b5ec3f435d20d51c75 HTTP/1.0" 202 Accepted 2026-03-19 08:46:46,193 - lava_callback - INFO - Starting async job submit for node 69bbb7b5ec3f435d20d51c75 2026-03-19 08:46:46,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:46,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7b5ec3f435d20d51c75 HTTP/1.1" 200 None 2026-03-19 08:46:46,230 - lava_callback - DEBUG - Processing node 69bbb7b5ec3f435d20d51c75: baseline-arm-pengutronix 2026-03-19 08:46:46,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:46,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:46,514 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b5ec3f435d20d51c75/log.txt.gz INFO: 172.20.0.1:41706 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:46:46,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:46,791 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:46,793 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b5ec3f435d20d51c75/lava-logs.yaml 2026-03-19 08:46:46,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:46,938 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:46,940 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b5ec3f435d20d51c75/lava_callback.json.gz 2026-03-19 08:46:46,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:46,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7b5ec3f435d20d51c75 HTTP/1.1" 200 None 2026-03-19 08:46:46,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:46,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:46:46,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:47,024 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7b5ec3f435d20d51c75 HTTP/1.1" 200 None 2026-03-19 08:46:47,025 - lava_callback - INFO - Completed processing callback for node 69bbb7b5ec3f435d20d51c75 2026-03-19 08:46:47,401 - lava_callback - INFO - Received callback for node 69bbb7b4ec3f435d20d51c72 INFO: 172.20.0.1:41714 - "POST /node/69bbb7b4ec3f435d20d51c72 HTTP/1.0" 202 Accepted 2026-03-19 08:46:47,408 - lava_callback - INFO - Starting async job submit for node 69bbb7b4ec3f435d20d51c72 2026-03-19 08:46:47,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:47,442 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7b4ec3f435d20d51c72 HTTP/1.1" 200 None 2026-03-19 08:46:47,443 - lava_callback - DEBUG - Processing node 69bbb7b4ec3f435d20d51c72: baseline-arm-pengutronix 2026-03-19 08:46:47,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:47,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:47,730 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b4ec3f435d20d51c72/log.txt.gz 2026-03-19 08:46:47,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:48,009 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:48,011 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b4ec3f435d20d51c72/lava-logs.yaml 2026-03-19 08:46:48,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:48,144 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:48,146 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b4ec3f435d20d51c72/lava_callback.json.gz 2026-03-19 08:46:48,167 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:48,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7b4ec3f435d20d51c72 HTTP/1.1" 200 None 2026-03-19 08:46:48,184 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:48,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:46:48,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:48,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7b4ec3f435d20d51c72 HTTP/1.1" 200 None 2026-03-19 08:46:48,231 - lava_callback - INFO - Completed processing callback for node 69bbb7b4ec3f435d20d51c72 2026-03-19 08:46:56,193 - lava_callback - INFO - Received callback for node 69bbb7b8ec3f435d20d51c7f INFO: 172.20.0.1:54402 - "POST /node/69bbb7b8ec3f435d20d51c7f HTTP/1.0" 202 Accepted 2026-03-19 08:46:56,241 - lava_callback - INFO - Starting async job submit for node 69bbb7b8ec3f435d20d51c7f 2026-03-19 08:46:56,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:56,275 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7b8ec3f435d20d51c7f HTTP/1.1" 200 None 2026-03-19 08:46:56,276 - lava_callback - DEBUG - Processing node 69bbb7b8ec3f435d20d51c7f: baseline-arm-pengutronix 2026-03-19 08:46:56,396 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:54404 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:46:56,525 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:56,527 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b8ec3f435d20d51c7f/log.txt.gz 2026-03-19 08:46:56,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:56,757 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:56,759 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b8ec3f435d20d51c7f/lava-logs.yaml 2026-03-19 08:46:56,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:46:56,874 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:46:56,876 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b8ec3f435d20d51c7f/lava_callback.json.gz 2026-03-19 08:46:56,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:56,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7b8ec3f435d20d51c7f HTTP/1.1" 200 None 2026-03-19 08:46:56,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:56,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:46:56,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:46:56,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7b8ec3f435d20d51c7f HTTP/1.1" 200 None 2026-03-19 08:46:56,957 - lava_callback - INFO - Completed processing callback for node 69bbb7b8ec3f435d20d51c7f 2026-03-19 08:47:03,388 - lava_callback - INFO - Received callback for node 69bbb7aaec3f435d20d51c27 INFO: 172.20.0.1:40524 - "POST /node/69bbb7aaec3f435d20d51c27 HTTP/1.0" 202 Accepted 2026-03-19 08:47:03,394 - lava_callback - INFO - Starting async job submit for node 69bbb7aaec3f435d20d51c27 2026-03-19 08:47:03,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:03,430 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7aaec3f435d20d51c27 HTTP/1.1" 200 None 2026-03-19 08:47:03,431 - lava_callback - DEBUG - Processing node 69bbb7aaec3f435d20d51c27: baseline-arm-clabbe 2026-03-19 08:47:03,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:03,826 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:03,828 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7aaec3f435d20d51c27/log.txt.gz 2026-03-19 08:47:03,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:04,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:04,183 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7aaec3f435d20d51c27/lava-logs.yaml 2026-03-19 08:47:04,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:04,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:04,373 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7aaec3f435d20d51c27/lava_callback.json.gz 2026-03-19 08:47:04,398 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:04,412 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7aaec3f435d20d51c27 HTTP/1.1" 200 None 2026-03-19 08:47:04,414 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:04,437 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:47:04,439 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:04,467 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7aaec3f435d20d51c27 HTTP/1.1" 200 None 2026-03-19 08:47:04,472 - lava_callback - INFO - Completed processing callback for node 69bbb7aaec3f435d20d51c27 2026-03-19 08:47:05,075 - lava_callback - INFO - Received callback for node 69b914ff0ec88e58bad0db3a INFO: 172.20.0.1:40528 - "POST /node/69b914ff0ec88e58bad0db3a HTTP/1.0" 202 Accepted 2026-03-19 08:47:05,083 - lava_callback - INFO - Starting async job submit for node 69b914ff0ec88e58bad0db3a 2026-03-19 08:47:05,084 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:05,102 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914ff0ec88e58bad0db3a HTTP/1.1" 200 None 2026-03-19 08:47:05,103 - lava_callback - DEBUG - Processing node 69b914ff0ec88e58bad0db3a: baseline-arm-baylibre 2026-03-19 08:47:05,103 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b914ff0ec88e58bad0db3a 2026-03-19 08:47:05,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:05,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b914ff0ec88e58bad0db3a HTTP/1.1" 200 None 2026-03-19 08:47:05,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:05,147 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 08:47:05,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:05,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b914ff0ec88e58bad0db3a HTTP/1.1" 200 None 2026-03-19 08:47:05,179 - lava_callback - ERROR - Error processing callback for node 69b914ff0ec88e58bad0db3a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40544 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:47:07,525 - lava_callback - INFO - Received callback for node 69bbb7a7ec3f435d20d51c18 INFO: 172.20.0.1:40560 - "POST /node/69bbb7a7ec3f435d20d51c18 HTTP/1.0" 202 Accepted 2026-03-19 08:47:07,531 - lava_callback - INFO - Starting async job submit for node 69bbb7a7ec3f435d20d51c18 2026-03-19 08:47:07,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:07,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7a7ec3f435d20d51c18 HTTP/1.1" 200 None 2026-03-19 08:47:07,593 - lava_callback - DEBUG - Processing node 69bbb7a7ec3f435d20d51c18: baseline-arm-broonie 2026-03-19 08:47:07,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:07,983 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:07,984 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a7ec3f435d20d51c18/log.txt.gz 2026-03-19 08:47:08,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:08,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:08,330 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a7ec3f435d20d51c18/lava-logs.yaml 2026-03-19 08:47:08,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:08,472 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:08,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a7ec3f435d20d51c18/lava_callback.json.gz 2026-03-19 08:47:08,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:08,513 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7a7ec3f435d20d51c18 HTTP/1.1" 200 None 2026-03-19 08:47:08,514 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:08,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:47:08,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:08,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7a7ec3f435d20d51c18 HTTP/1.1" 200 None 2026-03-19 08:47:08,559 - lava_callback - INFO - Completed processing callback for node 69bbb7a7ec3f435d20d51c18 2026-03-19 08:47:11,943 - lava_callback - INFO - Received callback for node 69bbb7a4ec3f435d20d51c12 INFO: 172.20.0.1:51506 - "POST /node/69bbb7a4ec3f435d20d51c12 HTTP/1.0" 202 Accepted 2026-03-19 08:47:11,949 - lava_callback - INFO - Starting async job submit for node 69bbb7a4ec3f435d20d51c12 2026-03-19 08:47:11,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:11,986 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7a4ec3f435d20d51c12 HTTP/1.1" 200 None 2026-03-19 08:47:11,987 - lava_callback - DEBUG - Processing node 69bbb7a4ec3f435d20d51c12: baseline-arm-broonie 2026-03-19 08:47:12,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:12,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:12,338 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a4ec3f435d20d51c12/log.txt.gz 2026-03-19 08:47:12,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:12,638 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:12,641 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a4ec3f435d20d51c12/lava-logs.yaml 2026-03-19 08:47:12,646 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:12,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:12,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:12,801 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a4ec3f435d20d51c12/lava_callback.json.gz 2026-03-19 08:47:12,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:12,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-19 08:47:12,845 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7a4ec3f435d20d51c12 HTTP/1.1" 200 None 2026-03-19 08:47:12,847 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:12,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:47:12,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:12,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7a4ec3f435d20d51c12 HTTP/1.1" 200 None 2026-03-19 08:47:12,894 - lava_callback - INFO - Completed processing callback for node 69bbb7a4ec3f435d20d51c12 2026-03-19 08:47:13,415 - lava_callback - INFO - Received callback for node 69bbb7a6ec3f435d20d51c15 INFO: 172.20.0.1:51510 - "POST /node/69bbb7a6ec3f435d20d51c15 HTTP/1.0" 202 Accepted 2026-03-19 08:47:13,422 - lava_callback - INFO - Starting async job submit for node 69bbb7a6ec3f435d20d51c15 2026-03-19 08:47:13,450 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:13,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7a6ec3f435d20d51c15 HTTP/1.1" 200 None 2026-03-19 08:47:13,464 - lava_callback - DEBUG - Processing node 69bbb7a6ec3f435d20d51c15: baseline-arm-broonie 2026-03-19 08:47:13,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:13,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:13,795 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a6ec3f435d20d51c15/log.txt.gz 2026-03-19 08:47:13,936 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:14,124 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:14,127 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a6ec3f435d20d51c15/lava-logs.yaml 2026-03-19 08:47:14,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:14,357 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:14,359 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a6ec3f435d20d51c15/lava_callback.json.gz 2026-03-19 08:47:14,383 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:14,398 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7a6ec3f435d20d51c15 HTTP/1.1" 200 None 2026-03-19 08:47:14,399 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:14,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:47:14,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:14,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7a6ec3f435d20d51c15 HTTP/1.1" 200 None 2026-03-19 08:47:14,446 - lava_callback - INFO - Completed processing callback for node 69bbb7a6ec3f435d20d51c15 INFO: 172.20.0.1:51520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51524 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:47:17,693 - lava_callback - INFO - Received callback for node 69bbb7fbec3f435d20d51cf3 INFO: 172.20.0.1:51532 - "POST /node/69bbb7fbec3f435d20d51cf3 HTTP/1.0" 202 Accepted 2026-03-19 08:47:17,700 - lava_callback - INFO - Starting async job submit for node 69bbb7fbec3f435d20d51cf3 2026-03-19 08:47:17,718 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:17,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7fbec3f435d20d51cf3 HTTP/1.1" 200 None 2026-03-19 08:47:17,745 - lava_callback - DEBUG - Processing node 69bbb7fbec3f435d20d51cf3: baseline-x86 2026-03-19 08:47:17,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:18,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:18,074 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb7fbec3f435d20d51cf3/log.txt.gz 2026-03-19 08:47:18,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:18,358 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:18,360 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb7fbec3f435d20d51cf3/lava-logs.yaml 2026-03-19 08:47:18,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:18,496 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:18,498 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb7fbec3f435d20d51cf3/lava_callback.json.gz 2026-03-19 08:47:18,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:18,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7fbec3f435d20d51cf3 HTTP/1.1" 200 None 2026-03-19 08:47:18,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:18,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb14fec3f435d20d51ac2 HTTP/1.1" 200 None 2026-03-19 08:47:18,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:18,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7fbec3f435d20d51cf3 HTTP/1.1" 200 None 2026-03-19 08:47:18,584 - lava_callback - INFO - Completed processing callback for node 69bbb7fbec3f435d20d51cf3 INFO: 172.20.0.1:38682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38694 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:47:36,027 - lava_callback - INFO - Received callback for node 69bbb7fdec3f435d20d51cf6 INFO: 172.20.0.1:49728 - "POST /node/69bbb7fdec3f435d20d51cf6 HTTP/1.0" 202 Accepted 2026-03-19 08:47:36,033 - lava_callback - INFO - Starting async job submit for node 69bbb7fdec3f435d20d51cf6 2026-03-19 08:47:36,052 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:36,066 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7fdec3f435d20d51cf6 HTTP/1.1" 200 None 2026-03-19 08:47:36,067 - lava_callback - DEBUG - Processing node 69bbb7fdec3f435d20d51cf6: baseline-x86 2026-03-19 08:47:36,241 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:36,363 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:36,365 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb7fdec3f435d20d51cf6/log.txt.gz 2026-03-19 08:47:36,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:49738 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:47:36,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:36,715 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb7fdec3f435d20d51cf6/lava-logs.yaml 2026-03-19 08:47:36,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:47:36,852 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:47:36,853 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-x86-69bbb7fdec3f435d20d51cf6/lava_callback.json.gz 2026-03-19 08:47:36,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:36,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7fdec3f435d20d51cf6 HTTP/1.1" 200 None 2026-03-19 08:47:36,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:36,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb14fec3f435d20d51ac2 HTTP/1.1" 200 None 2026-03-19 08:47:36,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:36,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7fdec3f435d20d51cf6 HTTP/1.1" 200 None 2026-03-19 08:47:36,931 - lava_callback - INFO - Completed processing callback for node 69bbb7fdec3f435d20d51cf6 2026-03-19 08:47:42,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:47:42,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:57650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55084 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:48:07,494 - lava_callback - INFO - Received callback for node 69bbb7a3ec3f435d20d51c0e INFO: 172.20.0.1:55098 - "POST /node/69bbb7a3ec3f435d20d51c0e HTTP/1.0" 202 Accepted 2026-03-19 08:48:07,500 - lava_callback - INFO - Starting async job submit for node 69bbb7a3ec3f435d20d51c0e 2026-03-19 08:48:07,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:07,537 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7a3ec3f435d20d51c0e HTTP/1.1" 200 None 2026-03-19 08:48:07,538 - lava_callback - DEBUG - Processing node 69bbb7a3ec3f435d20d51c0e: baseline-arm-broonie 2026-03-19 08:48:07,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:07,895 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:07,897 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a3ec3f435d20d51c0e/log.txt.gz 2026-03-19 08:48:08,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:08,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:08,265 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a3ec3f435d20d51c0e/lava-logs.yaml 2026-03-19 08:48:08,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:08,421 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:08,423 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-broonie-69bbb7a3ec3f435d20d51c0e/lava_callback.json.gz 2026-03-19 08:48:08,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:08,470 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7a3ec3f435d20d51c0e HTTP/1.1" 200 None 2026-03-19 08:48:08,472 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:08,485 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:48:08,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:08,511 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7a3ec3f435d20d51c0e HTTP/1.1" 200 None 2026-03-19 08:48:08,513 - lava_callback - INFO - Completed processing callback for node 69bbb7a3ec3f435d20d51c0e 2026-03-19 08:48:12,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:12,887 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38464 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49146 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:48:31,520 - lava_callback - INFO - Received callback for node 69bbb7ceec3f435d20d51c98 INFO: 172.20.0.1:60702 - "POST /node/69bbb7ceec3f435d20d51c98 HTTP/1.0" 202 Accepted 2026-03-19 08:48:31,530 - lava_callback - INFO - Starting async job submit for node 69bbb7ceec3f435d20d51c98 2026-03-19 08:48:31,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:31,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7ceec3f435d20d51c98 HTTP/1.1" 200 None 2026-03-19 08:48:31,615 - lava_callback - DEBUG - Processing node 69bbb7ceec3f435d20d51c98: ltp-dio 2026-03-19 08:48:32,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:32,529 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:32,531 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-dio-69bbb7ceec3f435d20d51c98/log.txt.gz 2026-03-19 08:48:32,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:33,224 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:33,227 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-dio-69bbb7ceec3f435d20d51c98/lava-logs.yaml 2026-03-19 08:48:33,235 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:33,382 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:33,385 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-dio-69bbb7ceec3f435d20d51c98/lava_callback.json.gz 2026-03-19 08:48:33,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:33,450 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7ceec3f435d20d51c98 HTTP/1.1" 200 None 2026-03-19 08:48:33,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:33,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:48:33,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:33,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7ceec3f435d20d51c98 HTTP/1.1" 200 None 2026-03-19 08:48:33,518 - lava_callback - INFO - Completed processing callback for node 69bbb7ceec3f435d20d51c98 2026-03-19 08:48:33,628 - lava_callback - INFO - Received callback for node 69bbb84eec3f435d20d51d59 INFO: 172.20.0.1:60716 - "POST /node/69bbb84eec3f435d20d51d59 HTTP/1.0" 202 Accepted 2026-03-19 08:48:33,641 - lava_callback - INFO - Starting async job submit for node 69bbb84eec3f435d20d51d59 2026-03-19 08:48:33,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:33,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb84eec3f435d20d51d59 HTTP/1.1" 200 None 2026-03-19 08:48:33,672 - lava_callback - DEBUG - Processing node 69bbb84eec3f435d20d51d59: baseline-arm 2026-03-19 08:48:33,693 - lava_callback - WARNING - Failed to upload log 2026-03-19 08:48:33,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:34,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:34,013 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb84eec3f435d20d51d59/lava-logs.yaml 2026-03-19 08:48:34,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:34,137 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:34,139 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb84eec3f435d20d51d59/lava_callback.json.gz 2026-03-19 08:48:34,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:34,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb84eec3f435d20d51d59 HTTP/1.1" 200 None 2026-03-19 08:48:34,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:34,172 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:48:34,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:34,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb84eec3f435d20d51d59 HTTP/1.1" 200 None 2026-03-19 08:48:34,205 - lava_callback - INFO - Completed processing callback for node 69bbb84eec3f435d20d51d59 INFO: 172.20.0.1:60728 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:48:42,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:42,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-19 08:48:44,729 - lava_callback - INFO - Received callback for node 69b9156b0ec88e58bad0db92 INFO: 172.20.0.1:37908 - "POST /node/69b9156b0ec88e58bad0db92 HTTP/1.0" 202 Accepted 2026-03-19 08:48:44,734 - lava_callback - INFO - Starting async job submit for node 69b9156b0ec88e58bad0db92 2026-03-19 08:48:44,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:44,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9156b0ec88e58bad0db92 HTTP/1.1" 200 None 2026-03-19 08:48:44,752 - lava_callback - DEBUG - Processing node 69b9156b0ec88e58bad0db92: baseline-x86 2026-03-19 08:48:44,752 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9156b0ec88e58bad0db92 2026-03-19 08:48:44,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:44,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9156b0ec88e58bad0db92 HTTP/1.1" 200 None 2026-03-19 08:48:44,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:44,785 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None 2026-03-19 08:48:44,787 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:44,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9156b0ec88e58bad0db92 HTTP/1.1" 200 None 2026-03-19 08:48:44,818 - lava_callback - ERROR - Error processing callback for node 69b9156b0ec88e58bad0db92: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37920 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:48:50,532 - lava_callback - INFO - Received callback for node 69bbb7abec3f435d20d51c2b INFO: 172.20.0.1:58530 - "POST /node/69bbb7abec3f435d20d51c2b HTTP/1.0" 202 Accepted 2026-03-19 08:48:50,541 - lava_callback - INFO - Starting async job submit for node 69bbb7abec3f435d20d51c2b 2026-03-19 08:48:50,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:50,610 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7abec3f435d20d51c2b HTTP/1.1" 200 None 2026-03-19 08:48:50,611 - lava_callback - DEBUG - Processing node 69bbb7abec3f435d20d51c2b: baseline-arm-clabbe 2026-03-19 08:48:50,960 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:51,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:51,078 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7abec3f435d20d51c2b/log.txt.gz 2026-03-19 08:48:51,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:51,622 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:51,625 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7abec3f435d20d51c2b/lava-logs.yaml 2026-03-19 08:48:51,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:51,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:51,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7abec3f435d20d51c2b/lava_callback.json.gz 2026-03-19 08:48:51,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:51,793 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7abec3f435d20d51c2b HTTP/1.1" 200 None 2026-03-19 08:48:51,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:51,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:48:51,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:51,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7abec3f435d20d51c2b HTTP/1.1" 200 None 2026-03-19 08:48:51,839 - lava_callback - INFO - Completed processing callback for node 69bbb7abec3f435d20d51c2b 2026-03-19 08:48:52,048 - lava_callback - INFO - Received callback for node 69bbb3d2ec3f435d20d51ae9 INFO: 172.20.0.1:58536 - "POST /node/69bbb3d2ec3f435d20d51ae9 HTTP/1.0" 202 Accepted 2026-03-19 08:48:52,063 - lava_callback - INFO - Starting async job submit for node 69bbb3d2ec3f435d20d51ae9 2026-03-19 08:48:52,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:52,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb3d2ec3f435d20d51ae9 HTTP/1.1" 200 None 2026-03-19 08:48:52,219 - lava_callback - DEBUG - Processing node 69bbb3d2ec3f435d20d51ae9: ltp-smoke 2026-03-19 08:48:53,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:53,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:53,228 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbb3d2ec3f435d20d51ae9/log.txt.gz 2026-03-19 08:48:53,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:54,003 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:54,005 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbb3d2ec3f435d20d51ae9/lava-logs.yaml 2026-03-19 08:48:54,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:48:54,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:48:54,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbb3d2ec3f435d20d51ae9/lava_callback.json.gz 2026-03-19 08:48:54,434 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:54,459 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb3d2ec3f435d20d51ae9 HTTP/1.1" 200 None 2026-03-19 08:48:54,461 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:54,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb135ec3f435d20d51a9e HTTP/1.1" 200 None 2026-03-19 08:48:54,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:48:54,526 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb3d2ec3f435d20d51ae9 HTTP/1.1" 200 None 2026-03-19 08:48:54,692 - lava_callback - INFO - Completed processing callback for node 69bbb3d2ec3f435d20d51ae9 INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43310 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:49:12,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:49:12,941 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:32894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37734 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:49:41,171 - lava_callback - INFO - Received callback for node 69b9159b0ec88e58bad0dbb7 INFO: 172.20.0.1:41606 - "POST /node/69b9159b0ec88e58bad0dbb7 HTTP/1.0" 202 Accepted 2026-03-19 08:49:41,180 - lava_callback - INFO - Starting async job submit for node 69b9159b0ec88e58bad0dbb7 2026-03-19 08:49:41,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:49:41,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9159b0ec88e58bad0dbb7 HTTP/1.1" 200 None 2026-03-19 08:49:41,220 - lava_callback - DEBUG - Processing node 69b9159b0ec88e58bad0dbb7: baseline-arm-clabbe 2026-03-19 08:49:41,220 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9159b0ec88e58bad0dbb7 2026-03-19 08:49:41,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:49:41,261 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9159b0ec88e58bad0dbb7 HTTP/1.1" 200 None 2026-03-19 08:49:41,263 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:49:41,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 08:49:41,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:49:41,318 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9159b0ec88e58bad0dbb7 HTTP/1.1" 200 None 2026-03-19 08:49:41,320 - lava_callback - ERROR - Error processing callback for node 69b9159b0ec88e58bad0dbb7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50356 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:50:07,837 - lava_callback - INFO - Received callback for node 69bbb7c8ec3f435d20d51c86 INFO: 172.20.0.1:50364 - "POST /node/69bbb7c8ec3f435d20d51c86 HTTP/1.0" 202 Accepted 2026-03-19 08:50:07,845 - lava_callback - INFO - Starting async job submit for node 69bbb7c8ec3f435d20d51c86 2026-03-19 08:50:07,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:07,903 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7c8ec3f435d20d51c86 HTTP/1.1" 200 None 2026-03-19 08:50:07,905 - lava_callback - DEBUG - Processing node 69bbb7c8ec3f435d20d51c86: ltp-cap_bounds 2026-03-19 08:50:08,296 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:08,431 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:08,433 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69bbb7c8ec3f435d20d51c86/log.txt.gz 2026-03-19 08:50:08,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:08,998 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:09,000 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69bbb7c8ec3f435d20d51c86/lava-logs.yaml 2026-03-19 08:50:09,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:09,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:09,220 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cap_bounds-69bbb7c8ec3f435d20d51c86/lava_callback.json.gz 2026-03-19 08:50:09,252 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:09,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7c8ec3f435d20d51c86 HTTP/1.1" 200 None 2026-03-19 08:50:09,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:09,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:50:09,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:09,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7c8ec3f435d20d51c86 HTTP/1.1" 200 None 2026-03-19 08:50:09,318 - lava_callback - INFO - Completed processing callback for node 69bbb7c8ec3f435d20d51c86 2026-03-19 08:50:10,060 - lava_callback - INFO - Received callback for node 69bbb7cbec3f435d20d51c92 INFO: 172.20.0.1:34480 - "POST /node/69bbb7cbec3f435d20d51c92 HTTP/1.0" 202 Accepted 2026-03-19 08:50:10,069 - lava_callback - INFO - Starting async job submit for node 69bbb7cbec3f435d20d51c92 2026-03-19 08:50:10,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:10,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7cbec3f435d20d51c92 HTTP/1.1" 200 None 2026-03-19 08:50:10,126 - lava_callback - DEBUG - Processing node 69bbb7cbec3f435d20d51c92: ltp-controllers 2026-03-19 08:50:10,692 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:10,948 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:10,950 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-controllers-69bbb7cbec3f435d20d51c92/log.txt.gz 2026-03-19 08:50:11,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:11,514 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:11,517 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-controllers-69bbb7cbec3f435d20d51c92/lava-logs.yaml 2026-03-19 08:50:11,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:11,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:11,741 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-controllers-69bbb7cbec3f435d20d51c92/lava_callback.json.gz 2026-03-19 08:50:11,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:11,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7cbec3f435d20d51c92 HTTP/1.1" 200 None 2026-03-19 08:50:11,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:11,827 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:50:11,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:11,871 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7cbec3f435d20d51c92 HTTP/1.1" 200 None 2026-03-19 08:50:11,873 - lava_callback - INFO - Completed processing callback for node 69bbb7cbec3f435d20d51c92 2026-03-19 08:50:12,488 - lava_callback - INFO - Received callback for node 69bbb7c9ec3f435d20d51c8b INFO: 172.20.0.1:34482 - "POST /node/69bbb7c9ec3f435d20d51c8b HTTP/1.0" 202 Accepted 2026-03-19 08:50:12,495 - lava_callback - INFO - Starting async job submit for node 69bbb7c9ec3f435d20d51c8b 2026-03-19 08:50:12,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:12,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7c9ec3f435d20d51c8b HTTP/1.1" 200 None 2026-03-19 08:50:12,558 - lava_callback - DEBUG - Processing node 69bbb7c9ec3f435d20d51c8b: ltp-containers 2026-03-19 08:50:12,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:12,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:12,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-19 08:50:13,116 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:13,118 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-containers-69bbb7c9ec3f435d20d51c8b/log.txt.gz 2026-03-19 08:50:13,356 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:13,707 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:13,709 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-containers-69bbb7c9ec3f435d20d51c8b/lava-logs.yaml 2026-03-19 08:50:13,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:13,903 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:13,905 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-containers-69bbb7c9ec3f435d20d51c8b/lava_callback.json.gz 2026-03-19 08:50:13,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:13,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7c9ec3f435d20d51c8b HTTP/1.1" 200 None 2026-03-19 08:50:13,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:13,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:50:13,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:14,005 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7c9ec3f435d20d51c8b HTTP/1.1" 200 None 2026-03-19 08:50:14,007 - lava_callback - INFO - Completed processing callback for node 69bbb7c9ec3f435d20d51c8b INFO: 172.20.0.1:34494 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34510 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:50:25,573 - lava_callback - INFO - Received callback for node 69bbb7aeec3f435d20d51c37 INFO: 172.20.0.1:48768 - "POST /node/69bbb7aeec3f435d20d51c37 HTTP/1.0" 202 Accepted 2026-03-19 08:50:25,584 - lava_callback - INFO - Starting async job submit for node 69bbb7aeec3f435d20d51c37 2026-03-19 08:50:25,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:25,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7aeec3f435d20d51c37 HTTP/1.1" 200 None 2026-03-19 08:50:25,648 - lava_callback - DEBUG - Processing node 69bbb7aeec3f435d20d51c37: baseline-arm-clabbe 2026-03-19 08:50:25,897 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:26,088 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:26,090 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7aeec3f435d20d51c37/log.txt.gz 2026-03-19 08:50:26,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:26,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:26,434 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7aeec3f435d20d51c37/lava-logs.yaml 2026-03-19 08:50:26,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:48770 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:50:26,663 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:26,665 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7aeec3f435d20d51c37/lava_callback.json.gz 2026-03-19 08:50:26,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:26,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7aeec3f435d20d51c37 HTTP/1.1" 200 None 2026-03-19 08:50:26,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:26,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:50:26,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:26,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7aeec3f435d20d51c37 HTTP/1.1" 200 None 2026-03-19 08:50:26,768 - lava_callback - INFO - Completed processing callback for node 69bbb7aeec3f435d20d51c37 INFO: 172.20.0.1:48782 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:50:28,325 - lava_callback - INFO - Received callback for node 69bbb7daec3f435d20d51cc3 INFO: 172.20.0.1:48786 - "POST /node/69bbb7daec3f435d20d51cc3 HTTP/1.0" 202 Accepted 2026-03-19 08:50:28,335 - lava_callback - INFO - Starting async job submit for node 69bbb7daec3f435d20d51cc3 2026-03-19 08:50:28,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:28,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7daec3f435d20d51cc3 HTTP/1.1" 200 None 2026-03-19 08:50:28,395 - lava_callback - DEBUG - Processing node 69bbb7daec3f435d20d51cc3: ltp-syscalls 2026-03-19 08:50:29,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:29,527 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:29,529 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-69bbb7daec3f435d20d51cc3/log.txt.gz 2026-03-19 08:50:30,073 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:30,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:30,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-69bbb7daec3f435d20d51cc3/lava-logs.yaml 2026-03-19 08:50:30,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:50:30,553 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:50:30,555 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-69bbb7daec3f435d20d51cc3/lava_callback.json.gz 2026-03-19 08:50:30,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:30,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7daec3f435d20d51cc3 HTTP/1.1" 200 None 2026-03-19 08:50:30,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:30,615 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:50:30,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:30,653 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7daec3f435d20d51cc3 HTTP/1.1" 200 None 2026-03-19 08:50:30,655 - lava_callback - INFO - Completed processing callback for node 69bbb7daec3f435d20d51cc3 INFO: 172.20.0.1:60460 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:50:42,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:50:43,023 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48988 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:51:01,272 - lava_callback - INFO - Received callback for node 69b915e50ec88e58bad0dbe6 INFO: 172.20.0.1:40630 - "POST /node/69b915e50ec88e58bad0dbe6 HTTP/1.0" 202 Accepted 2026-03-19 08:51:01,277 - lava_callback - INFO - Starting async job submit for node 69b915e50ec88e58bad0dbe6 2026-03-19 08:51:01,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:51:01,297 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915e50ec88e58bad0dbe6 HTTP/1.1" 200 None 2026-03-19 08:51:01,298 - lava_callback - DEBUG - Processing node 69b915e50ec88e58bad0dbe6: baseline-arm-clabbe 2026-03-19 08:51:01,298 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b915e50ec88e58bad0dbe6 2026-03-19 08:51:01,299 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:51:01,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b915e50ec88e58bad0dbe6 HTTP/1.1" 200 None 2026-03-19 08:51:01,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:51:01,336 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 08:51:01,337 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:51:01,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b915e50ec88e58bad0dbe6 HTTP/1.1" 200 None 2026-03-19 08:51:01,388 - lava_callback - ERROR - Error processing callback for node 69b915e50ec88e58bad0dbe6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51264 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:52:12,635 - lava_callback - INFO - Received callback for node 69bbb7afec3f435d20d51c3a INFO: 172.20.0.1:46282 - "POST /node/69bbb7afec3f435d20d51c3a HTTP/1.0" 202 Accepted 2026-03-19 08:52:12,642 - lava_callback - INFO - Starting async job submit for node 69bbb7afec3f435d20d51c3a 2026-03-19 08:52:12,669 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:12,687 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7afec3f435d20d51c3a HTTP/1.1" 200 None 2026-03-19 08:52:12,688 - lava_callback - DEBUG - Processing node 69bbb7afec3f435d20d51c3a: baseline-arm-clabbe 2026-03-19 08:52:12,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:52:13,591 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:52:13,593 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7afec3f435d20d51c3a/log.txt.gz 2026-03-19 08:52:13,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:52:14,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:52:14,507 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7afec3f435d20d51c3a/lava-logs.yaml 2026-03-19 08:52:14,515 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46294 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-19 08:52:15,209 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:52:15,211 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-clabbe-69bbb7afec3f435d20d51c3a/lava_callback.json.gz 2026-03-19 08:52:15,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:15,314 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7afec3f435d20d51c3a HTTP/1.1" 200 None 2026-03-19 08:52:15,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:15,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:52:15,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:15,386 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7afec3f435d20d51c3a HTTP/1.1" 200 None 2026-03-19 08:52:15,387 - lava_callback - INFO - Completed processing callback for node 69bbb7afec3f435d20d51c3a INFO: 172.20.0.1:46296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46312 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:52:21,421 - lava_callback - INFO - Received callback for node 69b916310ec88e58bad0dc1a INFO: 172.20.0.1:45462 - "POST /node/69b916310ec88e58bad0dc1a HTTP/1.0" 202 Accepted 2026-03-19 08:52:21,427 - lava_callback - INFO - Starting async job submit for node 69b916310ec88e58bad0dc1a 2026-03-19 08:52:21,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:21,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b916310ec88e58bad0dc1a HTTP/1.1" 200 None 2026-03-19 08:52:21,448 - lava_callback - DEBUG - Processing node 69b916310ec88e58bad0dc1a: baseline-arm-clabbe 2026-03-19 08:52:21,449 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b916310ec88e58bad0dc1a 2026-03-19 08:52:21,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:21,471 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b916310ec88e58bad0dc1a HTTP/1.1" 200 None 2026-03-19 08:52:21,473 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:21,492 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 08:52:21,494 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:21,531 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b916310ec88e58bad0dc1a HTTP/1.1" 200 None 2026-03-19 08:52:21,538 - lava_callback - ERROR - Error processing callback for node 69b916310ec88e58bad0dc1a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45500 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:52:27,845 - lava_callback - INFO - Received callback for node 69bbb7cdec3f435d20d51c95 INFO: 172.20.0.1:45508 - "POST /node/69bbb7cdec3f435d20d51c95 HTTP/1.0" 202 Accepted 2026-03-19 08:52:27,854 - lava_callback - INFO - Starting async job submit for node 69bbb7cdec3f435d20d51c95 2026-03-19 08:52:27,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:27,916 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7cdec3f435d20d51c95 HTTP/1.1" 200 None 2026-03-19 08:52:27,917 - lava_callback - DEBUG - Processing node 69bbb7cdec3f435d20d51c95: ltp-cve 2026-03-19 08:52:28,535 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:52:29,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:52:29,169 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-cve-69bbb7cdec3f435d20d51c95/log.txt.gz 2026-03-19 08:52:29,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:55290 - "GET /favicon.ico HTTP/1.0" 404 Not Found 2026-03-19 08:52:30,176 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:52:30,178 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-cve-69bbb7cdec3f435d20d51c95/lava-logs.yaml 2026-03-19 08:52:30,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:52:30,706 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:52:30,708 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-cve-69bbb7cdec3f435d20d51c95/lava_callback.json.gz 2026-03-19 08:52:30,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:30,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7cdec3f435d20d51c95 HTTP/1.1" 200 None 2026-03-19 08:52:30,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:30,819 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:52:30,822 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:30,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7cdec3f435d20d51c95 HTTP/1.1" 200 None 2026-03-19 08:52:30,873 - lava_callback - INFO - Completed processing callback for node 69bbb7cdec3f435d20d51c95 INFO: 172.20.0.1:55292 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:52:43,026 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:52:43,051 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38614 - "GET /login HTTP/1.0" 404 Not Found INFO: 172.20.0.1:52818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39770 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:53:41,484 - lava_callback - INFO - Received callback for node 69b916800ec88e58bad0dc4a INFO: 172.20.0.1:52300 - "POST /node/69b916800ec88e58bad0dc4a HTTP/1.0" 202 Accepted 2026-03-19 08:53:41,490 - lava_callback - INFO - Starting async job submit for node 69b916800ec88e58bad0dc4a 2026-03-19 08:53:41,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:53:41,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b916800ec88e58bad0dc4a HTTP/1.1" 200 None 2026-03-19 08:53:41,507 - lava_callback - DEBUG - Processing node 69b916800ec88e58bad0dc4a: baseline-arm-clabbe 2026-03-19 08:53:41,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b916800ec88e58bad0dc4a 2026-03-19 08:53:41,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:53:41,522 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b916800ec88e58bad0dc4a HTTP/1.1" 200 None 2026-03-19 08:53:41,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:53:41,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 08:53:41,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:53:41,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b916800ec88e58bad0dc4a HTTP/1.1" 200 None 2026-03-19 08:53:41,569 - lava_callback - ERROR - Error processing callback for node 69b916800ec88e58bad0dc4a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44450 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:54:07,983 - lava_callback - INFO - Received callback for node 69bbb7d3ec3f435d20d51cae INFO: 172.20.0.1:44462 - "POST /node/69bbb7d3ec3f435d20d51cae HTTP/1.0" 202 Accepted 2026-03-19 08:54:07,991 - lava_callback - INFO - Starting async job submit for node 69bbb7d3ec3f435d20d51cae 2026-03-19 08:54:08,022 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:08,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d3ec3f435d20d51cae HTTP/1.1" 200 None 2026-03-19 08:54:08,038 - lava_callback - DEBUG - Processing node 69bbb7d3ec3f435d20d51cae: ltp-input 2026-03-19 08:54:08,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:54:08,645 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:54:08,647 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-input-69bbb7d3ec3f435d20d51cae/log.txt.gz 2026-03-19 08:54:08,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:54:09,094 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:54:09,096 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-input-69bbb7d3ec3f435d20d51cae/lava-logs.yaml 2026-03-19 08:54:09,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:54:09,255 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:54:09,257 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-input-69bbb7d3ec3f435d20d51cae/lava_callback.json.gz 2026-03-19 08:54:09,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:09,303 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d3ec3f435d20d51cae HTTP/1.1" 200 None 2026-03-19 08:54:09,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:09,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:54:09,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:09,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7d3ec3f435d20d51cae HTTP/1.1" 200 None 2026-03-19 08:54:09,362 - lava_callback - INFO - Completed processing callback for node 69bbb7d3ec3f435d20d51cae 2026-03-19 08:54:13,054 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:13,074 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56034 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:54:17,312 - lava_callback - INFO - Received callback for node 69bbb7d0ec3f435d20d51ca8 INFO: 172.20.0.1:56046 - "POST /node/69bbb7d0ec3f435d20d51ca8 HTTP/1.0" 202 Accepted 2026-03-19 08:54:17,319 - lava_callback - INFO - Starting async job submit for node 69bbb7d0ec3f435d20d51ca8 2026-03-19 08:54:17,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:17,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d0ec3f435d20d51ca8 HTTP/1.1" 200 None 2026-03-19 08:54:17,367 - lava_callback - DEBUG - Processing node 69bbb7d0ec3f435d20d51ca8: ltp-fs_bind 2026-03-19 08:54:17,798 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:54:17,942 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:54:17,944 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69bbb7d0ec3f435d20d51ca8/log.txt.gz 2026-03-19 08:54:18,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:54:18,505 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:54:18,507 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69bbb7d0ec3f435d20d51ca8/lava-logs.yaml 2026-03-19 08:54:18,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:54:18,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:54:18,681 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fs_bind-69bbb7d0ec3f435d20d51ca8/lava_callback.json.gz 2026-03-19 08:54:18,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:18,728 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d0ec3f435d20d51ca8 HTTP/1.1" 200 None 2026-03-19 08:54:18,730 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:18,779 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:54:18,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:18,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7d0ec3f435d20d51ca8 HTTP/1.1" 200 None 2026-03-19 08:54:18,818 - lava_callback - INFO - Completed processing callback for node 69bbb7d0ec3f435d20d51ca8 INFO: 172.20.0.1:33986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33994 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:54:32,785 - lava_callback - INFO - Received callback for node 69bbb9a7ec3f435d20d523f1 INFO: 172.20.0.1:52980 - "POST /node/69bbb9a7ec3f435d20d523f1 HTTP/1.0" 202 Accepted 2026-03-19 08:54:32,792 - lava_callback - INFO - Starting async job submit for node 69bbb9a7ec3f435d20d523f1 2026-03-19 08:54:32,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:32,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9a7ec3f435d20d523f1 HTTP/1.1" 200 None 2026-03-19 08:54:32,834 - lava_callback - DEBUG - Processing node 69bbb9a7ec3f435d20d523f1: baseline-arm 2026-03-19 08:54:32,840 - lava_callback - WARNING - Failed to upload log 2026-03-19 08:54:32,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:54:32,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:54:32,974 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb9a7ec3f435d20d523f1/lava-logs.yaml 2026-03-19 08:54:32,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:54:33,149 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:54:33,151 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb9a7ec3f435d20d523f1/lava_callback.json.gz 2026-03-19 08:54:33,156 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:33,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9a7ec3f435d20d523f1 HTTP/1.1" 200 None 2026-03-19 08:54:33,175 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:33,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:54:33,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:33,216 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb9a7ec3f435d20d523f1 HTTP/1.1" 200 None 2026-03-19 08:54:33,221 - lava_callback - INFO - Completed processing callback for node 69bbb9a7ec3f435d20d523f1 INFO: 172.20.0.1:52984 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:54:41,546 - lava_callback - INFO - Received callback for node 69b916c60ec88e58bad0dca0 INFO: 172.20.0.1:37378 - "POST /node/69b916c60ec88e58bad0dca0 HTTP/1.0" 202 Accepted 2026-03-19 08:54:41,552 - lava_callback - INFO - Starting async job submit for node 69b916c60ec88e58bad0dca0 2026-03-19 08:54:41,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:41,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b916c60ec88e58bad0dca0 HTTP/1.1" 200 None 2026-03-19 08:54:41,568 - lava_callback - DEBUG - Processing node 69b916c60ec88e58bad0dca0: baseline-arm-clabbe 2026-03-19 08:54:41,569 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b916c60ec88e58bad0dca0 2026-03-19 08:54:41,569 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:41,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b916c60ec88e58bad0dca0 HTTP/1.1" 200 None 2026-03-19 08:54:41,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:41,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-19 08:54:41,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:41,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b916c60ec88e58bad0dca0 HTTP/1.1" 200 None 2026-03-19 08:54:41,636 - lava_callback - ERROR - Error processing callback for node 69b916c60ec88e58bad0dca0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:54:43,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:54:43,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36874 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:55:56,892 - lava_callback - INFO - Received callback for node 69bbb9f5ec3f435d20d52428 INFO: 172.20.0.1:36882 - "POST /node/69bbb9f5ec3f435d20d52428 HTTP/1.0" 202 Accepted 2026-03-19 08:55:56,898 - lava_callback - INFO - Starting async job submit for node 69bbb9f5ec3f435d20d52428 2026-03-19 08:55:56,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:55:56,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9f5ec3f435d20d52428 HTTP/1.1" 200 None 2026-03-19 08:55:56,935 - lava_callback - DEBUG - Processing node 69bbb9f5ec3f435d20d52428: baseline-arm64 2026-03-19 08:55:57,140 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:55:57,277 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:55:57,279 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f5ec3f435d20d52428/log.txt.gz 2026-03-19 08:55:57,370 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:55:57,566 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:55:57,569 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f5ec3f435d20d52428/lava-logs.yaml 2026-03-19 08:55:57,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:55:57,755 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:55:57,757 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f5ec3f435d20d52428/lava_callback.json.gz 2026-03-19 08:55:57,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:55:57,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9f5ec3f435d20d52428 HTTP/1.1" 200 None 2026-03-19 08:55:57,792 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:55:57,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:55:57,812 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:55:57,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb9f5ec3f435d20d52428 HTTP/1.1" 200 None 2026-03-19 08:55:57,838 - lava_callback - INFO - Completed processing callback for node 69bbb9f5ec3f435d20d52428 2026-03-19 08:56:01,624 - lava_callback - INFO - Received callback for node 69b9170e0ec88e58bad0dcfc INFO: 172.20.0.1:49966 - "POST /node/69b9170e0ec88e58bad0dcfc HTTP/1.0" 202 Accepted 2026-03-19 08:56:01,633 - lava_callback - INFO - Starting async job submit for node 69b9170e0ec88e58bad0dcfc 2026-03-19 08:56:01,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:01,670 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9170e0ec88e58bad0dcfc HTTP/1.1" 200 None 2026-03-19 08:56:01,671 - lava_callback - DEBUG - Processing node 69b9170e0ec88e58bad0dcfc: baseline-arm-clabbe 2026-03-19 08:56:01,671 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9170e0ec88e58bad0dcfc 2026-03-19 08:56:01,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:01,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9170e0ec88e58bad0dcfc HTTP/1.1" 200 None 2026-03-19 08:56:01,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:01,718 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-19 08:56:01,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:01,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9170e0ec88e58bad0dcfc HTTP/1.1" 200 None 2026-03-19 08:56:01,767 - lava_callback - ERROR - Error processing callback for node 69b9170e0ec88e58bad0dcfc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49980 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:56:13,103 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:13,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54496 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-19 08:56:15,732 - lava_callback - INFO - Received callback for node 69bbba11ec3f435d20d52493 INFO: 172.20.0.1:54500 - "POST /node/69bbba11ec3f435d20d52493 HTTP/1.0" 202 Accepted 2026-03-19 08:56:15,739 - lava_callback - INFO - Starting async job submit for node 69bbba11ec3f435d20d52493 2026-03-19 08:56:15,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:15,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba11ec3f435d20d52493 HTTP/1.1" 200 None 2026-03-19 08:56:15,760 - lava_callback - DEBUG - Processing node 69bbba11ec3f435d20d52493: baseline-nfs-arm64 2026-03-19 08:56:15,762 - lava_callback - WARNING - Failed to upload log 2026-03-19 08:56:15,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:15,899 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:15,907 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba11ec3f435d20d52493/lava-logs.yaml 2026-03-19 08:56:15,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:16,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:16,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba11ec3f435d20d52493/lava_callback.json.gz 2026-03-19 08:56:16,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:16,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba11ec3f435d20d52493 HTTP/1.1" 200 None 2026-03-19 08:56:16,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:16,106 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:56:16,107 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:16,127 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba11ec3f435d20d52493 HTTP/1.1" 200 None 2026-03-19 08:56:16,133 - lava_callback - INFO - Completed processing callback for node 69bbba11ec3f435d20d52493 INFO: 172.20.0.1:54508 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:56:16,909 - lava_callback - INFO - Received callback for node 69bbba02ec3f435d20d52449 INFO: 172.20.0.1:54518 - "POST /node/69bbba02ec3f435d20d52449 HTTP/1.0" 202 Accepted 2026-03-19 08:56:16,919 - lava_callback - INFO - Starting async job submit for node 69bbba02ec3f435d20d52449 2026-03-19 08:56:16,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:16,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba02ec3f435d20d52449 HTTP/1.1" 200 None 2026-03-19 08:56:16,956 - lava_callback - DEBUG - Processing node 69bbba02ec3f435d20d52449: baseline-arm64 2026-03-19 08:56:17,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:17,287 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:17,290 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba02ec3f435d20d52449/log.txt.gz 2026-03-19 08:56:17,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:17,573 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:17,575 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba02ec3f435d20d52449/lava-logs.yaml 2026-03-19 08:56:17,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:17,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:17,739 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba02ec3f435d20d52449/lava_callback.json.gz 2026-03-19 08:56:17,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:17,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba02ec3f435d20d52449 HTTP/1.1" 200 None 2026-03-19 08:56:17,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:17,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:56:17,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:17,814 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba02ec3f435d20d52449 HTTP/1.1" 200 None 2026-03-19 08:56:17,821 - lava_callback - INFO - Completed processing callback for node 69bbba02ec3f435d20d52449 2026-03-19 08:56:21,570 - lava_callback - INFO - Received callback for node 69b917320ec88e58bad0dd15 INFO: 172.20.0.1:40018 - "POST /node/69b917320ec88e58bad0dd15 HTTP/1.0" 202 Accepted 2026-03-19 08:56:21,576 - lava_callback - INFO - Starting async job submit for node 69b917320ec88e58bad0dd15 2026-03-19 08:56:21,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:21,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917320ec88e58bad0dd15 HTTP/1.1" 200 None 2026-03-19 08:56:21,593 - lava_callback - DEBUG - Processing node 69b917320ec88e58bad0dd15: baseline-arm-clabbe 2026-03-19 08:56:21,593 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b917320ec88e58bad0dd15 2026-03-19 08:56:21,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:21,607 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917320ec88e58bad0dd15 HTTP/1.1" 200 None 2026-03-19 08:56:21,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:21,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-19 08:56:21,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:21,645 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b917320ec88e58bad0dd15 HTTP/1.1" 200 None 2026-03-19 08:56:21,646 - lava_callback - ERROR - Error processing callback for node 69b917320ec88e58bad0dd15: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:56:22,679 - lava_callback - INFO - Received callback for node 69bbba03ec3f435d20d5244c INFO: 172.20.0.1:40022 - "POST /node/69bbba03ec3f435d20d5244c HTTP/1.0" 202 Accepted 2026-03-19 08:56:22,690 - lava_callback - INFO - Starting async job submit for node 69bbba03ec3f435d20d5244c 2026-03-19 08:56:22,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:22,770 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba03ec3f435d20d5244c HTTP/1.1" 200 None 2026-03-19 08:56:22,772 - lava_callback - DEBUG - Processing node 69bbba03ec3f435d20d5244c: baseline-arm64 2026-03-19 08:56:23,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:23,199 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:23,201 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba03ec3f435d20d5244c/log.txt.gz 2026-03-19 08:56:23,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:23,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:23,587 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba03ec3f435d20d5244c/lava-logs.yaml 2026-03-19 08:56:23,593 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:23,771 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:23,773 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba03ec3f435d20d5244c/lava_callback.json.gz 2026-03-19 08:56:23,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:23,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba03ec3f435d20d5244c HTTP/1.1" 200 None 2026-03-19 08:56:23,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:23,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:56:23,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:23,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba03ec3f435d20d5244c HTTP/1.1" 200 None 2026-03-19 08:56:23,851 - lava_callback - INFO - Completed processing callback for node 69bbba03ec3f435d20d5244c 2026-03-19 08:56:24,892 - lava_callback - INFO - Received callback for node 69bbb9f7ec3f435d20d5242e INFO: 172.20.0.1:40030 - "POST /node/69bbb9f7ec3f435d20d5242e HTTP/1.0" 202 Accepted 2026-03-19 08:56:24,899 - lava_callback - INFO - Starting async job submit for node 69bbb9f7ec3f435d20d5242e 2026-03-19 08:56:24,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:24,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9f7ec3f435d20d5242e HTTP/1.1" 200 None 2026-03-19 08:56:24,977 - lava_callback - DEBUG - Processing node 69bbb9f7ec3f435d20d5242e: baseline-arm64 2026-03-19 08:56:25,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:25,420 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:25,422 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f7ec3f435d20d5242e/log.txt.gz 2026-03-19 08:56:25,612 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:25,844 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:25,846 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f7ec3f435d20d5242e/lava-logs.yaml 2026-03-19 08:56:25,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:25,994 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:25,996 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f7ec3f435d20d5242e/lava_callback.json.gz 2026-03-19 08:56:26,025 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:26,039 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9f7ec3f435d20d5242e HTTP/1.1" 200 None 2026-03-19 08:56:26,040 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:26,054 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:56:26,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:26,080 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb9f7ec3f435d20d5242e HTTP/1.1" 200 None 2026-03-19 08:56:26,081 - lava_callback - INFO - Completed processing callback for node 69bbb9f7ec3f435d20d5242e INFO: 172.20.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40060 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:56:27,721 - lava_callback - INFO - Received callback for node 69bbb9f9ec3f435d20d52434 INFO: 172.20.0.1:40076 - "POST /node/69bbb9f9ec3f435d20d52434 HTTP/1.0" 202 Accepted 2026-03-19 08:56:27,729 - lava_callback - INFO - Starting async job submit for node 69bbb9f9ec3f435d20d52434 2026-03-19 08:56:27,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:27,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9f9ec3f435d20d52434 HTTP/1.1" 200 None 2026-03-19 08:56:27,795 - lava_callback - DEBUG - Processing node 69bbb9f9ec3f435d20d52434: baseline-arm64 2026-03-19 08:56:27,959 - lava_callback - WARNING - Failed to upload log 2026-03-19 08:56:28,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:28,194 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:28,196 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f9ec3f435d20d52434/lava-logs.yaml 2026-03-19 08:56:28,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:28,402 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:28,405 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f9ec3f435d20d52434/lava_callback.json.gz 2026-03-19 08:56:28,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:28,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9f9ec3f435d20d52434 HTTP/1.1" 200 None 2026-03-19 08:56:28,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:28,501 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:56:28,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:28,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb9f9ec3f435d20d52434 HTTP/1.1" 200 None 2026-03-19 08:56:28,590 - lava_callback - INFO - Completed processing callback for node 69bbb9f9ec3f435d20d52434 INFO: 172.20.0.1:53130 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:56:43,121 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:43,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-19 08:56:46,424 - lava_callback - INFO - Received callback for node 69bbba00ec3f435d20d52443 INFO: 172.20.0.1:48208 - "POST /node/69bbba00ec3f435d20d52443 HTTP/1.0" 202 Accepted 2026-03-19 08:56:46,431 - lava_callback - INFO - Starting async job submit for node 69bbba00ec3f435d20d52443 2026-03-19 08:56:46,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:46,483 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba00ec3f435d20d52443 HTTP/1.1" 200 None 2026-03-19 08:56:46,484 - lava_callback - DEBUG - Processing node 69bbba00ec3f435d20d52443: baseline-arm64 INFO: 172.20.0.1:48214 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:56:46,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:47,131 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:47,133 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba00ec3f435d20d52443/log.txt.gz 2026-03-19 08:56:47,442 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:47,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:47,683 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba00ec3f435d20d52443/lava-logs.yaml 2026-03-19 08:56:47,693 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:47,857 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:47,859 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba00ec3f435d20d52443/lava_callback.json.gz 2026-03-19 08:56:47,900 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:47,918 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba00ec3f435d20d52443 HTTP/1.1" 200 None 2026-03-19 08:56:47,920 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:47,934 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:56:47,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:47,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba00ec3f435d20d52443 HTTP/1.1" 200 None 2026-03-19 08:56:47,960 - lava_callback - INFO - Completed processing callback for node 69bbba00ec3f435d20d52443 2026-03-19 08:56:48,095 - lava_callback - INFO - Received callback for node 69bbb7d4ec3f435d20d51cb4 INFO: 172.20.0.1:48222 - "POST /node/69bbb7d4ec3f435d20d51cb4 HTTP/1.0" 202 Accepted 2026-03-19 08:56:48,106 - lava_callback - INFO - Starting async job submit for node 69bbb7d4ec3f435d20d51cb4 2026-03-19 08:56:48,149 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:48,169 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d4ec3f435d20d51cb4 HTTP/1.1" 200 None 2026-03-19 08:56:48,170 - lava_callback - DEBUG - Processing node 69bbb7d4ec3f435d20d51cb4: ltp-ipc 2026-03-19 08:56:48,582 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:48,719 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:48,721 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-ipc-69bbb7d4ec3f435d20d51cb4/log.txt.gz 2026-03-19 08:56:48,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:49,160 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:49,162 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-ipc-69bbb7d4ec3f435d20d51cb4/lava-logs.yaml 2026-03-19 08:56:49,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:49,354 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:49,356 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-ipc-69bbb7d4ec3f435d20d51cb4/lava_callback.json.gz 2026-03-19 08:56:49,382 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:49,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d4ec3f435d20d51cb4 HTTP/1.1" 200 None 2026-03-19 08:56:49,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:49,415 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:56:49,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:49,443 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7d4ec3f435d20d51cb4 HTTP/1.1" 200 None 2026-03-19 08:56:49,445 - lava_callback - INFO - Completed processing callback for node 69bbb7d4ec3f435d20d51cb4 2026-03-19 08:56:52,826 - lava_callback - INFO - Received callback for node 69bbba01ec3f435d20d52446 INFO: 172.20.0.1:52410 - "POST /node/69bbba01ec3f435d20d52446 HTTP/1.0" 202 Accepted 2026-03-19 08:56:52,832 - lava_callback - INFO - Starting async job submit for node 69bbba01ec3f435d20d52446 2026-03-19 08:56:52,854 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:52,869 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba01ec3f435d20d52446 HTTP/1.1" 200 None 2026-03-19 08:56:52,870 - lava_callback - DEBUG - Processing node 69bbba01ec3f435d20d52446: baseline-arm64 2026-03-19 08:56:53,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:53,384 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:53,386 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba01ec3f435d20d52446/log.txt.gz 2026-03-19 08:56:53,620 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:53,824 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:53,826 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba01ec3f435d20d52446/lava-logs.yaml 2026-03-19 08:56:53,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:53,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:53,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba01ec3f435d20d52446/lava_callback.json.gz 2026-03-19 08:56:53,993 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:54,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba01ec3f435d20d52446 HTTP/1.1" 200 None 2026-03-19 08:56:54,009 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:54,022 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:56:54,024 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:54,048 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba01ec3f435d20d52446 HTTP/1.1" 200 None 2026-03-19 08:56:54,053 - lava_callback - INFO - Completed processing callback for node 69bbba01ec3f435d20d52446 INFO: 172.20.0.1:52424 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:56:58,674 - lava_callback - INFO - Received callback for node 69bbb9f6ec3f435d20d5242b INFO: 172.20.0.1:52436 - "POST /node/69bbb9f6ec3f435d20d5242b HTTP/1.0" 202 Accepted 2026-03-19 08:56:58,680 - lava_callback - INFO - Starting async job submit for node 69bbb9f6ec3f435d20d5242b 2026-03-19 08:56:58,701 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:58,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9f6ec3f435d20d5242b HTTP/1.1" 200 None 2026-03-19 08:56:58,716 - lava_callback - DEBUG - Processing node 69bbb9f6ec3f435d20d5242b: baseline-arm64 2026-03-19 08:56:58,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:59,049 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:59,051 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f6ec3f435d20d5242b/log.txt.gz 2026-03-19 08:56:59,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:59,377 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:59,379 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f6ec3f435d20d5242b/lava-logs.yaml 2026-03-19 08:56:59,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:56:59,538 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:56:59,540 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f6ec3f435d20d5242b/lava_callback.json.gz 2026-03-19 08:56:59,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:59,577 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9f6ec3f435d20d5242b HTTP/1.1" 200 None 2026-03-19 08:56:59,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:59,592 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:56:59,594 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:56:59,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb9f6ec3f435d20d5242b HTTP/1.1" 200 None 2026-03-19 08:56:59,619 - lava_callback - INFO - Completed processing callback for node 69bbb9f6ec3f435d20d5242b 2026-03-19 08:57:05,454 - lava_callback - INFO - Received callback for node 69bbba07ec3f435d20d52459 INFO: 172.20.0.1:44388 - "POST /node/69bbba07ec3f435d20d52459 HTTP/1.0" 202 Accepted 2026-03-19 08:57:05,460 - lava_callback - INFO - Starting async job submit for node 69bbba07ec3f435d20d52459 2026-03-19 08:57:05,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:05,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba07ec3f435d20d52459 HTTP/1.1" 200 None 2026-03-19 08:57:05,504 - lava_callback - DEBUG - Processing node 69bbba07ec3f435d20d52459: baseline-arm64 2026-03-19 08:57:05,794 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:05,916 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:05,918 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba07ec3f435d20d52459/log.txt.gz 2026-03-19 08:57:06,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:06,327 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:06,329 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba07ec3f435d20d52459/lava-logs.yaml 2026-03-19 08:57:06,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:06,477 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:06,479 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba07ec3f435d20d52459/lava_callback.json.gz INFO: 172.20.0.1:44396 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:57:06,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:06,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba07ec3f435d20d52459 HTTP/1.1" 200 None 2026-03-19 08:57:06,565 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:06,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:06,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:06,609 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba07ec3f435d20d52459 HTTP/1.1" 200 None 2026-03-19 08:57:06,658 - lava_callback - INFO - Completed processing callback for node 69bbba07ec3f435d20d52459 2026-03-19 08:57:09,118 - lava_callback - INFO - Received callback for node 69bbba0fec3f435d20d5248b INFO: 172.20.0.1:44408 - "POST /node/69bbba0fec3f435d20d5248b HTTP/1.0" 202 Accepted 2026-03-19 08:57:09,125 - lava_callback - INFO - Starting async job submit for node 69bbba0fec3f435d20d5248b 2026-03-19 08:57:09,148 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:09,163 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba0fec3f435d20d5248b HTTP/1.1" 200 None 2026-03-19 08:57:09,164 - lava_callback - DEBUG - Processing node 69bbba0fec3f435d20d5248b: baseline-nfs-arm64 2026-03-19 08:57:09,214 - lava_callback - INFO - Received callback for node 69bbb9fbec3f435d20d52437 2026-03-19 08:57:09,242 - lava_callback - INFO - Starting async job submit for node 69bbb9fbec3f435d20d52437 INFO: 172.20.0.1:44416 - "POST /node/69bbb9fbec3f435d20d52437 HTTP/1.0" 202 Accepted 2026-03-19 08:57:09,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:09,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9fbec3f435d20d52437 HTTP/1.1" 200 None 2026-03-19 08:57:09,437 - lava_callback - DEBUG - Processing node 69bbb9fbec3f435d20d52437: baseline-arm64 2026-03-19 08:57:09,902 - lava_callback - WARNING - Failed to upload log 2026-03-19 08:57:09,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:10,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:10,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:10,183 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0fec3f435d20d5248b/log.txt.gz 2026-03-19 08:57:10,310 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:10,343 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9fbec3f435d20d52437/lava-logs.yaml 2026-03-19 08:57:10,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:10,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:10,583 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:10,585 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9fbec3f435d20d52437/lava_callback.json.gz 2026-03-19 08:57:10,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:10,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9fbec3f435d20d52437 HTTP/1.1" 200 None 2026-03-19 08:57:10,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:10,659 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:10,661 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:10,684 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb9fbec3f435d20d52437 HTTP/1.1" 200 None 2026-03-19 08:57:10,732 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:10,739 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0fec3f435d20d5248b/lava-logs.yaml 2026-03-19 08:57:10,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:10,763 - lava_callback - INFO - Completed processing callback for node 69bbb9fbec3f435d20d52437 2026-03-19 08:57:11,029 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:11,032 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0fec3f435d20d5248b/lava_callback.json.gz 2026-03-19 08:57:11,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:11,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba0fec3f435d20d5248b HTTP/1.1" 200 None 2026-03-19 08:57:11,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:11,087 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:11,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:11,119 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba0fec3f435d20d5248b HTTP/1.1" 200 None 2026-03-19 08:57:11,121 - lava_callback - INFO - Completed processing callback for node 69bbba0fec3f435d20d5248b 2026-03-19 08:57:13,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:13,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-19 08:57:14,990 - lava_callback - INFO - Received callback for node 69bbba15ec3f435d20d5249d INFO: 172.20.0.1:60686 - "POST /node/69bbba15ec3f435d20d5249d HTTP/1.0" 202 Accepted 2026-03-19 08:57:14,996 - lava_callback - INFO - Starting async job submit for node 69bbba15ec3f435d20d5249d 2026-03-19 08:57:15,019 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:15,061 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba15ec3f435d20d5249d HTTP/1.1" 200 None 2026-03-19 08:57:15,062 - lava_callback - DEBUG - Processing node 69bbba15ec3f435d20d5249d: baseline-nfs-arm64 INFO: 172.20.0.1:60702 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-19 08:57:15,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:15,614 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:15,616 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba15ec3f435d20d5249d/log.txt.gz 2026-03-19 08:57:15,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:16,037 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:16,039 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba15ec3f435d20d5249d/lava-logs.yaml 2026-03-19 08:57:16,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:16,217 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:16,219 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba15ec3f435d20d5249d/lava_callback.json.gz 2026-03-19 08:57:16,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:16,257 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba15ec3f435d20d5249d HTTP/1.1" 200 None 2026-03-19 08:57:16,258 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:16,273 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:16,275 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:16,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba15ec3f435d20d5249d HTTP/1.1" 200 None 2026-03-19 08:57:16,303 - lava_callback - INFO - Completed processing callback for node 69bbba15ec3f435d20d5249d INFO: 172.20.0.1:60704 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:57:18,800 - lava_callback - INFO - Received callback for node 69bbb9feec3f435d20d52440 INFO: 172.20.0.1:60718 - "POST /node/69bbb9feec3f435d20d52440 HTTP/1.0" 202 Accepted 2026-03-19 08:57:18,806 - lava_callback - INFO - Starting async job submit for node 69bbb9feec3f435d20d52440 2026-03-19 08:57:18,828 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:18,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9feec3f435d20d52440 HTTP/1.1" 200 None 2026-03-19 08:57:18,845 - lava_callback - DEBUG - Processing node 69bbb9feec3f435d20d52440: baseline-arm64 2026-03-19 08:57:19,204 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:19,328 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:19,330 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9feec3f435d20d52440/log.txt.gz 2026-03-19 08:57:19,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:19,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:19,766 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9feec3f435d20d52440/lava-logs.yaml 2026-03-19 08:57:19,774 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:19,843 - lava_callback - INFO - Received callback for node 69bbba3cec3f435d20d52535 INFO: 172.20.0.1:57808 - "POST /node/69bbba3cec3f435d20d52535 HTTP/1.0" 202 Accepted 2026-03-19 08:57:19,851 - lava_callback - INFO - Starting async job submit for node 69bbba3cec3f435d20d52535 2026-03-19 08:57:19,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:19,901 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba3cec3f435d20d52535 HTTP/1.1" 200 None 2026-03-19 08:57:19,902 - lava_callback - DEBUG - Processing node 69bbba3cec3f435d20d52535: baseline-arm64-foundriesio 2026-03-19 08:57:19,972 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:20,024 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9feec3f435d20d52440/lava_callback.json.gz 2026-03-19 08:57:20,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:20,142 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:20,143 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9feec3f435d20d52440 HTTP/1.1" 200 None 2026-03-19 08:57:20,145 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:20,161 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:20,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:20,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb9feec3f435d20d52440 HTTP/1.1" 200 None 2026-03-19 08:57:20,200 - lava_callback - INFO - Completed processing callback for node 69bbb9feec3f435d20d52440 2026-03-19 08:57:20,332 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:20,334 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bbba3cec3f435d20d52535/log.txt.gz 2026-03-19 08:57:20,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:20,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:20,714 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bbba3cec3f435d20d52535/lava-logs.yaml 2026-03-19 08:57:20,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:20,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:20,861 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bbba3cec3f435d20d52535/lava_callback.json.gz 2026-03-19 08:57:20,884 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:20,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba3cec3f435d20d52535 HTTP/1.1" 200 None 2026-03-19 08:57:20,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:20,919 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:20,921 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:20,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba3cec3f435d20d52535 HTTP/1.1" 200 None 2026-03-19 08:57:20,950 - lava_callback - INFO - Completed processing callback for node 69bbba3cec3f435d20d52535 2026-03-19 08:57:21,374 - lava_callback - INFO - Received callback for node 69bbba3dec3f435d20d52538 INFO: 172.20.0.1:57816 - "POST /node/69bbba3dec3f435d20d52538 HTTP/1.0" 202 Accepted 2026-03-19 08:57:21,381 - lava_callback - INFO - Starting async job submit for node 69bbba3dec3f435d20d52538 2026-03-19 08:57:21,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:21,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba3dec3f435d20d52538 HTTP/1.1" 200 None 2026-03-19 08:57:21,427 - lava_callback - DEBUG - Processing node 69bbba3dec3f435d20d52538: baseline-arm64-foundriesio 2026-03-19 08:57:21,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:21,992 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:21,994 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bbba3dec3f435d20d52538/log.txt.gz 2026-03-19 08:57:22,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:22,466 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:22,468 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bbba3dec3f435d20d52538/lava-logs.yaml 2026-03-19 08:57:22,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:22,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:22,630 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-foundriesio-69bbba3dec3f435d20d52538/lava_callback.json.gz 2026-03-19 08:57:22,660 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:22,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba3dec3f435d20d52538 HTTP/1.1" 200 None 2026-03-19 08:57:22,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:22,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:22,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:22,725 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba3dec3f435d20d52538 HTTP/1.1" 200 None 2026-03-19 08:57:22,726 - lava_callback - INFO - Completed processing callback for node 69bbba3dec3f435d20d52538 INFO: 172.20.0.1:57832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57838 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:57:27,196 - lava_callback - INFO - Received callback for node 69bbba10ec3f435d20d5248e INFO: 172.20.0.1:57840 - "POST /node/69bbba10ec3f435d20d5248e HTTP/1.0" 202 Accepted 2026-03-19 08:57:27,203 - lava_callback - INFO - Starting async job submit for node 69bbba10ec3f435d20d5248e 2026-03-19 08:57:27,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:27,247 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba10ec3f435d20d5248e HTTP/1.1" 200 None 2026-03-19 08:57:27,247 - lava_callback - DEBUG - Processing node 69bbba10ec3f435d20d5248e: baseline-nfs-arm64 2026-03-19 08:57:27,687 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:27,822 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:27,824 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba10ec3f435d20d5248e/log.txt.gz 2026-03-19 08:57:28,110 - lava_callback - INFO - Received callback for node 69bbb7d1ec3f435d20d51cab INFO: 172.20.0.1:57842 - "POST /node/69bbb7d1ec3f435d20d51cab HTTP/1.0" 202 Accepted 2026-03-19 08:57:28,127 - lava_callback - INFO - Starting async job submit for node 69bbb7d1ec3f435d20d51cab 2026-03-19 08:57:28,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:28,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:28,184 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d1ec3f435d20d51cab HTTP/1.1" 200 None 2026-03-19 08:57:28,185 - lava_callback - DEBUG - Processing node 69bbb7d1ec3f435d20d51cab: ltp-fsx 2026-03-19 08:57:28,386 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:28,429 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba10ec3f435d20d5248e/lava-logs.yaml 2026-03-19 08:57:28,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:28,619 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:28,754 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:28,756 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba10ec3f435d20d5248e/lava_callback.json.gz 2026-03-19 08:57:28,778 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:28,781 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:28,782 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-fsx-69bbb7d1ec3f435d20d51cab/log.txt.gz 2026-03-19 08:57:28,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba10ec3f435d20d5248e HTTP/1.1" 200 None 2026-03-19 08:57:28,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:28,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:28,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:29,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:29,045 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba10ec3f435d20d5248e HTTP/1.1" 200 None 2026-03-19 08:57:29,047 - lava_callback - INFO - Completed processing callback for node 69bbba10ec3f435d20d5248e 2026-03-19 08:57:29,293 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:29,295 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-fsx-69bbb7d1ec3f435d20d51cab/lava-logs.yaml 2026-03-19 08:57:29,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:29,483 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:29,485 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-fsx-69bbb7d1ec3f435d20d51cab/lava_callback.json.gz 2026-03-19 08:57:29,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:29,541 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d1ec3f435d20d51cab HTTP/1.1" 200 None 2026-03-19 08:57:29,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:29,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:57:29,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:29,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7d1ec3f435d20d51cab HTTP/1.1" 200 None 2026-03-19 08:57:29,588 - lava_callback - INFO - Completed processing callback for node 69bbb7d1ec3f435d20d51cab 2026-03-19 08:57:32,238 - lava_callback - INFO - Received callback for node 69bbba2aec3f435d20d524f7 INFO: 172.20.0.1:60364 - "POST /node/69bbba2aec3f435d20d524f7 HTTP/1.0" 202 Accepted 2026-03-19 08:57:32,244 - lava_callback - INFO - Starting async job submit for node 69bbba2aec3f435d20d524f7 2026-03-19 08:57:32,267 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:32,283 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba2aec3f435d20d524f7 HTTP/1.1" 200 None 2026-03-19 08:57:32,284 - lava_callback - DEBUG - Processing node 69bbba2aec3f435d20d524f7: baseline-arm64-broonie 2026-03-19 08:57:32,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:32,665 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:32,667 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2aec3f435d20d524f7/log.txt.gz 2026-03-19 08:57:32,806 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:32,978 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:32,980 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2aec3f435d20d524f7/lava-logs.yaml 2026-03-19 08:57:32,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:33,134 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:33,136 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2aec3f435d20d524f7/lava_callback.json.gz 2026-03-19 08:57:33,159 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:33,173 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba2aec3f435d20d524f7 HTTP/1.1" 200 None 2026-03-19 08:57:33,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:33,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:33,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:33,229 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba2aec3f435d20d524f7 HTTP/1.1" 200 None 2026-03-19 08:57:33,231 - lava_callback - INFO - Completed processing callback for node 69bbba2aec3f435d20d524f7 INFO: 172.20.0.1:60366 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:57:40,778 - lava_callback - INFO - Received callback for node 69bbba38ec3f435d20d52526 INFO: 172.20.0.1:46828 - "POST /node/69bbba38ec3f435d20d52526 HTTP/1.0" 202 Accepted 2026-03-19 08:57:40,784 - lava_callback - INFO - Starting async job submit for node 69bbba38ec3f435d20d52526 2026-03-19 08:57:40,805 - lava_callback - INFO - Received callback for node 69bbba05ec3f435d20d52452 2026-03-19 08:57:40,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:46836 - "POST /node/69bbba05ec3f435d20d52452 HTTP/1.0" 202 Accepted 2026-03-19 08:57:40,812 - lava_callback - INFO - Starting async job submit for node 69bbba05ec3f435d20d52452 2026-03-19 08:57:40,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:40,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba38ec3f435d20d52526 HTTP/1.1" 200 None 2026-03-19 08:57:40,848 - lava_callback - DEBUG - Processing node 69bbba38ec3f435d20d52526: baseline-arm64-pengutronix 2026-03-19 08:57:40,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba05ec3f435d20d52452 HTTP/1.1" 200 None 2026-03-19 08:57:40,870 - lava_callback - DEBUG - Processing node 69bbba05ec3f435d20d52452: baseline-arm64 2026-03-19 08:57:41,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:41,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:41,445 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:41,447 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bbba38ec3f435d20d52526/log.txt.gz 2026-03-19 08:57:41,515 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:41,555 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba05ec3f435d20d52452/log.txt.gz 2026-03-19 08:57:41,598 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:41,771 - lava_callback - INFO - Received callback for node 69b9177c0ec88e58bad0dd32 2026-03-19 08:57:41,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:41,781 - lava_callback - INFO - Starting async job submit for node 69b9177c0ec88e58bad0dd32 INFO: 172.20.0.1:46838 - "POST /node/69b9177c0ec88e58bad0dd32 HTTP/1.0" 202 Accepted 2026-03-19 08:57:41,782 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:41,802 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9177c0ec88e58bad0dd32 HTTP/1.1" 200 None 2026-03-19 08:57:41,803 - lava_callback - DEBUG - Processing node 69b9177c0ec88e58bad0dd32: baseline-arm-clabbe 2026-03-19 08:57:41,803 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9177c0ec88e58bad0dd32 2026-03-19 08:57:41,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:41,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9177c0ec88e58bad0dd32 HTTP/1.1" 200 None 2026-03-19 08:57:41,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:41,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-19 08:57:41,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:41,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9177c0ec88e58bad0dd32 HTTP/1.1" 200 None 2026-03-19 08:57:41,887 - lava_callback - ERROR - Error processing callback for node 69b9177c0ec88e58bad0dd32: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:57:41,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:41,958 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bbba38ec3f435d20d52526/lava-logs.yaml 2026-03-19 08:57:41,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:42,070 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:42,072 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba05ec3f435d20d52452/lava-logs.yaml 2026-03-19 08:57:42,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:42,128 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:42,130 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bbba38ec3f435d20d52526/lava_callback.json.gz 2026-03-19 08:57:42,163 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:42,187 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba38ec3f435d20d52526 HTTP/1.1" 200 None 2026-03-19 08:57:42,189 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:42,204 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:42,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:42,232 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba38ec3f435d20d52526 HTTP/1.1" 200 None 2026-03-19 08:57:42,233 - lava_callback - INFO - Completed processing callback for node 69bbba38ec3f435d20d52526 2026-03-19 08:57:42,240 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:42,243 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba05ec3f435d20d52452/lava_callback.json.gz 2026-03-19 08:57:42,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:42,324 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba05ec3f435d20d52452 HTTP/1.1" 200 None 2026-03-19 08:57:42,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:42,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:42,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:42,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba05ec3f435d20d52452 HTTP/1.1" 200 None 2026-03-19 08:57:42,380 - lava_callback - INFO - Completed processing callback for node 69bbba05ec3f435d20d52452 2026-03-19 08:57:43,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:43,195 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:46848 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:57:48,095 - lava_callback - INFO - Received callback for node 69bbba2eec3f435d20d52500 INFO: 172.20.0.1:46858 - "POST /node/69bbba2eec3f435d20d52500 HTTP/1.0" 202 Accepted 2026-03-19 08:57:48,101 - lava_callback - INFO - Starting async job submit for node 69bbba2eec3f435d20d52500 2026-03-19 08:57:48,124 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:48,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba2eec3f435d20d52500 HTTP/1.1" 200 None 2026-03-19 08:57:48,142 - lava_callback - DEBUG - Processing node 69bbba2eec3f435d20d52500: baseline-arm64-broonie 2026-03-19 08:57:48,384 - lava_callback - INFO - Received callback for node 69bbb9f8ec3f435d20d52431 INFO: 172.20.0.1:46864 - "POST /node/69bbb9f8ec3f435d20d52431 HTTP/1.0" 202 Accepted 2026-03-19 08:57:48,390 - lava_callback - INFO - Starting async job submit for node 69bbb9f8ec3f435d20d52431 2026-03-19 08:57:48,412 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:48,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:48,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9f8ec3f435d20d52431 HTTP/1.1" 200 None 2026-03-19 08:57:48,429 - lava_callback - DEBUG - Processing node 69bbb9f8ec3f435d20d52431: baseline-arm64 2026-03-19 08:57:48,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:48,629 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2eec3f435d20d52500/log.txt.gz 2026-03-19 08:57:48,829 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:48,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:48,985 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:48,987 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f8ec3f435d20d52431/log.txt.gz 2026-03-19 08:57:49,098 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:49,134 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2eec3f435d20d52500/lava-logs.yaml 2026-03-19 08:57:49,135 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:49,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:49,280 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:49,282 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2eec3f435d20d52500/lava_callback.json.gz 2026-03-19 08:57:49,307 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:49,328 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba2eec3f435d20d52500 HTTP/1.1" 200 None 2026-03-19 08:57:49,329 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:49,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:49,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:49,372 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba2eec3f435d20d52500 HTTP/1.1" 200 None 2026-03-19 08:57:49,373 - lava_callback - INFO - Completed processing callback for node 69bbba2eec3f435d20d52500 2026-03-19 08:57:49,424 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:49,428 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f8ec3f435d20d52431/lava-logs.yaml 2026-03-19 08:57:49,437 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:49,626 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:49,628 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9f8ec3f435d20d52431/lava_callback.json.gz 2026-03-19 08:57:49,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:49,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9f8ec3f435d20d52431 HTTP/1.1" 200 None 2026-03-19 08:57:49,702 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:49,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:49,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:49,754 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb9f8ec3f435d20d52431 HTTP/1.1" 200 None 2026-03-19 08:57:49,871 - lava_callback - INFO - Completed processing callback for node 69bbb9f8ec3f435d20d52431 2026-03-19 08:57:53,287 - lava_callback - INFO - Received callback for node 69bbba21ec3f435d20d524bf INFO: 172.20.0.1:51282 - "POST /node/69bbba21ec3f435d20d524bf HTTP/1.0" 202 Accepted 2026-03-19 08:57:53,293 - lava_callback - INFO - Starting async job submit for node 69bbba21ec3f435d20d524bf 2026-03-19 08:57:53,315 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:53,330 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba21ec3f435d20d524bf HTTP/1.1" 200 None 2026-03-19 08:57:53,331 - lava_callback - DEBUG - Processing node 69bbba21ec3f435d20d524bf: baseline-arm64-broonie 2026-03-19 08:57:53,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:53,672 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:53,674 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba21ec3f435d20d524bf/log.txt.gz 2026-03-19 08:57:53,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:53,976 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:53,978 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba21ec3f435d20d524bf/lava-logs.yaml 2026-03-19 08:57:53,984 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:54,111 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:54,112 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba21ec3f435d20d524bf/lava_callback.json.gz 2026-03-19 08:57:54,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:54,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba21ec3f435d20d524bf HTTP/1.1" 200 None 2026-03-19 08:57:54,153 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:54,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:57:54,168 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:54,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba21ec3f435d20d524bf HTTP/1.1" 200 None 2026-03-19 08:57:54,197 - lava_callback - INFO - Completed processing callback for node 69bbba21ec3f435d20d524bf INFO: 172.20.0.1:51290 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:57:58,945 - lava_callback - INFO - Received callback for node 69bbba3aec3f435d20d5252d INFO: 172.20.0.1:51306 - "POST /node/69bbba3aec3f435d20d5252d HTTP/1.0" 202 Accepted 2026-03-19 08:57:58,953 - lava_callback - INFO - Starting async job submit for node 69bbba3aec3f435d20d5252d 2026-03-19 08:57:58,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:57:59,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba3aec3f435d20d5252d HTTP/1.1" 200 None 2026-03-19 08:57:59,015 - lava_callback - DEBUG - Processing node 69bbba3aec3f435d20d5252d: baseline-arm64-pengutronix 2026-03-19 08:57:59,304 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:59,536 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:59,538 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bbba3aec3f435d20d5252d/log.txt.gz 2026-03-19 08:57:59,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:57:59,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:57:59,938 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bbba3aec3f435d20d5252d/lava-logs.yaml 2026-03-19 08:57:59,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:00,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:00,286 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bbba3aec3f435d20d5252d/lava_callback.json.gz 2026-03-19 08:58:00,321 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:00,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba3aec3f435d20d5252d HTTP/1.1" 200 None 2026-03-19 08:58:00,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:00,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:00,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:00,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba3aec3f435d20d5252d HTTP/1.1" 200 None 2026-03-19 08:58:00,403 - lava_callback - INFO - Completed processing callback for node 69bbba3aec3f435d20d5252d 2026-03-19 08:58:00,898 - lava_callback - INFO - Received callback for node 69bbba17ec3f435d20d524a4 INFO: 172.20.0.1:54284 - "POST /node/69bbba17ec3f435d20d524a4 HTTP/1.0" 202 Accepted 2026-03-19 08:58:00,909 - lava_callback - INFO - Starting async job submit for node 69bbba17ec3f435d20d524a4 2026-03-19 08:58:00,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:00,981 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba17ec3f435d20d524a4 HTTP/1.1" 200 None 2026-03-19 08:58:00,983 - lava_callback - DEBUG - Processing node 69bbba17ec3f435d20d524a4: baseline-nfs-arm64 2026-03-19 08:58:01,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:01,764 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:01,766 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba17ec3f435d20d524a4/log.txt.gz 2026-03-19 08:58:02,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:02,068 - lava_callback - INFO - Received callback for node 69bbba3bec3f435d20d52530 INFO: 172.20.0.1:54290 - "POST /node/69bbba3bec3f435d20d52530 HTTP/1.0" 202 Accepted 2026-03-19 08:58:02,082 - lava_callback - INFO - Starting async job submit for node 69bbba3bec3f435d20d52530 2026-03-19 08:58:02,125 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:02,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba3bec3f435d20d52530 HTTP/1.1" 200 None 2026-03-19 08:58:02,153 - lava_callback - DEBUG - Processing node 69bbba3bec3f435d20d52530: baseline-arm64-pengutronix 2026-03-19 08:58:02,513 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:02,521 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba17ec3f435d20d524a4/lava-logs.yaml 2026-03-19 08:58:02,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:02,530 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:02,655 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:02,657 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bbba3bec3f435d20d52530/log.txt.gz 2026-03-19 08:58:02,708 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:02,715 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba17ec3f435d20d524a4/lava_callback.json.gz 2026-03-19 08:58:02,815 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:02,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba17ec3f435d20d524a4 HTTP/1.1" 200 None 2026-03-19 08:58:02,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:02,950 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:02,956 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:02,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:03,007 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba17ec3f435d20d524a4 HTTP/1.1" 200 None 2026-03-19 08:58:03,009 - lava_callback - INFO - Completed processing callback for node 69bbba17ec3f435d20d524a4 2026-03-19 08:58:03,331 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:03,333 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bbba3bec3f435d20d52530/lava-logs.yaml 2026-03-19 08:58:03,339 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:03,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:03,490 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-pengutronix-69bbba3bec3f435d20d52530/lava_callback.json.gz 2026-03-19 08:58:03,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:03,529 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba3bec3f435d20d52530 HTTP/1.1" 200 None 2026-03-19 08:58:03,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:03,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:03,550 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:03,582 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba3bec3f435d20d52530 HTTP/1.1" 200 None 2026-03-19 08:58:03,584 - lava_callback - INFO - Completed processing callback for node 69bbba3bec3f435d20d52530 2026-03-19 08:58:03,659 - lava_callback - INFO - Received callback for node 69bbba0cec3f435d20d52484 INFO: 172.20.0.1:54298 - "POST /node/69bbba0cec3f435d20d52484 HTTP/1.0" 202 Accepted 2026-03-19 08:58:03,672 - lava_callback - INFO - Starting async job submit for node 69bbba0cec3f435d20d52484 2026-03-19 08:58:03,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:03,776 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba0cec3f435d20d52484 HTTP/1.1" 200 None 2026-03-19 08:58:03,777 - lava_callback - DEBUG - Processing node 69bbba0cec3f435d20d52484: baseline-nfs-arm64 2026-03-19 08:58:04,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:04,576 - lava_callback - INFO - Received callback for node 69bbb9fdec3f435d20d5243d INFO: 172.20.0.1:54300 - "POST /node/69bbb9fdec3f435d20d5243d HTTP/1.0" 202 Accepted 2026-03-19 08:58:04,585 - lava_callback - INFO - Starting async job submit for node 69bbb9fdec3f435d20d5243d 2026-03-19 08:58:04,639 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:04,640 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:04,642 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0cec3f435d20d52484/log.txt.gz 2026-03-19 08:58:04,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9fdec3f435d20d5243d HTTP/1.1" 200 None 2026-03-19 08:58:04,707 - lava_callback - DEBUG - Processing node 69bbb9fdec3f435d20d5243d: baseline-arm64 2026-03-19 08:58:05,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:05,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:05,630 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:05,633 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9fdec3f435d20d5243d/log.txt.gz 2026-03-19 08:58:05,704 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:05,733 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0cec3f435d20d52484/lava-logs.yaml 2026-03-19 08:58:05,800 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:05,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:06,284 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:06,286 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0cec3f435d20d52484/lava_callback.json.gz 2026-03-19 08:58:06,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:06,335 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:06,337 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9fdec3f435d20d5243d/lava-logs.yaml 2026-03-19 08:58:06,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:06,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba0cec3f435d20d52484 HTTP/1.1" 200 None 2026-03-19 08:58:06,360 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:06,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:06,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:06,423 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba0cec3f435d20d52484 HTTP/1.1" 200 None 2026-03-19 08:58:06,425 - lava_callback - INFO - Completed processing callback for node 69bbba0cec3f435d20d52484 INFO: 172.20.0.1:54312 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:58:06,555 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:06,557 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9fdec3f435d20d5243d/lava_callback.json.gz 2026-03-19 08:58:06,633 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:06,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9fdec3f435d20d5243d HTTP/1.1" 200 None 2026-03-19 08:58:06,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:06,697 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:06,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:06,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb9fdec3f435d20d5243d HTTP/1.1" 200 None 2026-03-19 08:58:06,815 - lava_callback - INFO - Completed processing callback for node 69bbb9fdec3f435d20d5243d 2026-03-19 08:58:08,102 - lava_callback - INFO - Received callback for node 69bbb7d6ec3f435d20d51cba INFO: 172.20.0.1:54316 - "POST /node/69bbb7d6ec3f435d20d51cba HTTP/1.0" 202 Accepted 2026-03-19 08:58:08,108 - lava_callback - INFO - Starting async job submit for node 69bbb7d6ec3f435d20d51cba 2026-03-19 08:58:08,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:08,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d6ec3f435d20d51cba HTTP/1.1" 200 None 2026-03-19 08:58:08,155 - lava_callback - DEBUG - Processing node 69bbb7d6ec3f435d20d51cba: ltp-pty 2026-03-19 08:58:08,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:08,891 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:08,894 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-pty-69bbb7d6ec3f435d20d51cba/log.txt.gz 2026-03-19 08:58:09,174 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:09,489 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:09,491 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-pty-69bbb7d6ec3f435d20d51cba/lava-logs.yaml 2026-03-19 08:58:09,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:09,603 - lava_callback - INFO - Received callback for node 69bbba26ec3f435d20d524c9 INFO: 172.20.0.1:54326 - "POST /node/69bbba26ec3f435d20d524c9 HTTP/1.0" 202 Accepted 2026-03-19 08:58:09,610 - lava_callback - INFO - Starting async job submit for node 69bbba26ec3f435d20d524c9 2026-03-19 08:58:09,642 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:09,658 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:09,660 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-pty-69bbb7d6ec3f435d20d51cba/lava_callback.json.gz 2026-03-19 08:58:09,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba26ec3f435d20d524c9 HTTP/1.1" 200 None 2026-03-19 08:58:09,694 - lava_callback - DEBUG - Processing node 69bbba26ec3f435d20d524c9: baseline-arm64-broonie 2026-03-19 08:58:09,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:09,797 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d6ec3f435d20d51cba HTTP/1.1" 200 None 2026-03-19 08:58:09,805 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:09,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:58:09,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:09,953 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7d6ec3f435d20d51cba HTTP/1.1" 200 None 2026-03-19 08:58:09,954 - lava_callback - INFO - Completed processing callback for node 69bbb7d6ec3f435d20d51cba 2026-03-19 08:58:10,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:10,559 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:10,561 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba26ec3f435d20d524c9/log.txt.gz 2026-03-19 08:58:10,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:11,063 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:11,065 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba26ec3f435d20d524c9/lava-logs.yaml 2026-03-19 08:58:11,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:11,133 - lava_callback - INFO - Received callback for node 69bbba27ec3f435d20d524cc INFO: 172.20.0.1:55854 - "POST /node/69bbba27ec3f435d20d524cc HTTP/1.0" 202 Accepted 2026-03-19 08:58:11,143 - lava_callback - INFO - Starting async job submit for node 69bbba27ec3f435d20d524cc 2026-03-19 08:58:11,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:11,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba27ec3f435d20d524cc HTTP/1.1" 200 None 2026-03-19 08:58:11,214 - lava_callback - DEBUG - Processing node 69bbba27ec3f435d20d524cc: baseline-arm64-broonie 2026-03-19 08:58:11,510 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:11,543 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba26ec3f435d20d524c9/lava_callback.json.gz 2026-03-19 08:58:11,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:11,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba26ec3f435d20d524c9 HTTP/1.1" 200 None 2026-03-19 08:58:11,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:11,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:11,726 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:11,727 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:11,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba26ec3f435d20d524c9 HTTP/1.1" 200 None 2026-03-19 08:58:11,765 - lava_callback - INFO - Completed processing callback for node 69bbba26ec3f435d20d524c9 2026-03-19 08:58:11,964 - lava_callback - INFO - Received callback for node 69bbba34ec3f435d20d52518 INFO: 172.20.0.1:55866 - "POST /node/69bbba34ec3f435d20d52518 HTTP/1.0" 202 Accepted 2026-03-19 08:58:11,974 - lava_callback - INFO - Starting async job submit for node 69bbba34ec3f435d20d52518 2026-03-19 08:58:12,015 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:12,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba34ec3f435d20d52518 HTTP/1.1" 200 None 2026-03-19 08:58:12,043 - lava_callback - DEBUG - Processing node 69bbba34ec3f435d20d52518: baseline-arm64-clabbe 2026-03-19 08:58:12,337 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:12,340 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba27ec3f435d20d524cc/log.txt.gz 2026-03-19 08:58:12,520 - lava_callback - INFO - Received callback for node 69bbb7d7ec3f435d20d51cbd INFO: 172.20.0.1:55868 - "POST /node/69bbb7d7ec3f435d20d51cbd HTTP/1.0" 202 Accepted 2026-03-19 08:58:12,539 - lava_callback - INFO - Starting async job submit for node 69bbb7d7ec3f435d20d51cbd 2026-03-19 08:58:12,589 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:12,590 - lava_callback - INFO - Received callback for node 69bbba2cec3f435d20d524fa 2026-03-19 08:58:12,612 - lava_callback - INFO - Starting async job submit for node 69bbba2cec3f435d20d524fa 2026-03-19 08:58:12,617 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:55874 - "POST /node/69bbba2cec3f435d20d524fa HTTP/1.0" 202 Accepted 2026-03-19 08:58:12,662 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:12,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d7ec3f435d20d51cbd HTTP/1.1" 200 None 2026-03-19 08:58:12,763 - lava_callback - DEBUG - Processing node 69bbb7d7ec3f435d20d51cbd: ltp-sched 2026-03-19 08:58:12,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:12,796 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba2cec3f435d20d524fa HTTP/1.1" 200 None 2026-03-19 08:58:12,797 - lava_callback - DEBUG - Processing node 69bbba2cec3f435d20d524fa: baseline-arm64-broonie 2026-03-19 08:58:13,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:13,177 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69bbba34ec3f435d20d52518/log.txt.gz 2026-03-19 08:58:13,356 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:13,373 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:13,558 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba27ec3f435d20d524cc/lava-logs.yaml 2026-03-19 08:58:13,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:13,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 2026-03-19 08:58:13,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:13,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:14,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:14,020 - lava_callback - INFO - Received callback for node 69bbba2fec3f435d20d52503 2026-03-19 08:58:14,044 - lava_callback - INFO - Starting async job submit for node 69bbba2fec3f435d20d52503 INFO: 172.20.0.1:55882 - "POST /node/69bbba2fec3f435d20d52503 HTTP/1.0" 202 Accepted 2026-03-19 08:58:14,090 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba27ec3f435d20d524cc/lava_callback.json.gz 2026-03-19 08:58:14,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:14,144 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:14,146 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:14,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba2fec3f435d20d52503 HTTP/1.1" 200 None 2026-03-19 08:58:14,167 - lava_callback - DEBUG - Processing node 69bbba2fec3f435d20d52503: baseline-arm64-broonie 2026-03-19 08:58:14,178 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba27ec3f435d20d524cc HTTP/1.1" 200 None 2026-03-19 08:58:14,196 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:14,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:14,235 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69bbba34ec3f435d20d52518/lava-logs.yaml 2026-03-19 08:58:14,268 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:14,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:14,283 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:14,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba27ec3f435d20d524cc HTTP/1.1" 200 None 2026-03-19 08:58:14,369 - lava_callback - INFO - Completed processing callback for node 69bbba27ec3f435d20d524cc 2026-03-19 08:58:14,430 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:14,440 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-sched-69bbb7d7ec3f435d20d51cbd/log.txt.gz 2026-03-19 08:58:14,610 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:14,612 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2cec3f435d20d524fa/log.txt.gz 2026-03-19 08:58:14,748 - lava_callback - INFO - Received callback for node 69bbba0aec3f435d20d5247c INFO: 172.20.0.1:55888 - "POST /node/69bbba0aec3f435d20d5247c HTTP/1.0" 202 Accepted 2026-03-19 08:58:14,799 - lava_callback - INFO - Starting async job submit for node 69bbba0aec3f435d20d5247c 2026-03-19 08:58:14,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:15,179 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:15,182 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba0aec3f435d20d5247c HTTP/1.1" 200 None 2026-03-19 08:58:15,184 - lava_callback - DEBUG - Processing node 69bbba0aec3f435d20d5247c: baseline-nfs-arm64 INFO: 172.20.0.1:55898 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-19 08:58:15,218 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-clabbe-69bbba34ec3f435d20d52518/lava_callback.json.gz 2026-03-19 08:58:15,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:15,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:15,496 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba34ec3f435d20d52518 HTTP/1.1" 200 None 2026-03-19 08:58:15,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:15,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:15,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:15,585 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:15,601 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:15,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba34ec3f435d20d52518 HTTP/1.1" 200 None 2026-03-19 08:58:15,720 - lava_callback - INFO - Completed processing callback for node 69bbba34ec3f435d20d52518 2026-03-19 08:58:16,005 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:16,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:16,016 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2fec3f435d20d52503/log.txt.gz 2026-03-19 08:58:16,181 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:16,188 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2cec3f435d20d524fa/lava-logs.yaml 2026-03-19 08:58:16,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:16,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:16,281 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:16,283 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-sched-69bbb7d7ec3f435d20d51cbd/lava-logs.yaml 2026-03-19 08:58:16,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:55914 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:58:16,606 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:16,608 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0aec3f435d20d5247c/log.txt.gz 2026-03-19 08:58:16,795 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:16,820 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2cec3f435d20d524fa/lava_callback.json.gz 2026-03-19 08:58:16,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:16,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:16,907 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2fec3f435d20d52503/lava-logs.yaml 2026-03-19 08:58:16,943 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:16,944 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:16,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba2cec3f435d20d524fa HTTP/1.1" 200 None 2026-03-19 08:58:16,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:16,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:16,962 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-sched-69bbb7d7ec3f435d20d51cbd/lava_callback.json.gz 2026-03-19 08:58:17,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:17,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:17,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:17,037 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d7ec3f435d20d51cbd HTTP/1.1" 200 None 2026-03-19 08:58:17,039 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:17,059 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba2cec3f435d20d524fa HTTP/1.1" 200 None 2026-03-19 08:58:17,061 - lava_callback - INFO - Completed processing callback for node 69bbba2cec3f435d20d524fa 2026-03-19 08:58:17,069 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 08:58:17,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:17,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7d7ec3f435d20d51cbd HTTP/1.1" 200 None 2026-03-19 08:58:17,152 - lava_callback - INFO - Completed processing callback for node 69bbb7d7ec3f435d20d51cbd 2026-03-19 08:58:17,738 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:17,740 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0aec3f435d20d5247c/lava-logs.yaml 2026-03-19 08:58:17,748 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:17,799 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:17,801 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba2fec3f435d20d52503/lava_callback.json.gz 2026-03-19 08:58:17,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:17,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba2fec3f435d20d52503 HTTP/1.1" 200 None 2026-03-19 08:58:17,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:17,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:17,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:17,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba2fec3f435d20d52503 HTTP/1.1" 200 None 2026-03-19 08:58:17,919 - lava_callback - INFO - Completed processing callback for node 69bbba2fec3f435d20d52503 2026-03-19 08:58:18,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:18,236 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0aec3f435d20d5247c/lava_callback.json.gz 2026-03-19 08:58:18,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:18,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba0aec3f435d20d5247c HTTP/1.1" 200 None 2026-03-19 08:58:18,293 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:18,317 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:18,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:18,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba0aec3f435d20d5247c HTTP/1.1" 200 None 2026-03-19 08:58:18,365 - lava_callback - INFO - Completed processing callback for node 69bbba0aec3f435d20d5247c 2026-03-19 08:58:23,211 - lava_callback - INFO - Received callback for node 69bbba13ec3f435d20d52497 INFO: 172.20.0.1:54334 - "POST /node/69bbba13ec3f435d20d52497 HTTP/1.0" 202 Accepted 2026-03-19 08:58:23,219 - lava_callback - INFO - Starting async job submit for node 69bbba13ec3f435d20d52497 2026-03-19 08:58:23,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:23,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba13ec3f435d20d52497 HTTP/1.1" 200 None 2026-03-19 08:58:23,324 - lava_callback - DEBUG - Processing node 69bbba13ec3f435d20d52497: baseline-nfs-arm64 2026-03-19 08:58:23,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:24,170 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:24,172 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba13ec3f435d20d52497/log.txt.gz 2026-03-19 08:58:24,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:25,076 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:25,078 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba13ec3f435d20d52497/lava-logs.yaml 2026-03-19 08:58:25,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:25,243 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:25,245 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba13ec3f435d20d52497/lava_callback.json.gz 2026-03-19 08:58:25,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:25,284 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba13ec3f435d20d52497 HTTP/1.1" 200 None 2026-03-19 08:58:25,285 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:25,299 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:25,301 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:25,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba13ec3f435d20d52497 HTTP/1.1" 200 None 2026-03-19 08:58:25,328 - lava_callback - INFO - Completed processing callback for node 69bbba13ec3f435d20d52497 INFO: 172.20.0.1:54336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43124 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:58:43,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:43,735 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 15 INFO: 172.20.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46568 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:58:53,137 - lava_callback - INFO - Received callback for node 69bbba23ec3f435d20d524c3 INFO: 172.20.0.1:46582 - "POST /node/69bbba23ec3f435d20d524c3 HTTP/1.0" 202 Accepted 2026-03-19 08:58:53,146 - lava_callback - INFO - Starting async job submit for node 69bbba23ec3f435d20d524c3 2026-03-19 08:58:53,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:53,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba23ec3f435d20d524c3 HTTP/1.1" 200 None 2026-03-19 08:58:53,228 - lava_callback - DEBUG - Processing node 69bbba23ec3f435d20d524c3: baseline-arm64-broonie 2026-03-19 08:58:53,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:53,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:53,777 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba23ec3f435d20d524c3/log.txt.gz 2026-03-19 08:58:54,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:54,312 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:54,313 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba23ec3f435d20d524c3/lava-logs.yaml 2026-03-19 08:58:54,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:58:54,469 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:58:54,471 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba23ec3f435d20d524c3/lava_callback.json.gz 2026-03-19 08:58:54,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:54,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba23ec3f435d20d524c3 HTTP/1.1" 200 None 2026-03-19 08:58:54,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:54,538 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:58:54,540 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:58:54,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba23ec3f435d20d524c3 HTTP/1.1" 200 None 2026-03-19 08:58:54,579 - lava_callback - INFO - Completed processing callback for node 69bbba23ec3f435d20d524c3 INFO: 172.20.0.1:46586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46598 - "GET /favicon.ico HTTP/1.0" 404 Not Found 2026-03-19 08:59:01,702 - lava_callback - INFO - Received callback for node 69b917c30ec88e58bad0dd5d INFO: 172.20.0.1:55934 - "POST /node/69b917c30ec88e58bad0dd5d HTTP/1.0" 202 Accepted 2026-03-19 08:59:01,711 - lava_callback - INFO - Starting async job submit for node 69b917c30ec88e58bad0dd5d 2026-03-19 08:59:01,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:01,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917c30ec88e58bad0dd5d HTTP/1.1" 200 None 2026-03-19 08:59:01,740 - lava_callback - DEBUG - Processing node 69b917c30ec88e58bad0dd5d: baseline-arm-clabbe 2026-03-19 08:59:01,740 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b917c30ec88e58bad0dd5d 2026-03-19 08:59:01,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:01,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b917c30ec88e58bad0dd5d HTTP/1.1" 200 None 2026-03-19 08:59:01,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:01,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b12591a870a1dc3343ba82 HTTP/1.1" 200 None 2026-03-19 08:59:01,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:01,837 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b917c30ec88e58bad0dd5d HTTP/1.1" 200 None 2026-03-19 08:59:01,839 - lava_callback - ERROR - Error processing callback for node 69b917c30ec88e58bad0dd5d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 08:59:02,022 - lava_callback - INFO - Received callback for node 69bbb9fcec3f435d20d5243a INFO: 172.20.0.1:55948 - "POST /node/69bbb9fcec3f435d20d5243a HTTP/1.0" 202 Accepted 2026-03-19 08:59:02,032 - lava_callback - INFO - Starting async job submit for node 69bbb9fcec3f435d20d5243a 2026-03-19 08:59:02,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:02,092 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9fcec3f435d20d5243a HTTP/1.1" 200 None 2026-03-19 08:59:02,094 - lava_callback - DEBUG - Processing node 69bbb9fcec3f435d20d5243a: baseline-arm64 2026-03-19 08:59:02,632 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:59:03,145 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:59:03,147 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9fcec3f435d20d5243a/log.txt.gz 2026-03-19 08:59:03,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:59:03,851 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:59:03,853 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9fcec3f435d20d5243a/lava-logs.yaml 2026-03-19 08:59:03,865 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:59:04,053 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:59:04,055 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbb9fcec3f435d20d5243a/lava_callback.json.gz 2026-03-19 08:59:04,088 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:04,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb9fcec3f435d20d5243a HTTP/1.1" 200 None 2026-03-19 08:59:04,114 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:04,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:59:04,137 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:04,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb9fcec3f435d20d5243a HTTP/1.1" 200 None 2026-03-19 08:59:04,190 - lava_callback - INFO - Completed processing callback for node 69bbb9fcec3f435d20d5243a INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:59:13,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:13,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41946 - "GET / HTTP/1.0" 200 OK 2026-03-19 08:59:52,612 - lava_callback - INFO - Received callback for node 69bbba29ec3f435d20d524f4 INFO: 172.20.0.1:55882 - "POST /node/69bbba29ec3f435d20d524f4 HTTP/1.0" 202 Accepted 2026-03-19 08:59:52,618 - lava_callback - INFO - Starting async job submit for node 69bbba29ec3f435d20d524f4 2026-03-19 08:59:52,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:52,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba29ec3f435d20d524f4 HTTP/1.1" 200 None 2026-03-19 08:59:52,656 - lava_callback - DEBUG - Processing node 69bbba29ec3f435d20d524f4: baseline-arm64-broonie 2026-03-19 08:59:52,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:59:53,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:59:53,073 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba29ec3f435d20d524f4/log.txt.gz 2026-03-19 08:59:53,228 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:59:53,416 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:59:53,417 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba29ec3f435d20d524f4/lava-logs.yaml 2026-03-19 08:59:53,424 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 08:59:53,593 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 08:59:53,595 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-broonie-69bbba29ec3f435d20d524f4/lava_callback.json.gz 2026-03-19 08:59:53,618 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:53,632 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba29ec3f435d20d524f4 HTTP/1.1" 200 None 2026-03-19 08:59:53,634 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:53,647 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 08:59:53,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 08:59:53,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba29ec3f435d20d524f4 HTTP/1.1" 200 None 2026-03-19 08:59:53,677 - lava_callback - INFO - Completed processing callback for node 69bbba29ec3f435d20d524f4 INFO: 172.20.0.1:55884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58134 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:00:09,299 - lava_callback - INFO - Received callback for node 69bbba0bec3f435d20d5247f INFO: 172.20.0.1:58136 - "POST /node/69bbba0bec3f435d20d5247f HTTP/1.0" 202 Accepted 2026-03-19 09:00:09,305 - lava_callback - INFO - Starting async job submit for node 69bbba0bec3f435d20d5247f 2026-03-19 09:00:09,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:00:09,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba0bec3f435d20d5247f HTTP/1.1" 200 None 2026-03-19 09:00:09,341 - lava_callback - DEBUG - Processing node 69bbba0bec3f435d20d5247f: baseline-nfs-arm64 2026-03-19 09:00:09,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:00:09,921 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:00:09,923 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0bec3f435d20d5247f/log.txt.gz 2026-03-19 09:00:10,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:00:10,376 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:00:10,378 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0bec3f435d20d5247f/lava-logs.yaml 2026-03-19 09:00:10,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:00:10,587 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:00:10,589 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0bec3f435d20d5247f/lava_callback.json.gz 2026-03-19 09:00:10,608 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:00:10,623 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba0bec3f435d20d5247f HTTP/1.1" 200 None 2026-03-19 09:00:10,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:00:10,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:00:10,644 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:00:10,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba0bec3f435d20d5247f HTTP/1.1" 200 None 2026-03-19 09:00:10,670 - lava_callback - INFO - Completed processing callback for node 69bbba0bec3f435d20d5247f INFO: 172.20.0.1:58782 - "GET /.well-known/security.txt HTTP/1.0" 404 Not Found 2026-03-19 09:00:13,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:00:13,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:58792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49086 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:01:08,329 - lava_callback - INFO - Received callback for node 69bbb7d9ec3f435d20d51cc0 INFO: 172.20.0.1:49102 - "POST /node/69bbb7d9ec3f435d20d51cc0 HTTP/1.0" 202 Accepted 2026-03-19 09:01:08,336 - lava_callback - INFO - Starting async job submit for node 69bbb7d9ec3f435d20d51cc0 2026-03-19 09:01:08,363 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:08,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d9ec3f435d20d51cc0 HTTP/1.1" 200 None 2026-03-19 09:01:08,378 - lava_callback - DEBUG - Processing node 69bbb7d9ec3f435d20d51cc0: ltp-smoke 2026-03-19 09:01:08,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:01:09,014 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:01:09,015 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbb7d9ec3f435d20d51cc0/log.txt.gz 2026-03-19 09:01:09,338 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:01:09,562 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:01:09,565 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbb7d9ec3f435d20d51cc0/lava-logs.yaml 2026-03-19 09:01:09,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:01:09,762 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:01:09,764 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbb7d9ec3f435d20d51cc0/lava_callback.json.gz 2026-03-19 09:01:09,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:09,818 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7d9ec3f435d20d51cc0 HTTP/1.1" 200 None 2026-03-19 09:01:09,820 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:09,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 09:01:09,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:09,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7d9ec3f435d20d51cc0 HTTP/1.1" 200 None 2026-03-19 09:01:09,879 - lava_callback - INFO - Completed processing callback for node 69bbb7d9ec3f435d20d51cc0 2026-03-19 09:01:13,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:13,798 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36034 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:01:25,928 - lava_callback - INFO - Received callback for node 69b918580ec88e58bad0dd89 INFO: 172.20.0.1:50808 - "POST /node/69b918580ec88e58bad0dd89 HTTP/1.0" 202 Accepted 2026-03-19 09:01:25,934 - lava_callback - INFO - Starting async job submit for node 69b918580ec88e58bad0dd89 2026-03-19 09:01:25,935 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:25,949 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b918580ec88e58bad0dd89 HTTP/1.1" 200 None 2026-03-19 09:01:25,950 - lava_callback - DEBUG - Processing node 69b918580ec88e58bad0dd89: baseline-arm64-baylibre 2026-03-19 09:01:25,951 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b918580ec88e58bad0dd89 2026-03-19 09:01:25,951 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:25,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b918580ec88e58bad0dd89 HTTP/1.1" 200 None 2026-03-19 09:01:25,966 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:25,979 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:01:25,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:26,003 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b918580ec88e58bad0dd89 HTTP/1.1" 200 None 2026-03-19 09:01:26,005 - lava_callback - ERROR - Error processing callback for node 69b918580ec88e58bad0dd89: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50822 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:01:28,302 - lava_callback - INFO - Received callback for node 69bbb7dbec3f435d20d51cc6 INFO: 172.20.0.1:50832 - "POST /node/69bbb7dbec3f435d20d51cc6 HTTP/1.0" 202 Accepted 2026-03-19 09:01:28,313 - lava_callback - INFO - Starting async job submit for node 69bbb7dbec3f435d20d51cc6 2026-03-19 09:01:28,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:28,366 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7dbec3f435d20d51cc6 HTTP/1.1" 200 None 2026-03-19 09:01:28,367 - lava_callback - DEBUG - Processing node 69bbb7dbec3f435d20d51cc6: ltp-syscalls-ipc 2026-03-19 09:01:28,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:01:28,911 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:01:28,913 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69bbb7dbec3f435d20d51cc6/log.txt.gz 2026-03-19 09:01:29,221 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:01:29,432 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:01:29,434 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69bbb7dbec3f435d20d51cc6/lava-logs.yaml 2026-03-19 09:01:29,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:01:29,624 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:01:29,626 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-syscalls-ipc-69bbb7dbec3f435d20d51cc6/lava_callback.json.gz 2026-03-19 09:01:29,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:29,669 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7dbec3f435d20d51cc6 HTTP/1.1" 200 None 2026-03-19 09:01:29,671 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:29,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 09:01:29,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:29,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7dbec3f435d20d51cc6 HTTP/1.1" 200 None 2026-03-19 09:01:29,715 - lava_callback - INFO - Completed processing callback for node 69bbb7dbec3f435d20d51cc6 INFO: 172.20.0.1:39438 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:01:43,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:01:43,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:54440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48234 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:02:08,217 - lava_callback - INFO - Received callback for node 69bbb7dfec3f435d20d51cd0 INFO: 172.20.0.1:48244 - "POST /node/69bbb7dfec3f435d20d51cd0 HTTP/1.0" 202 Accepted 2026-03-19 09:02:08,224 - lava_callback - INFO - Starting async job submit for node 69bbb7dfec3f435d20d51cd0 2026-03-19 09:02:08,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:08,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7dfec3f435d20d51cd0 HTTP/1.1" 200 None 2026-03-19 09:02:08,270 - lava_callback - DEBUG - Processing node 69bbb7dfec3f435d20d51cd0: ltp-watchqueue 2026-03-19 09:02:08,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:02:08,944 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:02:08,945 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69bbb7dfec3f435d20d51cd0/log.txt.gz 2026-03-19 09:02:09,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:02:09,498 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:02:09,501 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69bbb7dfec3f435d20d51cd0/lava-logs.yaml 2026-03-19 09:02:09,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:02:09,793 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:02:09,795 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-watchqueue-69bbb7dfec3f435d20d51cd0/lava_callback.json.gz 2026-03-19 09:02:09,823 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:09,839 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7dfec3f435d20d51cd0 HTTP/1.1" 200 None 2026-03-19 09:02:09,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:09,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 09:02:09,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:09,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7dfec3f435d20d51cd0 HTTP/1.1" 200 None 2026-03-19 09:02:09,893 - lava_callback - INFO - Completed processing callback for node 69bbb7dfec3f435d20d51cd0 2026-03-19 09:02:12,593 - lava_callback - INFO - Received callback for node 69bbb7deec3f435d20d51ccd INFO: 172.20.0.1:42214 - "POST /node/69bbb7deec3f435d20d51ccd HTTP/1.0" 202 Accepted 2026-03-19 09:02:12,599 - lava_callback - INFO - Starting async job submit for node 69bbb7deec3f435d20d51ccd 2026-03-19 09:02:12,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:12,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7deec3f435d20d51ccd HTTP/1.1" 200 None 2026-03-19 09:02:12,660 - lava_callback - DEBUG - Processing node 69bbb7deec3f435d20d51ccd: ltp-timers 2026-03-19 09:02:13,042 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:02:13,276 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:02:13,278 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-timers-69bbb7deec3f435d20d51ccd/log.txt.gz 2026-03-19 09:02:13,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:02:13,736 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:02:13,738 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-timers-69bbb7deec3f435d20d51ccd/lava-logs.yaml 2026-03-19 09:02:13,746 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:02:13,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:13,835 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-19 09:02:13,932 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:02:13,934 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-timers-69bbb7deec3f435d20d51ccd/lava_callback.json.gz 2026-03-19 09:02:13,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:13,978 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7deec3f435d20d51ccd HTTP/1.1" 200 None 2026-03-19 09:02:13,979 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:13,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 09:02:13,998 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:14,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7deec3f435d20d51ccd HTTP/1.1" 200 None 2026-03-19 09:02:14,038 - lava_callback - INFO - Completed processing callback for node 69bbb7deec3f435d20d51ccd INFO: 172.20.0.1:42218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42220 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:02:21,492 - lava_callback - INFO - Received callback for node 69bbbb89ec3f435d20d526fc INFO: 172.20.0.1:36038 - "POST /node/69bbbb89ec3f435d20d526fc HTTP/1.0" 202 Accepted 2026-03-19 09:02:21,498 - lava_callback - INFO - Starting async job submit for node 69bbbb89ec3f435d20d526fc 2026-03-19 09:02:21,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:21,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbb89ec3f435d20d526fc HTTP/1.1" 200 None 2026-03-19 09:02:21,529 - lava_callback - DEBUG - Processing node 69bbbb89ec3f435d20d526fc: baseline-arm 2026-03-19 09:02:21,537 - lava_callback - WARNING - Failed to upload log 2026-03-19 09:02:21,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:02:21,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:02:21,696 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbbb89ec3f435d20d526fc/lava-logs.yaml 2026-03-19 09:02:21,698 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:02:21,873 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:02:21,875 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbbb89ec3f435d20d526fc/lava_callback.json.gz 2026-03-19 09:02:21,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:21,894 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbb89ec3f435d20d526fc HTTP/1.1" 200 None 2026-03-19 09:02:21,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:21,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 09:02:21,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:21,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbbb89ec3f435d20d526fc HTTP/1.1" 200 None 2026-03-19 09:02:21,950 - lava_callback - INFO - Completed processing callback for node 69bbbb89ec3f435d20d526fc INFO: 172.20.0.1:36052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36068 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:02:32,584 - lava_callback - INFO - Received callback for node 69bbb793ec3f435d20d51bdd INFO: 172.20.0.1:35918 - "POST /node/69bbb793ec3f435d20d51bdd HTTP/1.0" 202 Accepted 2026-03-19 09:02:32,591 - lava_callback - INFO - Starting async job submit for node 69bbb793ec3f435d20d51bdd 2026-03-19 09:02:32,647 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:32,661 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb793ec3f435d20d51bdd HTTP/1.1" 200 None 2026-03-19 09:02:32,662 - lava_callback - DEBUG - Processing node 69bbb793ec3f435d20d51bdd: baseline-arm 2026-03-19 09:02:33,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:02:33,550 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:02:33,552 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb793ec3f435d20d51bdd/log.txt.gz 2026-03-19 09:02:33,914 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:02:34,202 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:02:34,204 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb793ec3f435d20d51bdd/lava-logs.yaml 2026-03-19 09:02:34,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:02:34,449 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:02:34,451 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbb793ec3f435d20d51bdd/lava_callback.json.gz DEBUG: Setup failed for 69bbb793ec3f435d20d51bdd. Transitting job node result: incomplete -> fail 2026-03-19 09:02:34,592 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:34,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb793ec3f435d20d51bdd HTTP/1.1" 200 None 2026-03-19 09:02:34,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:34,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 09:02:34,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:34,657 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb793ec3f435d20d51bdd HTTP/1.1" 200 None 2026-03-19 09:02:34,824 - lava_callback - INFO - Completed processing callback for node 69bbb793ec3f435d20d51bdd INFO: 172.20.0.1:35924 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:02:43,837 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:02:43,854 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46612 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:03:06,176 - lava_callback - INFO - Received callback for node 69b918c60ec88e58bad0dda6 INFO: 172.20.0.1:46762 - "POST /node/69b918c60ec88e58bad0dda6 HTTP/1.0" 202 Accepted 2026-03-19 09:03:06,181 - lava_callback - INFO - Starting async job submit for node 69b918c60ec88e58bad0dda6 2026-03-19 09:03:06,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:03:06,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b918c60ec88e58bad0dda6 HTTP/1.1" 200 None 2026-03-19 09:03:06,199 - lava_callback - DEBUG - Processing node 69b918c60ec88e58bad0dda6: baseline-arm64-baylibre 2026-03-19 09:03:06,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b918c60ec88e58bad0dda6 2026-03-19 09:03:06,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:03:06,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b918c60ec88e58bad0dda6 HTTP/1.1" 200 None 2026-03-19 09:03:06,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:03:06,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:03:06,231 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:03:06,266 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b918c60ec88e58bad0dda6 HTTP/1.1" 200 None 2026-03-19 09:03:06,277 - lava_callback - ERROR - Error processing callback for node 69b918c60ec88e58bad0dda6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55090 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:03:27,455 - lava_callback - INFO - Received callback for node 69bbba09ec3f435d20d52460 INFO: 172.20.0.1:55098 - "POST /node/69bbba09ec3f435d20d52460 HTTP/1.0" 202 Accepted 2026-03-19 09:03:27,462 - lava_callback - INFO - Starting async job submit for node 69bbba09ec3f435d20d52460 2026-03-19 09:03:27,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:03:27,514 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba09ec3f435d20d52460 HTTP/1.1" 200 None 2026-03-19 09:03:27,515 - lava_callback - DEBUG - Processing node 69bbba09ec3f435d20d52460: baseline-arm64 2026-03-19 09:03:27,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:03:28,011 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:03:28,013 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba09ec3f435d20d52460/log.txt.gz 2026-03-19 09:03:28,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:03:28,429 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:03:28,431 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba09ec3f435d20d52460/lava-logs.yaml 2026-03-19 09:03:28,440 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:03:28,580 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:03:28,582 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba09ec3f435d20d52460/lava_callback.json.gz DEBUG: Setup failed for 69bbba09ec3f435d20d52460. Transitting job node result: incomplete -> fail 2026-03-19 09:03:28,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:03:28,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba09ec3f435d20d52460 HTTP/1.1" 200 None 2026-03-19 09:03:28,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:03:28,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:03:28,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:03:28,722 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba09ec3f435d20d52460 HTTP/1.1" 200 None 2026-03-19 09:03:28,792 - lava_callback - INFO - Completed processing callback for node 69bbba09ec3f435d20d52460 INFO: 172.20.0.1:40778 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:03:43,856 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:03:43,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60292 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:05:06,037 - lava_callback - INFO - Received callback for node 69b9193c0ec88e58bad0dddc INFO: 172.20.0.1:44500 - "POST /node/69b9193c0ec88e58bad0dddc HTTP/1.0" 202 Accepted 2026-03-19 09:05:06,042 - lava_callback - INFO - Starting async job submit for node 69b9193c0ec88e58bad0dddc 2026-03-19 09:05:06,043 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:05:06,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9193c0ec88e58bad0dddc HTTP/1.1" 200 None 2026-03-19 09:05:06,058 - lava_callback - DEBUG - Processing node 69b9193c0ec88e58bad0dddc: baseline-arm64-baylibre 2026-03-19 09:05:06,058 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9193c0ec88e58bad0dddc 2026-03-19 09:05:06,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:05:06,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9193c0ec88e58bad0dddc HTTP/1.1" 200 None 2026-03-19 09:05:06,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:05:06,088 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:05:06,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:05:06,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9193c0ec88e58bad0dddc HTTP/1.1" 200 None 2026-03-19 09:05:06,123 - lava_callback - ERROR - Error processing callback for node 69b9193c0ec88e58bad0dddc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60668 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60678 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:05:24,359 - lava_callback - INFO - Received callback for node 69bbb7b6ec3f435d20d51c7c INFO: 172.20.0.1:57854 - "POST /node/69bbb7b6ec3f435d20d51c7c HTTP/1.0" 202 Accepted 2026-03-19 09:05:24,409 - lava_callback - INFO - Starting async job submit for node 69bbb7b6ec3f435d20d51c7c 2026-03-19 09:05:24,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:05:24,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7b6ec3f435d20d51c7c HTTP/1.1" 200 None 2026-03-19 09:05:24,448 - lava_callback - DEBUG - Processing node 69bbb7b6ec3f435d20d51c7c: baseline-arm-pengutronix 2026-03-19 09:05:24,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:05:24,715 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:05:24,717 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b6ec3f435d20d51c7c/log.txt.gz 2026-03-19 09:05:24,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:05:24,956 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:05:24,957 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b6ec3f435d20d51c7c/lava-logs.yaml 2026-03-19 09:05:24,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:05:25,108 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:05:25,110 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbb7b6ec3f435d20d51c7c/lava_callback.json.gz DEBUG: Setup failed for 69bbb7b6ec3f435d20d51c7c. Transitting job node result: incomplete -> fail 2026-03-19 09:05:25,160 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:05:25,175 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb7b6ec3f435d20d51c7c HTTP/1.1" 200 None 2026-03-19 09:05:25,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:05:25,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 09:05:25,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:05:25,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbb7b6ec3f435d20d51c7c HTTP/1.1" 200 None 2026-03-19 09:05:25,298 - lava_callback - INFO - Completed processing callback for node 69bbb7b6ec3f435d20d51c7c INFO: 172.20.0.1:57862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40122 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:05:43,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:05:43,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:38656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43856 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:06:21,232 - lava_callback - INFO - Received callback for node 69bbba14ec3f435d20d5249a INFO: 172.20.0.1:43538 - "POST /node/69bbba14ec3f435d20d5249a HTTP/1.0" 202 Accepted 2026-03-19 09:06:21,239 - lava_callback - INFO - Starting async job submit for node 69bbba14ec3f435d20d5249a 2026-03-19 09:06:21,264 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:06:21,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba14ec3f435d20d5249a HTTP/1.1" 200 None 2026-03-19 09:06:21,282 - lava_callback - DEBUG - Processing node 69bbba14ec3f435d20d5249a: baseline-nfs-arm64 2026-03-19 09:06:21,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:06:22,001 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:06:22,003 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba14ec3f435d20d5249a/log.txt.gz 2026-03-19 09:06:22,257 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:06:22,488 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:06:22,491 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba14ec3f435d20d5249a/lava-logs.yaml 2026-03-19 09:06:22,502 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:06:22,679 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:06:22,680 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba14ec3f435d20d5249a/lava_callback.json.gz 2026-03-19 09:06:22,707 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:06:22,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba14ec3f435d20d5249a HTTP/1.1" 200 None 2026-03-19 09:06:22,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:06:22,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:06:22,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:06:22,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba14ec3f435d20d5249a HTTP/1.1" 200 None 2026-03-19 09:06:22,836 - lava_callback - INFO - Completed processing callback for node 69bbba14ec3f435d20d5249a INFO: 172.20.0.1:43546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42524 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:06:41,531 - lava_callback - INFO - Received callback for node 69bbba04ec3f435d20d5244f INFO: 172.20.0.1:44638 - "POST /node/69bbba04ec3f435d20d5244f HTTP/1.0" 202 Accepted 2026-03-19 09:06:41,537 - lava_callback - INFO - Starting async job submit for node 69bbba04ec3f435d20d5244f 2026-03-19 09:06:41,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:06:41,595 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba04ec3f435d20d5244f HTTP/1.1" 200 None 2026-03-19 09:06:41,596 - lava_callback - DEBUG - Processing node 69bbba04ec3f435d20d5244f: baseline-arm64 2026-03-19 09:06:42,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:06:42,289 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:06:42,291 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba04ec3f435d20d5244f/log.txt.gz 2026-03-19 09:06:42,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:06:42,753 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:06:42,755 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba04ec3f435d20d5244f/lava-logs.yaml 2026-03-19 09:06:42,767 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:06:42,918 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:06:42,921 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbba04ec3f435d20d5244f/lava_callback.json.gz 2026-03-19 09:06:42,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:06:42,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba04ec3f435d20d5244f HTTP/1.1" 200 None 2026-03-19 09:06:42,970 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:06:42,985 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:06:42,987 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:06:43,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba04ec3f435d20d5244f HTTP/1.1" 200 None 2026-03-19 09:06:43,081 - lava_callback - INFO - Completed processing callback for node 69bbba04ec3f435d20d5244f 2026-03-19 09:06:43,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:06:43,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58328 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33186 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:07:41,510 - lava_callback - INFO - Received callback for node 69bbbcc3ec3f435d20d52770 INFO: 172.20.0.1:34360 - "POST /node/69bbbcc3ec3f435d20d52770 HTTP/1.0" 202 Accepted 2026-03-19 09:07:41,516 - lava_callback - INFO - Starting async job submit for node 69bbbcc3ec3f435d20d52770 2026-03-19 09:07:41,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:07:41,539 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbcc3ec3f435d20d52770 HTTP/1.1" 200 None 2026-03-19 09:07:41,540 - lava_callback - DEBUG - Processing node 69bbbcc3ec3f435d20d52770: baseline-nfs-arm64 2026-03-19 09:07:41,541 - lava_callback - WARNING - Failed to upload log 2026-03-19 09:07:41,542 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:07:41,693 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:07:41,694 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbbcc3ec3f435d20d52770/lava-logs.yaml 2026-03-19 09:07:41,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:07:41,838 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:07:41,840 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbbcc3ec3f435d20d52770/lava_callback.json.gz 2026-03-19 09:07:41,842 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:07:41,861 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbcc3ec3f435d20d52770 HTTP/1.1" 200 None 2026-03-19 09:07:41,862 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:07:41,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:07:41,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:07:41,898 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbbcc3ec3f435d20d52770 HTTP/1.1" 200 None 2026-03-19 09:07:41,911 - lava_callback - INFO - Completed processing callback for node 69bbbcc3ec3f435d20d52770 2026-03-19 09:07:43,911 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:07:43,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:34362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58902 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:08:06,315 - lava_callback - INFO - Received callback for node 69b919ed0ec88e58bad0deab INFO: 172.20.0.1:42922 - "POST /node/69b919ed0ec88e58bad0deab HTTP/1.0" 202 Accepted 2026-03-19 09:08:06,321 - lava_callback - INFO - Starting async job submit for node 69b919ed0ec88e58bad0deab 2026-03-19 09:08:06,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:06,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ed0ec88e58bad0deab HTTP/1.1" 200 None 2026-03-19 09:08:06,341 - lava_callback - DEBUG - Processing node 69b919ed0ec88e58bad0deab: baseline-arm64-baylibre 2026-03-19 09:08:06,341 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b919ed0ec88e58bad0deab 2026-03-19 09:08:06,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:06,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ed0ec88e58bad0deab HTTP/1.1" 200 None 2026-03-19 09:08:06,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:06,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:06,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:06,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919ed0ec88e58bad0deab HTTP/1.1" 200 None 2026-03-19 09:08:06,396 - lava_callback - ERROR - Error processing callback for node 69b919ed0ec88e58bad0deab: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42926 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:08:07,010 - lava_callback - INFO - Received callback for node 69b919ee0ec88e58bad0deae INFO: 172.20.0.1:42942 - "POST /node/69b919ee0ec88e58bad0deae HTTP/1.0" 202 Accepted 2026-03-19 09:08:07,016 - lava_callback - INFO - Starting async job submit for node 69b919ee0ec88e58bad0deae 2026-03-19 09:08:07,017 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:07,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ee0ec88e58bad0deae HTTP/1.1" 200 None 2026-03-19 09:08:07,032 - lava_callback - DEBUG - Processing node 69b919ee0ec88e58bad0deae: baseline-arm64-baylibre 2026-03-19 09:08:07,032 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b919ee0ec88e58bad0deae 2026-03-19 09:08:07,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:07,046 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ee0ec88e58bad0deae HTTP/1.1" 200 None 2026-03-19 09:08:07,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:07,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:07,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:07,086 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919ee0ec88e58bad0deae HTTP/1.1" 200 None 2026-03-19 09:08:07,087 - lava_callback - ERROR - Error processing callback for node 69b919ee0ec88e58bad0deae: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 09:08:07,666 - lava_callback - INFO - Received callback for node 69b919ef0ec88e58bad0deb1 INFO: 172.20.0.1:42952 - "POST /node/69b919ef0ec88e58bad0deb1 HTTP/1.0" 202 Accepted 2026-03-19 09:08:07,672 - lava_callback - INFO - Starting async job submit for node 69b919ef0ec88e58bad0deb1 2026-03-19 09:08:07,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:07,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ef0ec88e58bad0deb1 HTTP/1.1" 200 None 2026-03-19 09:08:07,690 - lava_callback - DEBUG - Processing node 69b919ef0ec88e58bad0deb1: baseline-arm64-baylibre 2026-03-19 09:08:07,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b919ef0ec88e58bad0deb1 2026-03-19 09:08:07,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:07,706 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919ef0ec88e58bad0deb1 HTTP/1.1" 200 None 2026-03-19 09:08:07,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:07,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:07,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:07,744 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919ef0ec88e58bad0deb1 HTTP/1.1" 200 None 2026-03-19 09:08:07,745 - lava_callback - ERROR - Error processing callback for node 69b919ef0ec88e58bad0deb1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 09:08:08,346 - lava_callback - INFO - Received callback for node 69b919f20ec88e58bad0deb8 INFO: 172.20.0.1:42956 - "POST /node/69b919f20ec88e58bad0deb8 HTTP/1.0" 202 Accepted 2026-03-19 09:08:08,351 - lava_callback - INFO - Starting async job submit for node 69b919f20ec88e58bad0deb8 2026-03-19 09:08:08,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:08,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f20ec88e58bad0deb8 HTTP/1.1" 200 None 2026-03-19 09:08:08,371 - lava_callback - DEBUG - Processing node 69b919f20ec88e58bad0deb8: baseline-arm64-baylibre 2026-03-19 09:08:08,371 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b919f20ec88e58bad0deb8 2026-03-19 09:08:08,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:08,388 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f20ec88e58bad0deb8 HTTP/1.1" 200 None 2026-03-19 09:08:08,389 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:08,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:08,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:08,425 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919f20ec88e58bad0deb8 HTTP/1.1" 200 None 2026-03-19 09:08:08,426 - lava_callback - ERROR - Error processing callback for node 69b919f20ec88e58bad0deb8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 09:08:09,022 - lava_callback - INFO - Received callback for node 69b919f30ec88e58bad0debb INFO: 172.20.0.1:42960 - "POST /node/69b919f30ec88e58bad0debb HTTP/1.0" 202 Accepted 2026-03-19 09:08:09,028 - lava_callback - INFO - Starting async job submit for node 69b919f30ec88e58bad0debb 2026-03-19 09:08:09,028 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:09,042 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f30ec88e58bad0debb HTTP/1.1" 200 None 2026-03-19 09:08:09,043 - lava_callback - DEBUG - Processing node 69b919f30ec88e58bad0debb: baseline-arm64-baylibre 2026-03-19 09:08:09,043 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b919f30ec88e58bad0debb 2026-03-19 09:08:09,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:09,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f30ec88e58bad0debb HTTP/1.1" 200 None 2026-03-19 09:08:09,059 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:09,072 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:09,074 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:09,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919f30ec88e58bad0debb HTTP/1.1" 200 None 2026-03-19 09:08:09,103 - lava_callback - ERROR - Error processing callback for node 69b919f30ec88e58bad0debb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52872 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:08:26,166 - lava_callback - INFO - Received callback for node 69b919f50ec88e58bad0debe INFO: 172.20.0.1:37822 - "POST /node/69b919f50ec88e58bad0debe HTTP/1.0" 202 Accepted 2026-03-19 09:08:26,172 - lava_callback - INFO - Starting async job submit for node 69b919f50ec88e58bad0debe 2026-03-19 09:08:26,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:26,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f50ec88e58bad0debe HTTP/1.1" 200 None 2026-03-19 09:08:26,187 - lava_callback - DEBUG - Processing node 69b919f50ec88e58bad0debe: baseline-arm64-baylibre 2026-03-19 09:08:26,188 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b919f50ec88e58bad0debe 2026-03-19 09:08:26,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:26,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919f50ec88e58bad0debe HTTP/1.1" 200 None 2026-03-19 09:08:26,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:26,223 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:26,225 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:26,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919f50ec88e58bad0debe HTTP/1.1" 200 None 2026-03-19 09:08:26,247 - lava_callback - ERROR - Error processing callback for node 69b919f50ec88e58bad0debe: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37834 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:08:26,861 - lava_callback - INFO - Received callback for node 69b919fb0ec88e58bad0dece INFO: 172.20.0.1:37842 - "POST /node/69b919fb0ec88e58bad0dece HTTP/1.0" 202 Accepted 2026-03-19 09:08:26,870 - lava_callback - INFO - Starting async job submit for node 69b919fb0ec88e58bad0dece 2026-03-19 09:08:26,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:26,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919fb0ec88e58bad0dece HTTP/1.1" 200 None 2026-03-19 09:08:26,887 - lava_callback - DEBUG - Processing node 69b919fb0ec88e58bad0dece: baseline-arm64-baylibre 2026-03-19 09:08:26,887 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b919fb0ec88e58bad0dece 2026-03-19 09:08:26,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:26,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b919fb0ec88e58bad0dece HTTP/1.1" 200 None 2026-03-19 09:08:26,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:26,922 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:08:26,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:26,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b919fb0ec88e58bad0dece HTTP/1.1" 200 None 2026-03-19 09:08:26,945 - lava_callback - ERROR - Error processing callback for node 69b919fb0ec88e58bad0dece: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40010 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:08:42,192 - lava_callback - INFO - Received callback for node 69b91a050ec88e58bad0defd INFO: 172.20.0.1:52440 - "POST /node/69b91a050ec88e58bad0defd HTTP/1.0" 202 Accepted 2026-03-19 09:08:42,198 - lava_callback - INFO - Starting async job submit for node 69b91a050ec88e58bad0defd 2026-03-19 09:08:42,199 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:42,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a050ec88e58bad0defd HTTP/1.1" 200 None 2026-03-19 09:08:42,214 - lava_callback - DEBUG - Processing node 69b91a050ec88e58bad0defd: baseline-arm64-clabbe 2026-03-19 09:08:42,214 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91a050ec88e58bad0defd 2026-03-19 09:08:42,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:42,237 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a050ec88e58bad0defd HTTP/1.1" 200 None 2026-03-19 09:08:42,239 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:42,252 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:42,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:42,281 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a050ec88e58bad0defd HTTP/1.1" 200 None 2026-03-19 09:08:42,283 - lava_callback - ERROR - Error processing callback for node 69b91a050ec88e58bad0defd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 09:08:42,846 - lava_callback - INFO - Received callback for node 69b91a060ec88e58bad0df00 INFO: 172.20.0.1:52448 - "POST /node/69b91a060ec88e58bad0df00 HTTP/1.0" 202 Accepted 2026-03-19 09:08:42,852 - lava_callback - INFO - Starting async job submit for node 69b91a060ec88e58bad0df00 2026-03-19 09:08:42,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:42,872 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a060ec88e58bad0df00 HTTP/1.1" 200 None 2026-03-19 09:08:42,873 - lava_callback - DEBUG - Processing node 69b91a060ec88e58bad0df00: baseline-arm64-clabbe 2026-03-19 09:08:42,873 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91a060ec88e58bad0df00 2026-03-19 09:08:42,874 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:42,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a060ec88e58bad0df00 HTTP/1.1" 200 None 2026-03-19 09:08:42,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:42,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:42,904 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:42,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a060ec88e58bad0df00 HTTP/1.1" 200 None 2026-03-19 09:08:42,929 - lava_callback - ERROR - Error processing callback for node 69b91a060ec88e58bad0df00: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 09:08:43,517 - lava_callback - INFO - Received callback for node 69b91a070ec88e58bad0df03 INFO: 172.20.0.1:52450 - "POST /node/69b91a070ec88e58bad0df03 HTTP/1.0" 202 Accepted 2026-03-19 09:08:43,523 - lava_callback - INFO - Starting async job submit for node 69b91a070ec88e58bad0df03 2026-03-19 09:08:43,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:43,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a070ec88e58bad0df03 HTTP/1.1" 200 None 2026-03-19 09:08:43,545 - lava_callback - DEBUG - Processing node 69b91a070ec88e58bad0df03: baseline-arm64-clabbe 2026-03-19 09:08:43,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91a070ec88e58bad0df03 2026-03-19 09:08:43,545 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:43,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a070ec88e58bad0df03 HTTP/1.1" 200 None 2026-03-19 09:08:43,560 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:43,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:43,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:43,596 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a070ec88e58bad0df03 HTTP/1.1" 200 None 2026-03-19 09:08:43,598 - lava_callback - ERROR - Error processing callback for node 69b91a070ec88e58bad0df03: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 09:08:44,196 - lava_callback - INFO - Received callback for node 69b91a080ec88e58bad0df06 INFO: 172.20.0.1:52458 - "POST /node/69b91a080ec88e58bad0df06 HTTP/1.0" 202 Accepted 2026-03-19 09:08:44,201 - lava_callback - INFO - Starting async job submit for node 69b91a080ec88e58bad0df06 2026-03-19 09:08:44,202 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:44,217 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a080ec88e58bad0df06 HTTP/1.1" 200 None 2026-03-19 09:08:44,218 - lava_callback - DEBUG - Processing node 69b91a080ec88e58bad0df06: baseline-arm64-clabbe 2026-03-19 09:08:44,218 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91a080ec88e58bad0df06 2026-03-19 09:08:44,219 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:44,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a080ec88e58bad0df06 HTTP/1.1" 200 None 2026-03-19 09:08:44,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:44,285 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:44,287 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:44,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a080ec88e58bad0df06 HTTP/1.1" 200 None 2026-03-19 09:08:44,312 - lava_callback - ERROR - Error processing callback for node 69b91a080ec88e58bad0df06: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 09:08:44,895 - lava_callback - INFO - Received callback for node 69b91a0a0ec88e58bad0df0c INFO: 172.20.0.1:52466 - "POST /node/69b91a0a0ec88e58bad0df0c HTTP/1.0" 202 Accepted 2026-03-19 09:08:44,901 - lava_callback - INFO - Starting async job submit for node 69b91a0a0ec88e58bad0df0c 2026-03-19 09:08:44,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:44,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a0a0ec88e58bad0df0c HTTP/1.1" 200 None 2026-03-19 09:08:44,917 - lava_callback - DEBUG - Processing node 69b91a0a0ec88e58bad0df0c: baseline-arm64-clabbe 2026-03-19 09:08:44,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91a0a0ec88e58bad0df0c 2026-03-19 09:08:44,918 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:44,932 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a0a0ec88e58bad0df0c HTTP/1.1" 200 None 2026-03-19 09:08:44,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:44,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:44,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:44,977 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a0a0ec88e58bad0df0c HTTP/1.1" 200 None 2026-03-19 09:08:44,985 - lava_callback - ERROR - Error processing callback for node 69b91a0a0ec88e58bad0df0c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 09:08:45,564 - lava_callback - INFO - Received callback for node 69b91a0b0ec88e58bad0df0f INFO: 172.20.0.1:52478 - "POST /node/69b91a0b0ec88e58bad0df0f HTTP/1.0" 202 Accepted 2026-03-19 09:08:45,569 - lava_callback - INFO - Starting async job submit for node 69b91a0b0ec88e58bad0df0f 2026-03-19 09:08:45,570 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:45,584 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a0b0ec88e58bad0df0f HTTP/1.1" 200 None 2026-03-19 09:08:45,585 - lava_callback - DEBUG - Processing node 69b91a0b0ec88e58bad0df0f: baseline-arm64-clabbe 2026-03-19 09:08:45,585 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91a0b0ec88e58bad0df0f 2026-03-19 09:08:45,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:45,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a0b0ec88e58bad0df0f HTTP/1.1" 200 None 2026-03-19 09:08:45,600 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:45,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 09:08:45,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:08:45,635 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a0b0ec88e58bad0df0f HTTP/1.1" 200 None 2026-03-19 09:08:45,642 - lava_callback - ERROR - Error processing callback for node 69b91a0b0ec88e58bad0df0f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47494 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:09:42,910 - lava_callback - INFO - Received callback for node 69bbbd0aec3f435d20d52788 INFO: 172.20.0.1:47906 - "POST /node/69bbbd0aec3f435d20d52788 HTTP/1.0" 202 Accepted 2026-03-19 09:09:42,917 - lava_callback - INFO - Starting async job submit for node 69bbbd0aec3f435d20d52788 2026-03-19 09:09:42,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:09:42,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbd0aec3f435d20d52788 HTTP/1.1" 200 None 2026-03-19 09:09:42,961 - lava_callback - DEBUG - Processing node 69bbbd0aec3f435d20d52788: baseline-arm64 2026-03-19 09:09:43,121 - lava_callback - WARNING - Failed to upload log 2026-03-19 09:09:43,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:09:43,385 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:09:43,387 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbd0aec3f435d20d52788/lava-logs.yaml 2026-03-19 09:09:43,390 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:09:43,520 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:09:43,522 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbd0aec3f435d20d52788/lava_callback.json.gz 2026-03-19 09:09:43,553 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:09:43,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbd0aec3f435d20d52788 HTTP/1.1" 200 None 2026-03-19 09:09:43,568 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:09:43,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:09:43,585 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:09:43,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbbd0aec3f435d20d52788 HTTP/1.1" 200 None 2026-03-19 09:09:43,668 - lava_callback - INFO - Completed processing callback for node 69bbbd0aec3f435d20d52788 2026-03-19 09:09:43,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:09:43,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:47918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39088 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:10:46,319 - lava_callback - INFO - Received callback for node 69b91a910ec88e58bad0e02a INFO: 172.20.0.1:35830 - "POST /node/69b91a910ec88e58bad0e02a HTTP/1.0" 202 Accepted 2026-03-19 09:10:46,324 - lava_callback - INFO - Starting async job submit for node 69b91a910ec88e58bad0e02a 2026-03-19 09:10:46,325 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:10:46,339 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a910ec88e58bad0e02a HTTP/1.1" 200 None 2026-03-19 09:10:46,340 - lava_callback - DEBUG - Processing node 69b91a910ec88e58bad0e02a: baseline-arm64-baylibre 2026-03-19 09:10:46,340 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91a910ec88e58bad0e02a 2026-03-19 09:10:46,341 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:10:46,363 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91a910ec88e58bad0e02a HTTP/1.1" 200 None 2026-03-19 09:10:46,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:10:46,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:10:46,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:10:46,402 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91a910ec88e58bad0e02a HTTP/1.1" 200 None 2026-03-19 09:10:46,403 - lava_callback - ERROR - Error processing callback for node 69b91a910ec88e58bad0e02a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40722 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58822 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:11:53,763 - lava_callback - INFO - Received callback for node 69bbbd84ec3f435d20d527b4 INFO: 172.20.0.1:58502 - "POST /node/69bbbd84ec3f435d20d527b4 HTTP/1.0" 202 Accepted 2026-03-19 09:11:53,769 - lava_callback - INFO - Starting async job submit for node 69bbbd84ec3f435d20d527b4 2026-03-19 09:11:53,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:11:53,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbd84ec3f435d20d527b4 HTTP/1.1" 200 None 2026-03-19 09:11:53,809 - lava_callback - DEBUG - Processing node 69bbbd84ec3f435d20d527b4: baseline-arm64 2026-03-19 09:11:54,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:11:54,247 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:11:54,248 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbd84ec3f435d20d527b4/log.txt.gz 2026-03-19 09:11:54,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:11:54,712 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:11:54,714 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbd84ec3f435d20d527b4/lava-logs.yaml 2026-03-19 09:11:54,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:11:54,875 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:11:54,877 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbd84ec3f435d20d527b4/lava_callback.json.gz 2026-03-19 09:11:54,899 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:11:54,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbd84ec3f435d20d527b4 HTTP/1.1" 200 None 2026-03-19 09:11:54,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:11:54,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:11:54,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:11:54,963 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbbd84ec3f435d20d527b4 HTTP/1.1" 200 None 2026-03-19 09:11:54,970 - lava_callback - INFO - Completed processing callback for node 69bbbd84ec3f435d20d527b4 INFO: 172.20.0.1:58516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40570 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:12:13,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:12:13,965 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:46012 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34986 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:13:26,551 - lava_callback - INFO - Received callback for node 69b91b2d0ec88e58bad0e062 INFO: 172.20.0.1:34996 - "POST /node/69b91b2d0ec88e58bad0e062 HTTP/1.0" 202 Accepted 2026-03-19 09:13:26,556 - lava_callback - INFO - Starting async job submit for node 69b91b2d0ec88e58bad0e062 2026-03-19 09:13:26,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:13:26,572 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91b2d0ec88e58bad0e062 HTTP/1.1" 200 None 2026-03-19 09:13:26,573 - lava_callback - DEBUG - Processing node 69b91b2d0ec88e58bad0e062: baseline-arm64-baylibre 2026-03-19 09:13:26,573 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91b2d0ec88e58bad0e062 2026-03-19 09:13:26,573 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:13:26,586 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91b2d0ec88e58bad0e062 HTTP/1.1" 200 None 2026-03-19 09:13:26,588 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:13:26,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:13:26,603 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:13:26,624 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91b2d0ec88e58bad0e062 HTTP/1.1" 200 None 2026-03-19 09:13:26,630 - lava_callback - ERROR - Error processing callback for node 69b91b2d0ec88e58bad0e062: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35010 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:13:33,149 - lava_callback - INFO - Received callback for node 69bbba10ec3f435d20d52490 INFO: 172.20.0.1:53602 - "POST /node/69bbba10ec3f435d20d52490 HTTP/1.0" 202 Accepted 2026-03-19 09:13:33,155 - lava_callback - INFO - Starting async job submit for node 69bbba10ec3f435d20d52490 2026-03-19 09:13:33,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:13:33,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba10ec3f435d20d52490 HTTP/1.1" 200 None 2026-03-19 09:13:33,229 - lava_callback - DEBUG - Processing node 69bbba10ec3f435d20d52490: ltp-smoke 2026-03-19 09:13:33,728 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:13:33,871 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:13:33,873 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbba10ec3f435d20d52490/log.txt.gz 2026-03-19 09:13:34,158 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:13:34,468 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:13:34,470 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbba10ec3f435d20d52490/lava-logs.yaml 2026-03-19 09:13:34,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:13:34,677 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:13:34,678 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbba10ec3f435d20d52490/lava_callback.json.gz 2026-03-19 09:13:34,797 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:13:34,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba10ec3f435d20d52490 HTTP/1.1" 200 None 2026-03-19 09:13:34,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:13:34,833 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb135ec3f435d20d51a9e HTTP/1.1" 200 None 2026-03-19 09:13:34,835 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:13:34,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba10ec3f435d20d52490 HTTP/1.1" 200 None 2026-03-19 09:13:34,999 - lava_callback - INFO - Completed processing callback for node 69bbba10ec3f435d20d52490 INFO: 172.20.0.1:53612 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:13:43,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:13:43,988 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:39374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52682 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:14:38,715 - lava_callback - INFO - Received callback for node 69bbbe22ec3f435d20d527d1 INFO: 172.20.0.1:52698 - "POST /node/69bbbe22ec3f435d20d527d1 HTTP/1.0" 202 Accepted 2026-03-19 09:14:38,721 - lava_callback - INFO - Starting async job submit for node 69bbbe22ec3f435d20d527d1 2026-03-19 09:14:38,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:14:38,757 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbe22ec3f435d20d527d1 HTTP/1.1" 200 None 2026-03-19 09:14:38,758 - lava_callback - DEBUG - Processing node 69bbbe22ec3f435d20d527d1: baseline-arm64 2026-03-19 09:14:39,020 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:14:39,169 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:14:39,170 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbe22ec3f435d20d527d1/log.txt.gz 2026-03-19 09:14:39,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:14:39,532 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:14:39,534 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbe22ec3f435d20d527d1/lava-logs.yaml 2026-03-19 09:14:39,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:14:39,713 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:14:39,714 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbe22ec3f435d20d527d1/lava_callback.json.gz 2026-03-19 09:14:39,737 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:14:39,751 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbe22ec3f435d20d527d1 HTTP/1.1" 200 None 2026-03-19 09:14:39,753 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:14:39,766 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:14:39,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:14:39,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbbe22ec3f435d20d527d1 HTTP/1.1" 200 None 2026-03-19 09:14:39,797 - lava_callback - INFO - Completed processing callback for node 69bbbe22ec3f435d20d527d1 2026-03-19 09:14:43,990 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:14:44,016 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60522 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:15:22,410 - lava_callback - INFO - Received callback for node 69b91ba20ec88e58bad0e086 INFO: 172.20.0.1:36894 - "POST /node/69b91ba20ec88e58bad0e086 HTTP/1.0" 202 Accepted 2026-03-19 09:15:22,416 - lava_callback - INFO - Starting async job submit for node 69b91ba20ec88e58bad0e086 2026-03-19 09:15:22,417 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:15:22,431 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91ba20ec88e58bad0e086 HTTP/1.1" 200 None 2026-03-19 09:15:22,432 - lava_callback - DEBUG - Processing node 69b91ba20ec88e58bad0e086: baseline-arm64-clabbe 2026-03-19 09:15:22,432 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91ba20ec88e58bad0e086 2026-03-19 09:15:22,433 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:15:22,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91ba20ec88e58bad0e086 HTTP/1.1" 200 None 2026-03-19 09:15:22,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:15:22,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:15:22,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:15:22,487 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91ba20ec88e58bad0e086 HTTP/1.1" 200 None 2026-03-19 09:15:22,489 - lava_callback - ERROR - Error processing callback for node 69b91ba20ec88e58bad0e086: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39576 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-19 09:16:15,196 - lava_callback - INFO - Received callback for node 69bbba0eec3f435d20d52488 INFO: 172.20.0.1:39582 - "POST /node/69bbba0eec3f435d20d52488 HTTP/1.0" 202 Accepted 2026-03-19 09:16:15,204 - lava_callback - INFO - Starting async job submit for node 69bbba0eec3f435d20d52488 2026-03-19 09:16:15,249 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:15,263 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba0eec3f435d20d52488 HTTP/1.1" 200 None 2026-03-19 09:16:15,264 - lava_callback - DEBUG - Processing node 69bbba0eec3f435d20d52488: baseline-nfs-arm64 2026-03-19 09:16:16,297 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:39584 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:16:16,565 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:16:16,567 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0eec3f435d20d52488/log.txt.gz 2026-03-19 09:16:17,262 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:16:17,534 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:16:17,536 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0eec3f435d20d52488/lava-logs.yaml 2026-03-19 09:16:17,556 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:16:17,773 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:16:17,775 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbba0eec3f435d20d52488/lava_callback.json.gz DEBUG: Setup failed for 69bbba0eec3f435d20d52488. Transitting job node result: incomplete -> fail 2026-03-19 09:16:17,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:17,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbba0eec3f435d20d52488 HTTP/1.1" 200 None 2026-03-19 09:16:17,882 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:17,905 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:16:17,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:17,929 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbba0eec3f435d20d52488 HTTP/1.1" 200 None 2026-03-19 09:16:18,036 - lava_callback - INFO - Completed processing callback for node 69bbba0eec3f435d20d52488 2026-03-19 09:16:26,288 - lava_callback - INFO - Received callback for node 69bbbe99ec3f435d20d527fd INFO: 172.20.0.1:46542 - "POST /node/69bbbe99ec3f435d20d527fd HTTP/1.0" 202 Accepted 2026-03-19 09:16:26,294 - lava_callback - INFO - Starting async job submit for node 69bbbe99ec3f435d20d527fd 2026-03-19 09:16:26,316 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:26,331 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbe99ec3f435d20d527fd HTTP/1.1" 200 None 2026-03-19 09:16:26,332 - lava_callback - DEBUG - Processing node 69bbbe99ec3f435d20d527fd: baseline-arm64 INFO: 172.20.0.1:46544 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:16:26,581 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:16:26,641 - lava_callback - INFO - Received callback for node 69b91be40ec88e58bad0e093 INFO: 172.20.0.1:46558 - "POST /node/69b91be40ec88e58bad0e093 HTTP/1.0" 202 Accepted 2026-03-19 09:16:26,647 - lava_callback - INFO - Starting async job submit for node 69b91be40ec88e58bad0e093 2026-03-19 09:16:26,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:26,668 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91be40ec88e58bad0e093 HTTP/1.1" 200 None 2026-03-19 09:16:26,669 - lava_callback - DEBUG - Processing node 69b91be40ec88e58bad0e093: baseline-arm64-baylibre 2026-03-19 09:16:26,669 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91be40ec88e58bad0e093 2026-03-19 09:16:26,670 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:26,690 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91be40ec88e58bad0e093 HTTP/1.1" 200 None 2026-03-19 09:16:26,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:26,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:16:26,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:26,742 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91be40ec88e58bad0e093 HTTP/1.1" 200 None 2026-03-19 09:16:26,743 - lava_callback - ERROR - Error processing callback for node 69b91be40ec88e58bad0e093: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 09:16:26,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:16:26,750 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbe99ec3f435d20d527fd/log.txt.gz 2026-03-19 09:16:26,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:16:27,263 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:16:27,265 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbe99ec3f435d20d527fd/lava-logs.yaml 2026-03-19 09:16:27,271 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:46568 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:16:27,428 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:16:27,430 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbe99ec3f435d20d527fd/lava_callback.json.gz 2026-03-19 09:16:27,452 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:27,466 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbe99ec3f435d20d527fd HTTP/1.1" 200 None 2026-03-19 09:16:27,468 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:27,482 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:16:27,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:27,507 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbbe99ec3f435d20d527fd HTTP/1.1" 200 None 2026-03-19 09:16:27,510 - lava_callback - INFO - Completed processing callback for node 69bbbe99ec3f435d20d527fd INFO: 172.20.0.1:55424 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:16:44,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:16:44,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49958 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39090 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:18:02,556 - lava_callback - INFO - Received callback for node 69b91c380ec88e58bad0e0a1 INFO: 172.20.0.1:46536 - "POST /node/69b91c380ec88e58bad0e0a1 HTTP/1.0" 202 Accepted 2026-03-19 09:18:02,562 - lava_callback - INFO - Starting async job submit for node 69b91c380ec88e58bad0e0a1 2026-03-19 09:18:02,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:18:02,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91c380ec88e58bad0e0a1 HTTP/1.1" 200 None 2026-03-19 09:18:02,579 - lava_callback - DEBUG - Processing node 69b91c380ec88e58bad0e0a1: baseline-arm64-clabbe 2026-03-19 09:18:02,579 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91c380ec88e58bad0e0a1 2026-03-19 09:18:02,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:18:02,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91c380ec88e58bad0e0a1 HTTP/1.1" 200 None 2026-03-19 09:18:02,604 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:18:02,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:18:02,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:18:02,646 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91c380ec88e58bad0e0a1 HTTP/1.1" 200 None 2026-03-19 09:18:02,652 - lava_callback - ERROR - Error processing callback for node 69b91c380ec88e58bad0e0a1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43108 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:19:06,926 - lava_callback - INFO - Received callback for node 69b91c7a0ec88e58bad0e0b2 INFO: 172.20.0.1:43116 - "POST /node/69b91c7a0ec88e58bad0e0b2 HTTP/1.0" 202 Accepted 2026-03-19 09:19:06,932 - lava_callback - INFO - Starting async job submit for node 69b91c7a0ec88e58bad0e0b2 2026-03-19 09:19:06,933 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:19:06,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91c7a0ec88e58bad0e0b2 HTTP/1.1" 200 None 2026-03-19 09:19:06,947 - lava_callback - DEBUG - Processing node 69b91c7a0ec88e58bad0e0b2: baseline-arm64-baylibre 2026-03-19 09:19:06,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91c7a0ec88e58bad0e0b2 2026-03-19 09:19:06,948 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:19:06,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91c7a0ec88e58bad0e0b2 HTTP/1.1" 200 None 2026-03-19 09:19:06,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:19:06,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:19:06,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:19:07,018 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91c7a0ec88e58bad0e0b2 HTTP/1.1" 200 None 2026-03-19 09:19:07,024 - lava_callback - ERROR - Error processing callback for node 69b91c7a0ec88e58bad0e0b2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 09:19:07,728 - lava_callback - INFO - Received callback for node 69bbbdd2ec3f435d20d527c1 INFO: 172.20.0.1:43122 - "POST /node/69bbbdd2ec3f435d20d527c1 HTTP/1.0" 202 Accepted 2026-03-19 09:19:07,735 - lava_callback - INFO - Starting async job submit for node 69bbbdd2ec3f435d20d527c1 2026-03-19 09:19:07,766 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:19:07,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbdd2ec3f435d20d527c1 HTTP/1.1" 200 None 2026-03-19 09:19:07,785 - lava_callback - DEBUG - Processing node 69bbbdd2ec3f435d20d527c1: baseline-arm64 2026-03-19 09:19:07,991 - lava_callback - WARNING - Failed to upload log 2026-03-19 09:19:08,098 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:19:08,311 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:19:08,314 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbdd2ec3f435d20d527c1/lava-logs.yaml 2026-03-19 09:19:08,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:19:08,471 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:19:08,473 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbbdd2ec3f435d20d527c1/lava_callback.json.gz 2026-03-19 09:19:08,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:19:08,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbdd2ec3f435d20d527c1 HTTP/1.1" 200 None 2026-03-19 09:19:08,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:19:08,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:19:08,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:19:08,558 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbbdd2ec3f435d20d527c1 HTTP/1.1" 200 None 2026-03-19 09:19:08,652 - lava_callback - INFO - Completed processing callback for node 69bbbdd2ec3f435d20d527c1 2026-03-19 09:19:14,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:19:14,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56306 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42028 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55404 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:21:26,943 - lava_callback - INFO - Received callback for node 69b91d080ec88e58bad0e0bc INFO: 172.20.0.1:55420 - "POST /node/69b91d080ec88e58bad0e0bc HTTP/1.0" 202 Accepted 2026-03-19 09:21:26,948 - lava_callback - INFO - Starting async job submit for node 69b91d080ec88e58bad0e0bc 2026-03-19 09:21:26,949 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:21:26,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91d080ec88e58bad0e0bc HTTP/1.1" 200 None 2026-03-19 09:21:26,970 - lava_callback - DEBUG - Processing node 69b91d080ec88e58bad0e0bc: baseline-arm64-baylibre 2026-03-19 09:21:26,971 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91d080ec88e58bad0e0bc 2026-03-19 09:21:26,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:21:26,984 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91d080ec88e58bad0e0bc HTTP/1.1" 200 None 2026-03-19 09:21:26,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:21:26,999 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:21:27,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:21:27,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91d080ec88e58bad0e0bc HTTP/1.1" 200 None 2026-03-19 09:21:27,029 - lava_callback - ERROR - Error processing callback for node 69b91d080ec88e58bad0e0bc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59472 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:22:42,778 - lava_callback - INFO - Received callback for node 69b91d5c0ec88e58bad0e0cf INFO: 172.20.0.1:51838 - "POST /node/69b91d5c0ec88e58bad0e0cf HTTP/1.0" 202 Accepted 2026-03-19 09:22:42,784 - lava_callback - INFO - Starting async job submit for node 69b91d5c0ec88e58bad0e0cf 2026-03-19 09:22:42,785 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:22:42,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91d5c0ec88e58bad0e0cf HTTP/1.1" 200 None 2026-03-19 09:22:42,800 - lava_callback - DEBUG - Processing node 69b91d5c0ec88e58bad0e0cf: baseline-arm64-clabbe 2026-03-19 09:22:42,800 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91d5c0ec88e58bad0e0cf 2026-03-19 09:22:42,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:22:42,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91d5c0ec88e58bad0e0cf HTTP/1.1" 200 None 2026-03-19 09:22:42,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:22:42,830 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:22:42,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:22:42,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91d5c0ec88e58bad0e0cf HTTP/1.1" 200 None 2026-03-19 09:22:42,881 - lava_callback - ERROR - Error processing callback for node 69b91d5c0ec88e58bad0e0cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53142 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:24:02,810 - lava_callback - INFO - Received callback for node 69b91daa0ec88e58bad0e0df INFO: 172.20.0.1:48242 - "POST /node/69b91daa0ec88e58bad0e0df HTTP/1.0" 202 Accepted 2026-03-19 09:24:02,816 - lava_callback - INFO - Starting async job submit for node 69b91daa0ec88e58bad0e0df 2026-03-19 09:24:02,817 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:24:02,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91daa0ec88e58bad0e0df HTTP/1.1" 200 None 2026-03-19 09:24:02,832 - lava_callback - DEBUG - Processing node 69b91daa0ec88e58bad0e0df: baseline-arm64-clabbe 2026-03-19 09:24:02,833 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91daa0ec88e58bad0e0df 2026-03-19 09:24:02,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:24:02,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91daa0ec88e58bad0e0df HTTP/1.1" 200 None 2026-03-19 09:24:02,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:24:02,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:24:02,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:24:02,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91daa0ec88e58bad0e0df HTTP/1.1" 200 None 2026-03-19 09:24:02,892 - lava_callback - ERROR - Error processing callback for node 69b91daa0ec88e58bad0e0df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47410 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38944 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:25:07,246 - lava_callback - INFO - Received callback for node 69b91dee0ec88e58bad0e0e6 INFO: 172.20.0.1:38950 - "POST /node/69b91dee0ec88e58bad0e0e6 HTTP/1.0" 202 Accepted 2026-03-19 09:25:07,252 - lava_callback - INFO - Starting async job submit for node 69b91dee0ec88e58bad0e0e6 2026-03-19 09:25:07,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:25:07,270 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91dee0ec88e58bad0e0e6 HTTP/1.1" 200 None 2026-03-19 09:25:07,271 - lava_callback - DEBUG - Processing node 69b91dee0ec88e58bad0e0e6: baseline-arm64-baylibre 2026-03-19 09:25:07,271 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91dee0ec88e58bad0e0e6 2026-03-19 09:25:07,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:25:07,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91dee0ec88e58bad0e0e6 HTTP/1.1" 200 None 2026-03-19 09:25:07,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:25:07,301 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:25:07,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:25:07,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91dee0ec88e58bad0e0e6 HTTP/1.1" 200 None 2026-03-19 09:25:07,332 - lava_callback - ERROR - Error processing callback for node 69b91dee0ec88e58bad0e0e6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35296 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:26:42,900 - lava_callback - INFO - Received callback for node 69b91e3f0ec88e58bad0e0f0 INFO: 172.20.0.1:35506 - "POST /node/69b91e3f0ec88e58bad0e0f0 HTTP/1.0" 202 Accepted 2026-03-19 09:26:42,906 - lava_callback - INFO - Starting async job submit for node 69b91e3f0ec88e58bad0e0f0 2026-03-19 09:26:42,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:26:42,923 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91e3f0ec88e58bad0e0f0 HTTP/1.1" 200 None 2026-03-19 09:26:42,924 - lava_callback - DEBUG - Processing node 69b91e3f0ec88e58bad0e0f0: baseline-arm64-clabbe 2026-03-19 09:26:42,924 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91e3f0ec88e58bad0e0f0 2026-03-19 09:26:42,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:26:42,939 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91e3f0ec88e58bad0e0f0 HTTP/1.1" 200 None 2026-03-19 09:26:42,941 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:26:42,954 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:26:42,956 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:26:42,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91e3f0ec88e58bad0e0f0 HTTP/1.1" 200 None 2026-03-19 09:26:42,981 - lava_callback - ERROR - Error processing callback for node 69b91e3f0ec88e58bad0e0f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60078 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41728 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:27:47,337 - lava_callback - INFO - Received callback for node 69b91e840ec88e58bad0e0f6 INFO: 172.20.0.1:41730 - "POST /node/69b91e840ec88e58bad0e0f6 HTTP/1.0" 202 Accepted 2026-03-19 09:27:47,342 - lava_callback - INFO - Starting async job submit for node 69b91e840ec88e58bad0e0f6 2026-03-19 09:27:47,343 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:27:47,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91e840ec88e58bad0e0f6 HTTP/1.1" 200 None 2026-03-19 09:27:47,358 - lava_callback - DEBUG - Processing node 69b91e840ec88e58bad0e0f6: baseline-arm64-baylibre 2026-03-19 09:27:47,359 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91e840ec88e58bad0e0f6 2026-03-19 09:27:47,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:27:47,374 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91e840ec88e58bad0e0f6 HTTP/1.1" 200 None 2026-03-19 09:27:47,376 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:27:47,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:27:47,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:27:47,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91e840ec88e58bad0e0f6 HTTP/1.1" 200 None 2026-03-19 09:27:47,437 - lava_callback - ERROR - Error processing callback for node 69b91e840ec88e58bad0e0f6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56364 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49274 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36022 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36032 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:30:23,027 - lava_callback - INFO - Received callback for node 69b91f1e0ec88e58bad0e11d INFO: 172.20.0.1:56488 - "POST /node/69b91f1e0ec88e58bad0e11d HTTP/1.0" 202 Accepted 2026-03-19 09:30:23,032 - lava_callback - INFO - Starting async job submit for node 69b91f1e0ec88e58bad0e11d 2026-03-19 09:30:23,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:30:23,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91f1e0ec88e58bad0e11d HTTP/1.1" 200 None 2026-03-19 09:30:23,050 - lava_callback - DEBUG - Processing node 69b91f1e0ec88e58bad0e11d: baseline-arm64-clabbe 2026-03-19 09:30:23,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91f1e0ec88e58bad0e11d 2026-03-19 09:30:23,051 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:30:23,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91f1e0ec88e58bad0e11d HTTP/1.1" 200 None 2026-03-19 09:30:23,069 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:30:23,091 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 09:30:23,092 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:30:23,114 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91f1e0ec88e58bad0e11d HTTP/1.1" 200 None 2026-03-19 09:30:23,115 - lava_callback - ERROR - Error processing callback for node 69b91f1e0ec88e58bad0e11d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49160 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:31:01,543 - lava_callback - INFO - Received callback for node 69bbc064ec3f435d20d5287d INFO: 172.20.0.1:39456 - "POST /node/69bbc064ec3f435d20d5287d HTTP/1.0" 202 Accepted 2026-03-19 09:31:01,551 - lava_callback - INFO - Starting async job submit for node 69bbc064ec3f435d20d5287d 2026-03-19 09:31:01,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:01,605 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc064ec3f435d20d5287d HTTP/1.1" 200 None 2026-03-19 09:31:01,605 - lava_callback - DEBUG - Processing node 69bbc064ec3f435d20d5287d: baseline-arm64 2026-03-19 09:31:01,995 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:31:02,155 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:31:02,157 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbc064ec3f435d20d5287d/log.txt.gz 2026-03-19 09:31:02,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:31:02,619 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:31:02,622 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbc064ec3f435d20d5287d/lava-logs.yaml 2026-03-19 09:31:02,630 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:31:02,834 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:31:02,836 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbc064ec3f435d20d5287d/lava_callback.json.gz DEBUG: Setup failed for 69bbc064ec3f435d20d5287d. Transitting job node result: incomplete -> fail 2026-03-19 09:31:02,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:02,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc064ec3f435d20d5287d HTTP/1.1" 200 None 2026-03-19 09:31:02,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:02,943 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:31:02,945 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:02,968 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbc064ec3f435d20d5287d HTTP/1.1" 200 None 2026-03-19 09:31:03,058 - lava_callback - INFO - Completed processing callback for node 69bbc064ec3f435d20d5287d INFO: 172.20.0.1:39464 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:31:14,057 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:14,073 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44902 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49610 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:31:27,434 - lava_callback - INFO - Received callback for node 69b91f650ec88e58bad0e126 INFO: 172.20.0.1:49626 - "POST /node/69b91f650ec88e58bad0e126 HTTP/1.0" 202 Accepted 2026-03-19 09:31:27,441 - lava_callback - INFO - Starting async job submit for node 69b91f650ec88e58bad0e126 2026-03-19 09:31:27,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:27,469 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91f650ec88e58bad0e126 HTTP/1.1" 200 None 2026-03-19 09:31:27,470 - lava_callback - DEBUG - Processing node 69b91f650ec88e58bad0e126: baseline-arm64-baylibre 2026-03-19 09:31:27,471 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91f650ec88e58bad0e126 2026-03-19 09:31:27,471 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:27,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91f650ec88e58bad0e126 HTTP/1.1" 200 None 2026-03-19 09:31:27,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:27,499 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:31:27,501 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:27,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91f650ec88e58bad0e126 HTTP/1.1" 200 None 2026-03-19 09:31:27,522 - lava_callback - ERROR - Error processing callback for node 69b91f650ec88e58bad0e126: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39852 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:31:37,060 - lava_callback - INFO - Received callback for node 69bbc261ec3f435d20d528d7 INFO: 172.20.0.1:39854 - "POST /node/69bbc261ec3f435d20d528d7 HTTP/1.0" 202 Accepted 2026-03-19 09:31:37,066 - lava_callback - INFO - Starting async job submit for node 69bbc261ec3f435d20d528d7 2026-03-19 09:31:37,068 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:37,083 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc261ec3f435d20d528d7 HTTP/1.1" 200 None 2026-03-19 09:31:37,084 - lava_callback - DEBUG - Processing node 69bbc261ec3f435d20d528d7: baseline-nfs-arm64 2026-03-19 09:31:37,085 - lava_callback - WARNING - Failed to upload log 2026-03-19 09:31:37,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:31:37,226 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:31:37,228 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbc261ec3f435d20d528d7/lava-logs.yaml 2026-03-19 09:31:37,229 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:31:37,341 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:31:37,343 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbc261ec3f435d20d528d7/lava_callback.json.gz 2026-03-19 09:31:37,345 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:37,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc261ec3f435d20d528d7 HTTP/1.1" 200 None 2026-03-19 09:31:37,365 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:37,379 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:31:37,380 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:37,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbc261ec3f435d20d528d7 HTTP/1.1" 200 None 2026-03-19 09:31:37,432 - lava_callback - INFO - Completed processing callback for node 69bbc261ec3f435d20d528d7 2026-03-19 09:31:44,076 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:31:44,115 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49026 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42638 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:33:03,243 - lava_callback - INFO - Received callback for node 69b91fbb0ec88e58bad0e130 INFO: 172.20.0.1:36776 - "POST /node/69b91fbb0ec88e58bad0e130 HTTP/1.0" 202 Accepted 2026-03-19 09:33:03,249 - lava_callback - INFO - Starting async job submit for node 69b91fbb0ec88e58bad0e130 2026-03-19 09:33:03,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:33:03,264 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91fbb0ec88e58bad0e130 HTTP/1.1" 200 None 2026-03-19 09:33:03,265 - lava_callback - DEBUG - Processing node 69b91fbb0ec88e58bad0e130: baseline-arm64-clabbe 2026-03-19 09:33:03,265 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b91fbb0ec88e58bad0e130 2026-03-19 09:33:03,265 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:33:03,278 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b91fbb0ec88e58bad0e130 HTTP/1.1" 200 None 2026-03-19 09:33:03,280 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:33:03,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:33:03,295 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:33:03,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b91fbb0ec88e58bad0e130 HTTP/1.1" 200 None 2026-03-19 09:33:03,316 - lava_callback - ERROR - Error processing callback for node 69b91fbb0ec88e58bad0e130: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49934 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42806 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50750 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60008 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:36:57,023 - lava_callback - INFO - Received callback for node 69bbbf9eec3f435d20d52854 INFO: 172.20.0.1:60022 - "POST /node/69bbbf9eec3f435d20d52854 HTTP/1.0" 202 Accepted 2026-03-19 09:36:57,029 - lava_callback - INFO - Starting async job submit for node 69bbbf9eec3f435d20d52854 2026-03-19 09:36:57,083 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:36:57,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbf9eec3f435d20d52854 HTTP/1.1" 200 None 2026-03-19 09:36:57,109 - lava_callback - DEBUG - Processing node 69bbbf9eec3f435d20d52854: baseline-arm 2026-03-19 09:36:57,720 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:36:57,881 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:36:57,883 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bbbf9eec3f435d20d52854/log.txt.gz 2026-03-19 09:36:58,244 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:36:58,491 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:36:58,493 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbbf9eec3f435d20d52854/lava-logs.yaml 2026-03-19 09:36:58,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:36:58,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:36:58,685 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbbf9eec3f435d20d52854/lava_callback.json.gz DEBUG: Setup failed for 69bbbf9eec3f435d20d52854. Transitting job node result: incomplete -> fail 2026-03-19 09:36:58,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:36:58,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbbf9eec3f435d20d52854 HTTP/1.1" 200 None 2026-03-19 09:36:58,813 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:36:58,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 09:36:58,831 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:36:58,855 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbbf9eec3f435d20d52854 HTTP/1.1" 200 None 2026-03-19 09:36:58,977 - lava_callback - INFO - Completed processing callback for node 69bbbf9eec3f435d20d52854 INFO: 172.20.0.1:40934 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:37:14,118 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:37:14,133 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55564 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52004 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:39:53,488 - lava_callback - INFO - Received callback for node 69bbc1c2ec3f435d20d528ba INFO: 172.20.0.1:34038 - "POST /node/69bbc1c2ec3f435d20d528ba HTTP/1.0" 202 Accepted 2026-03-19 09:39:53,495 - lava_callback - INFO - Starting async job submit for node 69bbc1c2ec3f435d20d528ba 2026-03-19 09:39:53,520 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:39:53,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc1c2ec3f435d20d528ba HTTP/1.1" 200 None 2026-03-19 09:39:53,536 - lava_callback - DEBUG - Processing node 69bbc1c2ec3f435d20d528ba: baseline-nfs-arm64 2026-03-19 09:39:54,066 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:39:54,234 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:39:54,236 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbc1c2ec3f435d20d528ba/log.txt.gz 2026-03-19 09:39:54,495 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:39:54,694 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:39:54,697 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbc1c2ec3f435d20d528ba/lava-logs.yaml 2026-03-19 09:39:54,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:39:54,868 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:39:54,870 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbc1c2ec3f435d20d528ba/lava_callback.json.gz 2026-03-19 09:39:54,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:39:54,910 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc1c2ec3f435d20d528ba HTTP/1.1" 200 None 2026-03-19 09:39:54,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:39:54,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:39:54,926 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:39:54,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbc1c2ec3f435d20d528ba HTTP/1.1" 200 None 2026-03-19 09:39:55,011 - lava_callback - INFO - Completed processing callback for node 69bbc1c2ec3f435d20d528ba INFO: 172.20.0.1:34044 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:40:05,504 - lava_callback - INFO - Received callback for node 69bbc20eec3f435d20d528c5 INFO: 172.20.0.1:33716 - "POST /node/69bbc20eec3f435d20d528c5 HTTP/1.0" 202 Accepted 2026-03-19 09:40:05,510 - lava_callback - INFO - Starting async job submit for node 69bbc20eec3f435d20d528c5 2026-03-19 09:40:05,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:40:05,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc20eec3f435d20d528c5 HTTP/1.1" 200 None 2026-03-19 09:40:05,550 - lava_callback - DEBUG - Processing node 69bbc20eec3f435d20d528c5: baseline-arm64 2026-03-19 09:40:06,071 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:40:06,215 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:40:06,217 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbc20eec3f435d20d528c5/log.txt.gz 2026-03-19 09:40:06,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:33720 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:40:06,684 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:40:06,686 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbc20eec3f435d20d528c5/lava-logs.yaml 2026-03-19 09:40:06,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:40:06,859 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:40:06,860 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbc20eec3f435d20d528c5/lava_callback.json.gz 2026-03-19 09:40:06,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:40:06,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc20eec3f435d20d528c5 HTTP/1.1" 200 None 2026-03-19 09:40:06,901 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:40:06,915 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:40:06,916 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:40:06,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbc20eec3f435d20d528c5 HTTP/1.1" 200 None 2026-03-19 09:40:06,993 - lava_callback - INFO - Completed processing callback for node 69bbc20eec3f435d20d528c5 2026-03-19 09:40:14,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:40:14,151 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:49234 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57862 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:41:43,616 - lava_callback - INFO - Received callback for node 69b921c50ec88e58bad0e182 INFO: 172.20.0.1:41592 - "POST /node/69b921c50ec88e58bad0e182 HTTP/1.0" 202 Accepted 2026-03-19 09:41:43,621 - lava_callback - INFO - Starting async job submit for node 69b921c50ec88e58bad0e182 2026-03-19 09:41:43,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:41:43,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b921c50ec88e58bad0e182 HTTP/1.1" 200 None 2026-03-19 09:41:43,637 - lava_callback - DEBUG - Processing node 69b921c50ec88e58bad0e182: baseline-arm64-clabbe 2026-03-19 09:41:43,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b921c50ec88e58bad0e182 2026-03-19 09:41:43,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:41:43,652 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b921c50ec88e58bad0e182 HTTP/1.1" 200 None 2026-03-19 09:41:43,653 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:41:43,666 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:41:43,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:41:43,700 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b921c50ec88e58bad0e182 HTTP/1.1" 200 None 2026-03-19 09:41:43,701 - lava_callback - ERROR - Error processing callback for node 69b921c50ec88e58bad0e182: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42624 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:44:03,679 - lava_callback - INFO - Received callback for node 69b9225a0ec88e58bad0e193 INFO: 172.20.0.1:40418 - "POST /node/69b9225a0ec88e58bad0e193 HTTP/1.0" 202 Accepted 2026-03-19 09:44:03,684 - lava_callback - INFO - Starting async job submit for node 69b9225a0ec88e58bad0e193 2026-03-19 09:44:03,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:44:03,707 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9225a0ec88e58bad0e193 HTTP/1.1" 200 None 2026-03-19 09:44:03,708 - lava_callback - DEBUG - Processing node 69b9225a0ec88e58bad0e193: baseline-arm64-clabbe 2026-03-19 09:44:03,709 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9225a0ec88e58bad0e193 2026-03-19 09:44:03,709 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:44:03,723 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9225a0ec88e58bad0e193 HTTP/1.1" 200 None 2026-03-19 09:44:03,725 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:44:03,739 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:44:03,741 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:44:03,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9225a0ec88e58bad0e193 HTTP/1.1" 200 None 2026-03-19 09:44:03,764 - lava_callback - ERROR - Error processing callback for node 69b9225a0ec88e58bad0e193: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51402 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:45:23,789 - lava_callback - INFO - Received callback for node 69b922a60ec88e58bad0e199 INFO: 172.20.0.1:54134 - "POST /node/69b922a60ec88e58bad0e199 HTTP/1.0" 202 Accepted 2026-03-19 09:45:23,795 - lava_callback - INFO - Starting async job submit for node 69b922a60ec88e58bad0e199 2026-03-19 09:45:23,796 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:45:23,810 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b922a60ec88e58bad0e199 HTTP/1.1" 200 None 2026-03-19 09:45:23,810 - lava_callback - DEBUG - Processing node 69b922a60ec88e58bad0e199: baseline-arm64-clabbe 2026-03-19 09:45:23,811 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b922a60ec88e58bad0e199 2026-03-19 09:45:23,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:45:23,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b922a60ec88e58bad0e199 HTTP/1.1" 200 None 2026-03-19 09:45:23,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:45:23,864 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:45:23,866 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:45:23,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b922a60ec88e58bad0e199 HTTP/1.1" 200 None 2026-03-19 09:45:23,914 - lava_callback - ERROR - Error processing callback for node 69b922a60ec88e58bad0e199: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35012 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:46:06,610 - lava_callback - INFO - Received callback for node 69bbc153ec3f435d20d528a7 INFO: 172.20.0.1:35018 - "POST /node/69bbc153ec3f435d20d528a7 HTTP/1.0" 202 Accepted 2026-03-19 09:46:06,657 - lava_callback - INFO - Starting async job submit for node 69bbc153ec3f435d20d528a7 2026-03-19 09:46:06,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:46:06,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc153ec3f435d20d528a7 HTTP/1.1" 200 None 2026-03-19 09:46:06,697 - lava_callback - DEBUG - Processing node 69bbc153ec3f435d20d528a7: baseline-arm-pengutronix 2026-03-19 09:46:06,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:46:06,958 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:46:06,961 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbc153ec3f435d20d528a7/log.txt.gz 2026-03-19 09:46:07,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:46:07,227 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:46:07,229 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbc153ec3f435d20d528a7/lava-logs.yaml 2026-03-19 09:46:07,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:46:07,390 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:46:07,392 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbc153ec3f435d20d528a7/lava_callback.json.gz DEBUG: Setup failed for 69bbc153ec3f435d20d528a7. Transitting job node result: incomplete -> fail 2026-03-19 09:46:07,458 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:46:07,473 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc153ec3f435d20d528a7 HTTP/1.1" 200 None 2026-03-19 09:46:07,475 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:46:07,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 09:46:07,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:46:07,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbc153ec3f435d20d528a7 HTTP/1.1" 200 None 2026-03-19 09:46:07,582 - lava_callback - INFO - Completed processing callback for node 69bbc153ec3f435d20d528a7 2026-03-19 09:46:14,154 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:46:14,177 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45624 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:46:43,824 - lava_callback - INFO - Received callback for node 69b922f70ec88e58bad0e1b8 INFO: 172.20.0.1:36350 - "POST /node/69b922f70ec88e58bad0e1b8 HTTP/1.0" 202 Accepted 2026-03-19 09:46:43,832 - lava_callback - INFO - Starting async job submit for node 69b922f70ec88e58bad0e1b8 2026-03-19 09:46:43,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:46:43,850 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b922f70ec88e58bad0e1b8 HTTP/1.1" 200 None 2026-03-19 09:46:43,851 - lava_callback - DEBUG - Processing node 69b922f70ec88e58bad0e1b8: baseline-arm64-clabbe 2026-03-19 09:46:43,851 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b922f70ec88e58bad0e1b8 2026-03-19 09:46:43,852 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:46:43,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b922f70ec88e58bad0e1b8 HTTP/1.1" 200 None 2026-03-19 09:46:43,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:46:43,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:46:43,905 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:46:43,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b922f70ec88e58bad0e1b8 HTTP/1.1" 200 None 2026-03-19 09:46:43,927 - lava_callback - ERROR - Error processing callback for node 69b922f70ec88e58bad0e1b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34206 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34096 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:48:03,900 - lava_callback - INFO - Received callback for node 69b923430ec88e58bad0e1c0 INFO: 172.20.0.1:59438 - "POST /node/69b923430ec88e58bad0e1c0 HTTP/1.0" 202 Accepted 2026-03-19 09:48:03,906 - lava_callback - INFO - Starting async job submit for node 69b923430ec88e58bad0e1c0 2026-03-19 09:48:03,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:48:03,921 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b923430ec88e58bad0e1c0 HTTP/1.1" 200 None 2026-03-19 09:48:03,922 - lava_callback - DEBUG - Processing node 69b923430ec88e58bad0e1c0: baseline-arm64-clabbe 2026-03-19 09:48:03,922 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b923430ec88e58bad0e1c0 2026-03-19 09:48:03,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:48:03,936 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b923430ec88e58bad0e1c0 HTTP/1.1" 200 None 2026-03-19 09:48:03,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:48:03,950 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b7e980113612b7716b9e01 HTTP/1.1" 200 None 2026-03-19 09:48:03,952 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:48:03,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b923430ec88e58bad0e1c0 HTTP/1.1" 200 None 2026-03-19 09:48:03,973 - lava_callback - ERROR - Error processing callback for node 69b923430ec88e58bad0e1c0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37334 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48878 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36034 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:51:05,225 - lava_callback - INFO - Received callback for node 69bbc6b6ec3f435d20d5297d INFO: 172.20.0.1:51886 - "POST /node/69bbc6b6ec3f435d20d5297d HTTP/1.0" 202 Accepted 2026-03-19 09:51:05,232 - lava_callback - INFO - Starting async job submit for node 69bbc6b6ec3f435d20d5297d 2026-03-19 09:51:05,261 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:51:05,279 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc6b6ec3f435d20d5297d HTTP/1.1" 200 None 2026-03-19 09:51:05,279 - lava_callback - DEBUG - Processing node 69bbc6b6ec3f435d20d5297d: baseline-arm64 2026-03-19 09:51:05,415 - lava_callback - WARNING - Failed to upload log 2026-03-19 09:51:05,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:51:05,700 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:51:05,702 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbc6b6ec3f435d20d5297d/lava-logs.yaml 2026-03-19 09:51:05,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:51:05,858 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:51:05,860 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbc6b6ec3f435d20d5297d/lava_callback.json.gz 2026-03-19 09:51:05,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:51:05,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc6b6ec3f435d20d5297d HTTP/1.1" 200 None 2026-03-19 09:51:05,907 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:51:05,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:51:05,932 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:51:05,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbc6b6ec3f435d20d5297d HTTP/1.1" 200 None 2026-03-19 09:51:06,051 - lava_callback - INFO - Completed processing callback for node 69bbc6b6ec3f435d20d5297d INFO: 172.20.0.1:51898 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:51:14,180 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:51:14,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:33802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49728 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49066 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53654 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46618 - "GET / HTTP/1.0" 200 OK 2026-03-19 09:58:38,080 - lava_callback - INFO - Received callback for node 69bbc894ec3f435d20d529b7 INFO: 172.20.0.1:46626 - "POST /node/69bbc894ec3f435d20d529b7 HTTP/1.0" 202 Accepted 2026-03-19 09:58:38,086 - lava_callback - INFO - Starting async job submit for node 69bbc894ec3f435d20d529b7 2026-03-19 09:58:38,116 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:58:38,130 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc894ec3f435d20d529b7 HTTP/1.1" 200 None 2026-03-19 09:58:38,131 - lava_callback - DEBUG - Processing node 69bbc894ec3f435d20d529b7: baseline-arm64 2026-03-19 09:58:38,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:58:38,446 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:58:38,448 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbc894ec3f435d20d529b7/log.txt.gz 2026-03-19 09:58:38,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:58:38,728 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:58:38,730 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbc894ec3f435d20d529b7/lava-logs.yaml 2026-03-19 09:58:38,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 09:58:38,848 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 09:58:38,850 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbc894ec3f435d20d529b7/lava_callback.json.gz 2026-03-19 09:58:38,881 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:58:38,908 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc894ec3f435d20d529b7 HTTP/1.1" 200 None 2026-03-19 09:58:38,910 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:58:38,924 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 09:58:38,925 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:58:38,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbc894ec3f435d20d529b7 HTTP/1.1" 200 None 2026-03-19 09:58:39,004 - lava_callback - INFO - Completed processing callback for node 69bbc894ec3f435d20d529b7 2026-03-19 09:58:44,205 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 09:58:44,228 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45802 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43044 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49526 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59750 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33324 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53014 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49092 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55862 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50016 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:10:04,781 - lava_callback - INFO - Received callback for node 69bbcb69ec3f435d20d52a14 INFO: 172.20.0.1:47806 - "POST /node/69bbcb69ec3f435d20d52a14 HTTP/1.0" 202 Accepted 2026-03-19 10:10:04,787 - lava_callback - INFO - Starting async job submit for node 69bbcb69ec3f435d20d52a14 2026-03-19 10:10:04,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:10:04,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcb69ec3f435d20d52a14 HTTP/1.1" 200 None 2026-03-19 10:10:04,806 - lava_callback - DEBUG - Processing node 69bbcb69ec3f435d20d52a14: baseline-nfs-arm64 2026-03-19 10:10:04,807 - lava_callback - WARNING - Failed to upload log 2026-03-19 10:10:04,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:10:04,961 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:10:04,963 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbcb69ec3f435d20d52a14/lava-logs.yaml 2026-03-19 10:10:04,964 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:10:05,153 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:10:05,155 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbcb69ec3f435d20d52a14/lava_callback.json.gz 2026-03-19 10:10:05,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:10:05,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcb69ec3f435d20d52a14 HTTP/1.1" 200 None 2026-03-19 10:10:05,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:10:05,186 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:10:05,188 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:10:05,210 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcb69ec3f435d20d52a14 HTTP/1.1" 200 None 2026-03-19 10:10:05,213 - lava_callback - INFO - Completed processing callback for node 69bbcb69ec3f435d20d52a14 INFO: 172.20.0.1:47810 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:10:14,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:10:14,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:48988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46024 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-19 10:11:15,641 - lava_callback - INFO - Received callback for node 69bbc7a2ec3f435d20d52997 INFO: 172.20.0.1:46036 - "POST /node/69bbc7a2ec3f435d20d52997 HTTP/1.0" 202 Accepted 2026-03-19 10:11:15,649 - lava_callback - INFO - Starting async job submit for node 69bbc7a2ec3f435d20d52997 2026-03-19 10:11:15,712 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:11:15,727 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc7a2ec3f435d20d52997 HTTP/1.1" 200 None 2026-03-19 10:11:15,727 - lava_callback - DEBUG - Processing node 69bbc7a2ec3f435d20d52997: ltp-smoke 2026-03-19 10:11:16,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:11:16,368 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:11:16,370 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbc7a2ec3f435d20d52997/log.txt.gz INFO: 172.20.0.1:46038 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:11:16,654 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:11:16,892 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:11:16,895 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbc7a2ec3f435d20d52997/lava-logs.yaml 2026-03-19 10:11:16,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:11:17,072 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:11:17,074 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbc7a2ec3f435d20d52997/lava_callback.json.gz 2026-03-19 10:11:17,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:11:17,207 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc7a2ec3f435d20d52997 HTTP/1.1" 200 None 2026-03-19 10:11:17,208 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:11:17,222 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb135ec3f435d20d51a9e HTTP/1.1" 200 None 2026-03-19 10:11:17,223 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:11:17,248 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbc7a2ec3f435d20d52997 HTTP/1.1" 200 None 2026-03-19 10:11:17,365 - lava_callback - INFO - Completed processing callback for node 69bbc7a2ec3f435d20d52997 INFO: 172.20.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59996 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:11:44,250 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:11:44,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:53332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57472 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37306 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:14:54,465 - lava_callback - INFO - Received callback for node 69bbc7faec3f435d20d529a3 INFO: 172.20.0.1:34386 - "POST /node/69bbc7faec3f435d20d529a3 HTTP/1.0" 202 Accepted 2026-03-19 10:14:54,473 - lava_callback - INFO - Starting async job submit for node 69bbc7faec3f435d20d529a3 2026-03-19 10:14:54,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:14:54,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc7faec3f435d20d529a3 HTTP/1.1" 200 None 2026-03-19 10:14:54,533 - lava_callback - DEBUG - Processing node 69bbc7faec3f435d20d529a3: baseline-nfs-arm64 2026-03-19 10:14:55,587 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:14:55,776 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:14:55,778 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbc7faec3f435d20d529a3/log.txt.gz 2026-03-19 10:14:56,381 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:34396 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:14:56,627 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:14:56,629 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbc7faec3f435d20d529a3/lava-logs.yaml 2026-03-19 10:14:56,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:14:56,856 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:14:56,858 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbc7faec3f435d20d529a3/lava_callback.json.gz DEBUG: Setup failed for 69bbc7faec3f435d20d529a3. Transitting job node result: incomplete -> fail 2026-03-19 10:14:56,954 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:14:56,992 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbc7faec3f435d20d529a3 HTTP/1.1" 200 None 2026-03-19 10:14:56,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:14:57,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:14:57,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:14:57,038 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbc7faec3f435d20d529a3 HTTP/1.1" 200 None 2026-03-19 10:14:57,124 - lava_callback - INFO - Completed processing callback for node 69bbc7faec3f435d20d529a3 INFO: 172.20.0.1:58288 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:15:14,270 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:15:14,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:59216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55462 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:15:47,614 - lava_callback - INFO - Received callback for node 69bbcb18ec3f435d20d52a08 INFO: 172.20.0.1:55474 - "POST /node/69bbcb18ec3f435d20d52a08 HTTP/1.0" 202 Accepted 2026-03-19 10:15:47,621 - lava_callback - INFO - Starting async job submit for node 69bbcb18ec3f435d20d52a08 2026-03-19 10:15:47,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:15:47,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcb18ec3f435d20d52a08 HTTP/1.1" 200 None 2026-03-19 10:15:47,679 - lava_callback - DEBUG - Processing node 69bbcb18ec3f435d20d52a08: baseline-arm64 2026-03-19 10:15:48,090 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:15:48,233 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:15:48,235 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcb18ec3f435d20d52a08/log.txt.gz 2026-03-19 10:15:48,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:15:48,680 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:15:48,682 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcb18ec3f435d20d52a08/lava-logs.yaml 2026-03-19 10:15:48,691 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:15:48,853 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:15:48,855 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcb18ec3f435d20d52a08/lava_callback.json.gz DEBUG: Setup failed for 69bbcb18ec3f435d20d52a08. Transitting job node result: incomplete -> fail 2026-03-19 10:15:48,931 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:15:48,955 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcb18ec3f435d20d52a08 HTTP/1.1" 200 None 2026-03-19 10:15:48,957 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:15:48,971 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:15:48,972 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:15:48,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcb18ec3f435d20d52a08 HTTP/1.1" 200 None 2026-03-19 10:15:49,078 - lava_callback - INFO - Completed processing callback for node 69bbcb18ec3f435d20d52a08 2026-03-19 10:15:54,817 - lava_callback - INFO - Received callback for node 69bbcc9aec3f435d20d52a53 INFO: 172.20.0.1:59464 - "POST /node/69bbcc9aec3f435d20d52a53 HTTP/1.0" 202 Accepted 2026-03-19 10:15:54,824 - lava_callback - INFO - Starting async job submit for node 69bbcc9aec3f435d20d52a53 2026-03-19 10:15:54,853 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:15:54,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcc9aec3f435d20d52a53 HTTP/1.1" 200 None 2026-03-19 10:15:54,871 - lava_callback - DEBUG - Processing node 69bbcc9aec3f435d20d52a53: baseline-arm64 2026-03-19 10:15:55,004 - lava_callback - WARNING - Failed to upload log 2026-03-19 10:15:55,075 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:15:55,249 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:15:55,250 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcc9aec3f435d20d52a53/lava-logs.yaml 2026-03-19 10:15:55,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:15:55,379 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:15:55,380 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcc9aec3f435d20d52a53/lava_callback.json.gz 2026-03-19 10:15:55,410 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:15:55,445 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcc9aec3f435d20d52a53 HTTP/1.1" 200 None 2026-03-19 10:15:55,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:15:55,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:15:55,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:15:55,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcc9aec3f435d20d52a53 HTTP/1.1" 200 None 2026-03-19 10:15:55,549 - lava_callback - INFO - Completed processing callback for node 69bbcc9aec3f435d20d52a53 INFO: 172.20.0.1:59470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58186 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:16:14,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:16:14,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43542 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49086 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:17:14,969 - lava_callback - INFO - Received callback for node 69bbcceaec3f435d20d52a65 INFO: 172.20.0.1:57096 - "POST /node/69bbcceaec3f435d20d52a65 HTTP/1.0" 202 Accepted 2026-03-19 10:17:14,976 - lava_callback - INFO - Starting async job submit for node 69bbcceaec3f435d20d52a65 2026-03-19 10:17:15,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:17:15,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcceaec3f435d20d52a65 HTTP/1.1" 200 None 2026-03-19 10:17:15,021 - lava_callback - DEBUG - Processing node 69bbcceaec3f435d20d52a65: baseline-arm64 2026-03-19 10:17:15,155 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:57104 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-19 10:17:15,323 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:17:15,325 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcceaec3f435d20d52a65/log.txt.gz 2026-03-19 10:17:15,397 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:17:15,585 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:17:15,587 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcceaec3f435d20d52a65/lava-logs.yaml 2026-03-19 10:17:15,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:17:15,737 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:17:15,739 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcceaec3f435d20d52a65/lava_callback.json.gz 2026-03-19 10:17:15,769 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:17:15,784 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcceaec3f435d20d52a65 HTTP/1.1" 200 None 2026-03-19 10:17:15,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:17:15,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:17:15,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:17:15,822 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcceaec3f435d20d52a65 HTTP/1.1" 200 None 2026-03-19 10:17:15,917 - lava_callback - INFO - Completed processing callback for node 69bbcceaec3f435d20d52a65 INFO: 172.20.0.1:57112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50896 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:17:44,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:17:44,323 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:43926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39196 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:18:30,252 - lava_callback - INFO - Received callback for node 69b92a6e0ec88e58bad0e339 INFO: 172.20.0.1:33290 - "POST /node/69b92a6e0ec88e58bad0e339 HTTP/1.0" 202 Accepted 2026-03-19 10:18:30,258 - lava_callback - INFO - Starting async job submit for node 69b92a6e0ec88e58bad0e339 2026-03-19 10:18:30,259 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:18:30,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92a6e0ec88e58bad0e339 HTTP/1.1" 200 None 2026-03-19 10:18:30,275 - lava_callback - DEBUG - Processing node 69b92a6e0ec88e58bad0e339: baseline-arm64-baylibre 2026-03-19 10:18:30,275 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92a6e0ec88e58bad0e339 2026-03-19 10:18:30,276 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:18:30,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92a6e0ec88e58bad0e339 HTTP/1.1" 200 None 2026-03-19 10:18:30,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:18:30,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-19 10:18:30,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:18:30,353 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92a6e0ec88e58bad0e339 HTTP/1.1" 200 None 2026-03-19 10:18:30,360 - lava_callback - ERROR - Error processing callback for node 69b92a6e0ec88e58bad0e339: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45270 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55072 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:19:50,169 - lava_callback - INFO - Received callback for node 69b92abb0ec88e58bad0e340 INFO: 172.20.0.1:56736 - "POST /node/69b92abb0ec88e58bad0e340 HTTP/1.0" 202 Accepted 2026-03-19 10:19:50,175 - lava_callback - INFO - Starting async job submit for node 69b92abb0ec88e58bad0e340 2026-03-19 10:19:50,176 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:19:50,191 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92abb0ec88e58bad0e340 HTTP/1.1" 200 None 2026-03-19 10:19:50,191 - lava_callback - DEBUG - Processing node 69b92abb0ec88e58bad0e340: baseline-arm64-baylibre 2026-03-19 10:19:50,192 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92abb0ec88e58bad0e340 2026-03-19 10:19:50,192 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:19:50,206 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92abb0ec88e58bad0e340 HTTP/1.1" 200 None 2026-03-19 10:19:50,207 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:19:50,221 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-19 10:19:50,222 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:19:50,249 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92abb0ec88e58bad0e340 HTTP/1.1" 200 None 2026-03-19 10:19:50,251 - lava_callback - ERROR - Error processing callback for node 69b92abb0ec88e58bad0e340: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40704 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:21:50,285 - lava_callback - INFO - Received callback for node 69b92b2c0ec88e58bad0e352 INFO: 172.20.0.1:41732 - "POST /node/69b92b2c0ec88e58bad0e352 HTTP/1.0" 202 Accepted 2026-03-19 10:21:50,291 - lava_callback - INFO - Starting async job submit for node 69b92b2c0ec88e58bad0e352 2026-03-19 10:21:50,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:21:50,315 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92b2c0ec88e58bad0e352 HTTP/1.1" 200 None 2026-03-19 10:21:50,316 - lava_callback - DEBUG - Processing node 69b92b2c0ec88e58bad0e352: baseline-arm64-baylibre 2026-03-19 10:21:50,316 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92b2c0ec88e58bad0e352 2026-03-19 10:21:50,317 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:21:50,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92b2c0ec88e58bad0e352 HTTP/1.1" 200 None 2026-03-19 10:21:50,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:21:50,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-19 10:21:50,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:21:50,394 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92b2c0ec88e58bad0e352 HTTP/1.1" 200 None 2026-03-19 10:21:50,395 - lava_callback - ERROR - Error processing callback for node 69b92b2c0ec88e58bad0e352: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37588 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48770 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:23:05,497 - lava_callback - INFO - Received callback for node 69b92b7d0ec88e58bad0e35e INFO: 172.20.0.1:44336 - "POST /node/69b92b7d0ec88e58bad0e35e HTTP/1.0" 202 Accepted 2026-03-19 10:23:05,503 - lava_callback - INFO - Starting async job submit for node 69b92b7d0ec88e58bad0e35e 2026-03-19 10:23:05,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:23:05,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92b7d0ec88e58bad0e35e HTTP/1.1" 200 None 2026-03-19 10:23:05,522 - lava_callback - DEBUG - Processing node 69b92b7d0ec88e58bad0e35e: baseline-arm64-clabbe 2026-03-19 10:23:05,522 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92b7d0ec88e58bad0e35e 2026-03-19 10:23:05,523 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:23:05,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92b7d0ec88e58bad0e35e HTTP/1.1" 200 None 2026-03-19 10:23:05,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:23:05,563 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-19 10:23:05,564 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:23:05,602 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92b7d0ec88e58bad0e35e HTTP/1.1" 200 None 2026-03-19 10:23:05,605 - lava_callback - ERROR - Error processing callback for node 69b92b7d0ec88e58bad0e35e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53282 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:23:26,096 - lava_callback - INFO - Received callback for node 69bbcc29ec3f435d20d52a3c INFO: 172.20.0.1:60914 - "POST /node/69bbcc29ec3f435d20d52a3c HTTP/1.0" 202 Accepted 2026-03-19 10:23:26,102 - lava_callback - INFO - Starting async job submit for node 69bbcc29ec3f435d20d52a3c 2026-03-19 10:23:26,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:23:26,142 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcc29ec3f435d20d52a3c HTTP/1.1" 200 None 2026-03-19 10:23:26,143 - lava_callback - DEBUG - Processing node 69bbcc29ec3f435d20d52a3c: baseline-arm64 INFO: 172.20.0.1:60928 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:23:26,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:23:26,820 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:23:26,822 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcc29ec3f435d20d52a3c/log.txt.gz 2026-03-19 10:23:27,085 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:23:27,360 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:23:27,362 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcc29ec3f435d20d52a3c/lava-logs.yaml 2026-03-19 10:23:27,374 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:23:27,572 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:23:27,574 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcc29ec3f435d20d52a3c/lava_callback.json.gz 2026-03-19 10:23:27,599 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:23:27,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcc29ec3f435d20d52a3c HTTP/1.1" 200 None 2026-03-19 10:23:27,616 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:23:27,629 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:23:27,631 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:23:27,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcc29ec3f435d20d52a3c HTTP/1.1" 200 None 2026-03-19 10:23:27,712 - lava_callback - INFO - Completed processing callback for node 69bbcc29ec3f435d20d52a3c INFO: 172.20.0.1:60938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44514 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:23:44,326 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:23:44,344 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51304 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54954 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:25:45,590 - lava_callback - INFO - Received callback for node 69b92c160ec88e58bad0e371 INFO: 172.20.0.1:43204 - "POST /node/69b92c160ec88e58bad0e371 HTTP/1.0" 202 Accepted 2026-03-19 10:25:45,596 - lava_callback - INFO - Starting async job submit for node 69b92c160ec88e58bad0e371 2026-03-19 10:25:45,597 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:25:45,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92c160ec88e58bad0e371 HTTP/1.1" 200 None 2026-03-19 10:25:45,621 - lava_callback - DEBUG - Processing node 69b92c160ec88e58bad0e371: baseline-arm64-clabbe 2026-03-19 10:25:45,621 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92c160ec88e58bad0e371 2026-03-19 10:25:45,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:25:45,642 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92c160ec88e58bad0e371 HTTP/1.1" 200 None 2026-03-19 10:25:45,643 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:25:45,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-19 10:25:45,681 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:25:45,712 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92c160ec88e58bad0e371 HTTP/1.1" 200 None 2026-03-19 10:25:45,720 - lava_callback - ERROR - Error processing callback for node 69b92c160ec88e58bad0e371: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36588 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:26:01,763 - lava_callback - INFO - Received callback for node 69bbcbdeec3f435d20d52a34 INFO: 172.20.0.1:57054 - "POST /node/69bbcbdeec3f435d20d52a34 HTTP/1.0" 202 Accepted 2026-03-19 10:26:01,769 - lava_callback - INFO - Starting async job submit for node 69bbcbdeec3f435d20d52a34 2026-03-19 10:26:01,795 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:01,811 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcbdeec3f435d20d52a34 HTTP/1.1" 200 None 2026-03-19 10:26:01,811 - lava_callback - DEBUG - Processing node 69bbcbdeec3f435d20d52a34: baseline-nfs-arm64 2026-03-19 10:26:02,196 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:26:02,371 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:26:02,373 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbcbdeec3f435d20d52a34/log.txt.gz 2026-03-19 10:26:02,567 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:26:02,800 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:26:02,802 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbcbdeec3f435d20d52a34/lava-logs.yaml 2026-03-19 10:26:02,811 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:26:02,953 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:26:02,955 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbcbdeec3f435d20d52a34/lava_callback.json.gz 2026-03-19 10:26:02,982 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:02,996 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcbdeec3f435d20d52a34 HTTP/1.1" 200 None 2026-03-19 10:26:02,997 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:03,011 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:26:03,012 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:03,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcbdeec3f435d20d52a34 HTTP/1.1" 200 None 2026-03-19 10:26:03,130 - lava_callback - INFO - Completed processing callback for node 69bbcbdeec3f435d20d52a34 INFO: 172.20.0.1:57060 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:26:14,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:14,364 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:45402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45414 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:26:17,163 - lava_callback - INFO - Received callback for node 69bbcd8dec3f435d20d52a82 INFO: 172.20.0.1:45416 - "POST /node/69bbcd8dec3f435d20d52a82 HTTP/1.0" 202 Accepted 2026-03-19 10:26:17,170 - lava_callback - INFO - Starting async job submit for node 69bbcd8dec3f435d20d52a82 2026-03-19 10:26:17,206 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:17,224 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcd8dec3f435d20d52a82 HTTP/1.1" 200 None 2026-03-19 10:26:17,224 - lava_callback - DEBUG - Processing node 69bbcd8dec3f435d20d52a82: baseline-arm64 2026-03-19 10:26:17,609 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:26:17,748 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:26:17,749 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcd8dec3f435d20d52a82/log.txt.gz 2026-03-19 10:26:17,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:26:18,167 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:26:18,169 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcd8dec3f435d20d52a82/lava-logs.yaml 2026-03-19 10:26:18,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:26:18,372 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:26:18,374 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcd8dec3f435d20d52a82/lava_callback.json.gz DEBUG: Setup failed for 69bbcd8dec3f435d20d52a82. Transitting job node result: incomplete -> fail 2026-03-19 10:26:18,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:18,463 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcd8dec3f435d20d52a82 HTTP/1.1" 200 None 2026-03-19 10:26:18,464 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:18,478 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:26:18,479 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:18,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcd8dec3f435d20d52a82 HTTP/1.1" 200 None 2026-03-19 10:26:18,600 - lava_callback - INFO - Completed processing callback for node 69bbcd8dec3f435d20d52a82 INFO: 172.20.0.1:34976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45174 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:26:44,366 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:44,382 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 2026-03-19 10:26:45,634 - lava_callback - INFO - Received callback for node 69b92c630ec88e58bad0e376 INFO: 172.20.0.1:35108 - "POST /node/69b92c630ec88e58bad0e376 HTTP/1.0" 202 Accepted 2026-03-19 10:26:45,639 - lava_callback - INFO - Starting async job submit for node 69b92c630ec88e58bad0e376 2026-03-19 10:26:45,640 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:45,656 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92c630ec88e58bad0e376 HTTP/1.1" 200 None 2026-03-19 10:26:45,657 - lava_callback - DEBUG - Processing node 69b92c630ec88e58bad0e376: baseline-arm64-clabbe 2026-03-19 10:26:45,657 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92c630ec88e58bad0e376 2026-03-19 10:26:45,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:45,671 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92c630ec88e58bad0e376 HTTP/1.1" 200 None 2026-03-19 10:26:45,672 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:45,685 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-19 10:26:45,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:26:45,711 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92c630ec88e58bad0e376 HTTP/1.1" 200 None 2026-03-19 10:26:45,721 - lava_callback - ERROR - Error processing callback for node 69b92c630ec88e58bad0e376: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38422 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53130 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56846 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:28:37,354 - lava_callback - INFO - Received callback for node 69bbcbb0ec3f435d20d52a1c INFO: 172.20.0.1:56848 - "POST /node/69bbcbb0ec3f435d20d52a1c HTTP/1.0" 202 Accepted 2026-03-19 10:28:37,360 - lava_callback - INFO - Starting async job submit for node 69bbcbb0ec3f435d20d52a1c 2026-03-19 10:28:37,415 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:28:37,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcbb0ec3f435d20d52a1c HTTP/1.1" 200 None 2026-03-19 10:28:37,439 - lava_callback - DEBUG - Processing node 69bbcbb0ec3f435d20d52a1c: baseline-arm 2026-03-19 10:28:38,044 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:28:38,201 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:28:38,203 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bbcbb0ec3f435d20d52a1c/log.txt.gz 2026-03-19 10:28:38,552 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:28:38,787 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:28:38,789 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbcbb0ec3f435d20d52a1c/lava-logs.yaml 2026-03-19 10:28:38,804 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:28:38,974 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:28:38,976 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbcbb0ec3f435d20d52a1c/lava_callback.json.gz DEBUG: Setup failed for 69bbcbb0ec3f435d20d52a1c. Transitting job node result: incomplete -> fail 2026-03-19 10:28:39,087 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:28:39,103 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcbb0ec3f435d20d52a1c HTTP/1.1" 200 None 2026-03-19 10:28:39,105 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:28:39,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 10:28:39,122 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:28:39,146 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcbb0ec3f435d20d52a1c HTTP/1.1" 200 None 2026-03-19 10:28:39,256 - lava_callback - INFO - Completed processing callback for node 69bbcbb0ec3f435d20d52a1c 2026-03-19 10:28:44,384 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:28:44,401 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34568 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:30:05,787 - lava_callback - INFO - Received callback for node 69b92d1e0ec88e58bad0e390 INFO: 172.20.0.1:51048 - "POST /node/69b92d1e0ec88e58bad0e390 HTTP/1.0" 202 Accepted 2026-03-19 10:30:05,792 - lava_callback - INFO - Starting async job submit for node 69b92d1e0ec88e58bad0e390 2026-03-19 10:30:05,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:30:05,808 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92d1e0ec88e58bad0e390 HTTP/1.1" 200 None 2026-03-19 10:30:05,809 - lava_callback - DEBUG - Processing node 69b92d1e0ec88e58bad0e390: baseline-arm64-clabbe 2026-03-19 10:30:05,809 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92d1e0ec88e58bad0e390 2026-03-19 10:30:05,809 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:30:05,823 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92d1e0ec88e58bad0e390 HTTP/1.1" 200 None 2026-03-19 10:30:05,825 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:30:05,838 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-19 10:30:05,839 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:30:05,860 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92d1e0ec88e58bad0e390 HTTP/1.1" 200 None 2026-03-19 10:30:05,861 - lava_callback - ERROR - Error processing callback for node 69b92d1e0ec88e58bad0e390: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40190 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48724 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:31:25,837 - lava_callback - INFO - Received callback for node 69b92d680ec88e58bad0e39f INFO: 172.20.0.1:37832 - "POST /node/69b92d680ec88e58bad0e39f HTTP/1.0" 202 Accepted 2026-03-19 10:31:25,842 - lava_callback - INFO - Starting async job submit for node 69b92d680ec88e58bad0e39f 2026-03-19 10:31:25,843 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:31:25,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92d680ec88e58bad0e39f HTTP/1.1" 200 None 2026-03-19 10:31:25,860 - lava_callback - DEBUG - Processing node 69b92d680ec88e58bad0e39f: baseline-arm64-clabbe 2026-03-19 10:31:25,861 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92d680ec88e58bad0e39f 2026-03-19 10:31:25,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:31:25,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92d680ec88e58bad0e39f HTTP/1.1" 200 None 2026-03-19 10:31:25,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:31:25,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-19 10:31:25,895 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:31:25,914 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92d680ec88e58bad0e39f HTTP/1.1" 200 None 2026-03-19 10:31:25,916 - lava_callback - ERROR - Error processing callback for node 69b92d680ec88e58bad0e39f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53904 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:32:25,802 - lava_callback - INFO - Received callback for node 69b92db20ec88e58bad0e3a5 INFO: 172.20.0.1:46436 - "POST /node/69b92db20ec88e58bad0e3a5 HTTP/1.0" 202 Accepted 2026-03-19 10:32:25,808 - lava_callback - INFO - Starting async job submit for node 69b92db20ec88e58bad0e3a5 2026-03-19 10:32:25,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:32:25,828 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92db20ec88e58bad0e3a5 HTTP/1.1" 200 None 2026-03-19 10:32:25,829 - lava_callback - DEBUG - Processing node 69b92db20ec88e58bad0e3a5: baseline-arm64-clabbe 2026-03-19 10:32:25,830 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92db20ec88e58bad0e3a5 2026-03-19 10:32:25,830 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:32:25,843 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92db20ec88e58bad0e3a5 HTTP/1.1" 200 None 2026-03-19 10:32:25,844 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:32:25,858 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b125a3a870a1dc3343ba94 HTTP/1.1" 200 None 2026-03-19 10:32:25,860 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:32:25,880 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92db20ec88e58bad0e3a5 HTTP/1.1" 200 None 2026-03-19 10:32:25,882 - lava_callback - ERROR - Error processing callback for node 69b92db20ec88e58bad0e3a5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42668 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:33:46,398 - lava_callback - INFO - Received callback for node 69bbcea5ec3f435d20d52a94 INFO: 172.20.0.1:51764 - "POST /node/69bbcea5ec3f435d20d52a94 HTTP/1.0" 202 Accepted 2026-03-19 10:33:46,405 - lava_callback - INFO - Starting async job submit for node 69bbcea5ec3f435d20d52a94 2026-03-19 10:33:46,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:33:46,451 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcea5ec3f435d20d52a94 HTTP/1.1" 200 None 2026-03-19 10:33:46,452 - lava_callback - DEBUG - Processing node 69bbcea5ec3f435d20d52a94: baseline-arm64 INFO: 172.20.0.1:51778 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:33:46,967 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:33:47,125 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:33:47,127 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcea5ec3f435d20d52a94/log.txt.gz 2026-03-19 10:33:47,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:33:47,599 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:33:47,601 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcea5ec3f435d20d52a94/lava-logs.yaml 2026-03-19 10:33:47,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:33:47,775 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:33:47,776 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm64-69bbcea5ec3f435d20d52a94/lava_callback.json.gz 2026-03-19 10:33:47,801 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:33:47,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcea5ec3f435d20d52a94 HTTP/1.1" 200 None 2026-03-19 10:33:47,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:33:47,831 - lava_callback - INFO - Received callback for node 69bbcc7fec3f435d20d52a45 2026-03-19 10:33:47,840 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:33:47,841 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:33:47,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcea5ec3f435d20d52a94 HTTP/1.1" 200 None INFO: 172.20.0.1:51782 - "POST /node/69bbcc7fec3f435d20d52a45 HTTP/1.0" 202 Accepted 2026-03-19 10:33:47,910 - lava_callback - INFO - Starting async job submit for node 69bbcc7fec3f435d20d52a45 2026-03-19 10:33:47,951 - lava_callback - INFO - Completed processing callback for node 69bbcea5ec3f435d20d52a94 2026-03-19 10:33:47,977 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:33:47,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcc7fec3f435d20d52a45 HTTP/1.1" 200 None 2026-03-19 10:33:47,994 - lava_callback - DEBUG - Processing node 69bbcc7fec3f435d20d52a45: baseline-arm-pengutronix 2026-03-19 10:33:48,131 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:33:48,286 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:33:48,288 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbcc7fec3f435d20d52a45/log.txt.gz 2026-03-19 10:33:48,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:33:48,507 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:33:48,510 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbcc7fec3f435d20d52a45/lava-logs.yaml 2026-03-19 10:33:48,513 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:33:48,632 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:33:48,634 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbcc7fec3f435d20d52a45/lava_callback.json.gz DEBUG: Setup failed for 69bbcc7fec3f435d20d52a45. Transitting job node result: incomplete -> fail 2026-03-19 10:33:48,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:33:48,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcc7fec3f435d20d52a45 HTTP/1.1" 200 None 2026-03-19 10:33:48,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:33:48,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 10:33:48,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:33:48,747 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcc7fec3f435d20d52a45 HTTP/1.1" 200 None 2026-03-19 10:33:48,803 - lava_callback - INFO - Completed processing callback for node 69bbcc7fec3f435d20d52a45 INFO: 172.20.0.1:43892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34644 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:34:14,404 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:34:14,420 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47582 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-19 10:35:16,422 - lava_callback - INFO - Received callback for node 69bbcd37ec3f435d20d52a72 INFO: 172.20.0.1:47584 - "POST /node/69bbcd37ec3f435d20d52a72 HTTP/1.0" 202 Accepted 2026-03-19 10:35:16,429 - lava_callback - INFO - Starting async job submit for node 69bbcd37ec3f435d20d52a72 2026-03-19 10:35:16,488 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:35:16,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcd37ec3f435d20d52a72 HTTP/1.1" 200 None 2026-03-19 10:35:16,503 - lava_callback - DEBUG - Processing node 69bbcd37ec3f435d20d52a72: ltp-smoke INFO: 172.20.0.1:47600 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:35:16,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:35:17,216 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:35:17,218 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbcd37ec3f435d20d52a72/log.txt.gz 2026-03-19 10:35:17,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:35:17,739 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:35:17,741 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbcd37ec3f435d20d52a72/lava-logs.yaml 2026-03-19 10:35:17,752 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:35:17,936 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:35:17,938 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/ltp-smoke-69bbcd37ec3f435d20d52a72/lava_callback.json.gz 2026-03-19 10:35:18,056 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:35:18,071 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcd37ec3f435d20d52a72 HTTP/1.1" 200 None 2026-03-19 10:35:18,072 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:35:18,089 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb135ec3f435d20d51a9e HTTP/1.1" 200 None 2026-03-19 10:35:18,091 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:35:18,120 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcd37ec3f435d20d52a72 HTTP/1.1" 200 None 2026-03-19 10:35:18,235 - lava_callback - INFO - Completed processing callback for node 69bbcd37ec3f435d20d52a72 INFO: 172.20.0.1:41574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45300 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:35:44,422 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:35:44,439 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:44732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57060 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:36:57,877 - lava_callback - INFO - Received callback for node 69bbcf45ec3f435d20d52aa3 INFO: 172.20.0.1:57076 - "POST /node/69bbcf45ec3f435d20d52aa3 HTTP/1.0" 202 Accepted 2026-03-19 10:36:57,883 - lava_callback - INFO - Starting async job submit for node 69bbcf45ec3f435d20d52aa3 2026-03-19 10:36:57,909 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:36:57,931 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcf45ec3f435d20d52aa3 HTTP/1.1" 200 None 2026-03-19 10:36:57,932 - lava_callback - DEBUG - Processing node 69bbcf45ec3f435d20d52aa3: baseline-nfs-arm64 2026-03-19 10:36:58,470 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:36:58,628 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:36:58,630 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbcf45ec3f435d20d52aa3/log.txt.gz 2026-03-19 10:36:58,885 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:36:59,129 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:36:59,131 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbcf45ec3f435d20d52aa3/lava-logs.yaml 2026-03-19 10:36:59,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:36:59,316 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:36:59,318 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbcf45ec3f435d20d52aa3/lava_callback.json.gz 2026-03-19 10:36:59,346 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:36:59,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcf45ec3f435d20d52aa3 HTTP/1.1" 200 None 2026-03-19 10:36:59,362 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:36:59,375 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:36:59,377 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:36:59,397 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcf45ec3f435d20d52aa3 HTTP/1.1" 200 None 2026-03-19 10:36:59,462 - lava_callback - INFO - Completed processing callback for node 69bbcf45ec3f435d20d52aa3 INFO: 172.20.0.1:44100 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:37:14,441 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:37:14,464 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:35954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37044 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:37:36,563 - lava_callback - INFO - Received callback for node 69bbcd41ec3f435d20d52a76 INFO: 172.20.0.1:37060 - "POST /node/69bbcd41ec3f435d20d52a76 HTTP/1.0" 202 Accepted 2026-03-19 10:37:36,571 - lava_callback - INFO - Starting async job submit for node 69bbcd41ec3f435d20d52a76 2026-03-19 10:37:36,614 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:37:36,628 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcd41ec3f435d20d52a76 HTTP/1.1" 200 None 2026-03-19 10:37:36,629 - lava_callback - DEBUG - Processing node 69bbcd41ec3f435d20d52a76: baseline-nfs-arm64 2026-03-19 10:37:37,666 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:37:37,937 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:37:37,939 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbcd41ec3f435d20d52a76/log.txt.gz 2026-03-19 10:37:38,510 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:37:38,750 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:37:38,752 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbcd41ec3f435d20d52a76/lava-logs.yaml 2026-03-19 10:37:38,772 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:37:38,969 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:37:38,971 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbcd41ec3f435d20d52a76/lava_callback.json.gz DEBUG: Setup failed for 69bbcd41ec3f435d20d52a76. Transitting job node result: incomplete -> fail 2026-03-19 10:37:39,061 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:37:39,076 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcd41ec3f435d20d52a76 HTTP/1.1" 200 None 2026-03-19 10:37:39,077 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:37:39,111 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:37:39,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:37:39,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcd41ec3f435d20d52a76 HTTP/1.1" 200 None 2026-03-19 10:37:39,231 - lava_callback - INFO - Completed processing callback for node 69bbcd41ec3f435d20d52a76 2026-03-19 10:37:44,466 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:37:44,489 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:56222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57644 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38152 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:39:51,413 - lava_callback - INFO - Received callback for node 69b92f6e0ec88e58bad0e3e9 INFO: 172.20.0.1:41346 - "POST /node/69b92f6e0ec88e58bad0e3e9 HTTP/1.0" 202 Accepted 2026-03-19 10:39:51,422 - lava_callback - INFO - Starting async job submit for node 69b92f6e0ec88e58bad0e3e9 2026-03-19 10:39:51,423 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:39:51,458 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92f6e0ec88e58bad0e3e9 HTTP/1.1" 200 None 2026-03-19 10:39:51,459 - lava_callback - DEBUG - Processing node 69b92f6e0ec88e58bad0e3e9: baseline-arm-baylibre 2026-03-19 10:39:51,459 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92f6e0ec88e58bad0e3e9 2026-03-19 10:39:51,460 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:39:51,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92f6e0ec88e58bad0e3e9 HTTP/1.1" 200 None 2026-03-19 10:39:51,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:39:51,528 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-19 10:39:51,529 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:39:51,550 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92f6e0ec88e58bad0e3e9 HTTP/1.1" 200 None 2026-03-19 10:39:51,561 - lava_callback - ERROR - Error processing callback for node 69b92f6e0ec88e58bad0e3e9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44078 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:40:31,340 - lava_callback - INFO - Received callback for node 69b92f9d0ec88e58bad0e3f7 INFO: 172.20.0.1:48768 - "POST /node/69b92f9d0ec88e58bad0e3f7 HTTP/1.0" 202 Accepted 2026-03-19 10:40:31,346 - lava_callback - INFO - Starting async job submit for node 69b92f9d0ec88e58bad0e3f7 2026-03-19 10:40:31,347 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:40:31,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92f9d0ec88e58bad0e3f7 HTTP/1.1" 200 None 2026-03-19 10:40:31,374 - lava_callback - DEBUG - Processing node 69b92f9d0ec88e58bad0e3f7: baseline-arm-baylibre 2026-03-19 10:40:31,375 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92f9d0ec88e58bad0e3f7 2026-03-19 10:40:31,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:40:31,390 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92f9d0ec88e58bad0e3f7 HTTP/1.1" 200 None 2026-03-19 10:40:31,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:40:31,406 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-19 10:40:31,407 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:40:31,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92f9d0ec88e58bad0e3f7 HTTP/1.1" 200 None 2026-03-19 10:40:31,430 - lava_callback - ERROR - Error processing callback for node 69b92f9d0ec88e58bad0e3f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57816 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:41:11,362 - lava_callback - INFO - Received callback for node 69b92fc20ec88e58bad0e402 INFO: 172.20.0.1:54886 - "POST /node/69b92fc20ec88e58bad0e402 HTTP/1.0" 202 Accepted 2026-03-19 10:41:11,367 - lava_callback - INFO - Starting async job submit for node 69b92fc20ec88e58bad0e402 2026-03-19 10:41:11,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:41:11,383 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92fc20ec88e58bad0e402 HTTP/1.1" 200 None 2026-03-19 10:41:11,384 - lava_callback - DEBUG - Processing node 69b92fc20ec88e58bad0e402: baseline-arm-baylibre 2026-03-19 10:41:11,384 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92fc20ec88e58bad0e402 2026-03-19 10:41:11,385 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:41:11,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92fc20ec88e58bad0e402 HTTP/1.1" 200 None 2026-03-19 10:41:11,400 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:41:11,414 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-19 10:41:11,416 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:41:11,438 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92fc20ec88e58bad0e402 HTTP/1.1" 200 None 2026-03-19 10:41:11,440 - lava_callback - ERROR - Error processing callback for node 69b92fc20ec88e58bad0e402: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:54898 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48178 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:41:51,386 - lava_callback - INFO - Received callback for node 69b92fe80ec88e58bad0e40d INFO: 172.20.0.1:41994 - "POST /node/69b92fe80ec88e58bad0e40d HTTP/1.0" 202 Accepted 2026-03-19 10:41:51,391 - lava_callback - INFO - Starting async job submit for node 69b92fe80ec88e58bad0e40d 2026-03-19 10:41:51,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:41:51,411 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92fe80ec88e58bad0e40d HTTP/1.1" 200 None 2026-03-19 10:41:51,412 - lava_callback - DEBUG - Processing node 69b92fe80ec88e58bad0e40d: baseline-arm-baylibre 2026-03-19 10:41:51,412 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b92fe80ec88e58bad0e40d 2026-03-19 10:41:51,413 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:41:51,427 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b92fe80ec88e58bad0e40d HTTP/1.1" 200 None 2026-03-19 10:41:51,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:41:51,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-19 10:41:51,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:41:51,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b92fe80ec88e58bad0e40d HTTP/1.1" 200 None 2026-03-19 10:41:51,473 - lava_callback - ERROR - Error processing callback for node 69b92fe80ec88e58bad0e40d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40724 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44136 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:42:51,482 - lava_callback - INFO - Received callback for node 69b930180ec88e58bad0e419 INFO: 172.20.0.1:53424 - "POST /node/69b930180ec88e58bad0e419 HTTP/1.0" 202 Accepted 2026-03-19 10:42:51,488 - lava_callback - INFO - Starting async job submit for node 69b930180ec88e58bad0e419 2026-03-19 10:42:51,489 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:42:51,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b930180ec88e58bad0e419 HTTP/1.1" 200 None 2026-03-19 10:42:51,504 - lava_callback - DEBUG - Processing node 69b930180ec88e58bad0e419: baseline-arm-baylibre 2026-03-19 10:42:51,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b930180ec88e58bad0e419 2026-03-19 10:42:51,505 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:42:51,518 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b930180ec88e58bad0e419 HTTP/1.1" 200 None 2026-03-19 10:42:51,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:42:51,533 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-19 10:42:51,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:42:51,555 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b930180ec88e58bad0e419 HTTP/1.1" 200 None 2026-03-19 10:42:51,556 - lava_callback - ERROR - Error processing callback for node 69b930180ec88e58bad0e419: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41108 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41860 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:43:51,521 - lava_callback - INFO - Received callback for node 69b930540ec88e58bad0e427 INFO: 172.20.0.1:37912 - "POST /node/69b930540ec88e58bad0e427 HTTP/1.0" 202 Accepted 2026-03-19 10:43:51,527 - lava_callback - INFO - Starting async job submit for node 69b930540ec88e58bad0e427 2026-03-19 10:43:51,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:43:51,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b930540ec88e58bad0e427 HTTP/1.1" 200 None 2026-03-19 10:43:51,545 - lava_callback - DEBUG - Processing node 69b930540ec88e58bad0e427: baseline-arm-baylibre 2026-03-19 10:43:51,545 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b930540ec88e58bad0e427 2026-03-19 10:43:51,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:43:51,559 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b930540ec88e58bad0e427 HTTP/1.1" 200 None 2026-03-19 10:43:51,561 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:43:51,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-19 10:43:51,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:43:51,618 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b930540ec88e58bad0e427 HTTP/1.1" 200 None 2026-03-19 10:43:51,619 - lava_callback - ERROR - Error processing callback for node 69b930540ec88e58bad0e427: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50964 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42000 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34046 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:45:46,510 - lava_callback - INFO - Received callback for node 69b930ce0ec88e58bad0e44b INFO: 172.20.0.1:47332 - "POST /node/69b930ce0ec88e58bad0e44b HTTP/1.0" 202 Accepted 2026-03-19 10:45:46,516 - lava_callback - INFO - Starting async job submit for node 69b930ce0ec88e58bad0e44b 2026-03-19 10:45:46,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:47334 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:45:46,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b930ce0ec88e58bad0e44b HTTP/1.1" 200 None 2026-03-19 10:45:46,533 - lava_callback - DEBUG - Processing node 69b930ce0ec88e58bad0e44b: baseline-arm-clabbe 2026-03-19 10:45:46,533 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b930ce0ec88e58bad0e44b 2026-03-19 10:45:46,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:45:46,547 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b930ce0ec88e58bad0e44b HTTP/1.1" 200 None 2026-03-19 10:45:46,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:45:46,562 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-19 10:45:46,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:45:46,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b930ce0ec88e58bad0e44b HTTP/1.1" 200 None 2026-03-19 10:45:46,595 - lava_callback - ERROR - Error processing callback for node 69b930ce0ec88e58bad0e44b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:39070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37366 - "GET /api/metrics HTTP/1.0" 200 OK 2026-03-19 10:46:15,728 - lava_callback - INFO - Received callback for node 69bbcfd8ec3f435d20d52ab9 INFO: 172.20.0.1:37378 - "POST /node/69bbcfd8ec3f435d20d52ab9 HTTP/1.0" 202 Accepted 2026-03-19 10:46:15,735 - lava_callback - INFO - Starting async job submit for node 69bbcfd8ec3f435d20d52ab9 2026-03-19 10:46:15,790 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:46:15,805 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcfd8ec3f435d20d52ab9 HTTP/1.1" 200 None 2026-03-19 10:46:15,806 - lava_callback - DEBUG - Processing node 69bbcfd8ec3f435d20d52ab9: baseline-arm 2026-03-19 10:46:16,426 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 INFO: 172.20.0.1:37394 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:46:16,588 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:46:16,589 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-69bbcfd8ec3f435d20d52ab9/log.txt.gz 2026-03-19 10:46:16,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:46:17,195 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:46:17,197 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-69bbcfd8ec3f435d20d52ab9/lava-logs.yaml 2026-03-19 10:46:17,211 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:46:17,413 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:46:17,414 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-69bbcfd8ec3f435d20d52ab9/lava_callback.json.gz DEBUG: Setup failed for 69bbcfd8ec3f435d20d52ab9. Transitting job node result: incomplete -> fail 2026-03-19 10:46:17,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:46:17,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbcfd8ec3f435d20d52ab9 HTTP/1.1" 200 None 2026-03-19 10:46:17,547 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:46:17,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 10:46:17,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:46:17,587 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbcfd8ec3f435d20d52ab9 HTTP/1.1" 200 None 2026-03-19 10:46:17,696 - lava_callback - INFO - Completed processing callback for node 69bbcfd8ec3f435d20d52ab9 2026-03-19 10:46:26,486 - lava_callback - INFO - Received callback for node 69b930f30ec88e58bad0e456 INFO: 172.20.0.1:53324 - "POST /node/69b930f30ec88e58bad0e456 HTTP/1.0" 202 Accepted 2026-03-19 10:46:26,492 - lava_callback - INFO - Starting async job submit for node 69b930f30ec88e58bad0e456 2026-03-19 10:46:26,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:46:26,508 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b930f30ec88e58bad0e456 HTTP/1.1" 200 None 2026-03-19 10:46:26,509 - lava_callback - DEBUG - Processing node 69b930f30ec88e58bad0e456: baseline-arm-clabbe 2026-03-19 10:46:26,509 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b930f30ec88e58bad0e456 2026-03-19 10:46:26,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:53334 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:46:26,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b930f30ec88e58bad0e456 HTTP/1.1" 200 None 2026-03-19 10:46:26,525 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:46:26,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-19 10:46:26,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:46:26,583 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b930f30ec88e58bad0e456 HTTP/1.1" 200 None 2026-03-19 10:46:26,584 - lava_callback - ERROR - Error processing callback for node 69b930f30ec88e58bad0e456: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45832 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:46:44,493 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:46:44,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:37734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57090 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:47:06,503 - lava_callback - INFO - Received callback for node 69b931170ec88e58bad0e462 INFO: 172.20.0.1:55428 - "POST /node/69b931170ec88e58bad0e462 HTTP/1.0" 202 Accepted 2026-03-19 10:47:06,509 - lava_callback - INFO - Starting async job submit for node 69b931170ec88e58bad0e462 2026-03-19 10:47:06,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:55434 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:47:06,548 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b931170ec88e58bad0e462 HTTP/1.1" 200 None 2026-03-19 10:47:06,548 - lava_callback - DEBUG - Processing node 69b931170ec88e58bad0e462: baseline-arm-clabbe 2026-03-19 10:47:06,549 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b931170ec88e58bad0e462 2026-03-19 10:47:06,549 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:47:06,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b931170ec88e58bad0e462 HTTP/1.1" 200 None 2026-03-19 10:47:06,575 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:47:06,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-19 10:47:06,590 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:47:06,640 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b931170ec88e58bad0e462 HTTP/1.1" 200 None 2026-03-19 10:47:06,642 - lava_callback - ERROR - Error processing callback for node 69b931170ec88e58bad0e462: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46112 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40558 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:47:46,485 - lava_callback - INFO - Received callback for node 69b931470ec88e58bad0e46f INFO: 172.20.0.1:44252 - "POST /node/69b931470ec88e58bad0e46f HTTP/1.0" 202 Accepted 2026-03-19 10:47:46,490 - lava_callback - INFO - Starting async job submit for node 69b931470ec88e58bad0e46f 2026-03-19 10:47:46,491 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:47:46,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b931470ec88e58bad0e46f HTTP/1.1" 200 None 2026-03-19 10:47:46,506 - lava_callback - DEBUG - Processing node 69b931470ec88e58bad0e46f: baseline-arm-clabbe 2026-03-19 10:47:46,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b931470ec88e58bad0e46f 2026-03-19 10:47:46,507 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:47:46,520 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b931470ec88e58bad0e46f HTTP/1.1" 200 None 2026-03-19 10:47:46,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:47:46,534 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-19 10:47:46,536 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:44256 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:47:46,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b931470ec88e58bad0e46f HTTP/1.1" 200 None 2026-03-19 10:47:46,562 - lava_callback - ERROR - Error processing callback for node 69b931470ec88e58bad0e46f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37780 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49012 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:48:26,601 - lava_callback - INFO - Received callback for node 69b9316b0ec88e58bad0e47e INFO: 172.20.0.1:49020 - "POST /node/69b9316b0ec88e58bad0e47e HTTP/1.0" 202 Accepted 2026-03-19 10:48:26,606 - lava_callback - INFO - Starting async job submit for node 69b9316b0ec88e58bad0e47e 2026-03-19 10:48:26,607 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:48:26,622 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9316b0ec88e58bad0e47e HTTP/1.1" 200 None 2026-03-19 10:48:26,623 - lava_callback - DEBUG - Processing node 69b9316b0ec88e58bad0e47e: baseline-arm-clabbe 2026-03-19 10:48:26,623 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9316b0ec88e58bad0e47e 2026-03-19 10:48:26,624 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:48:26,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9316b0ec88e58bad0e47e HTTP/1.1" 200 None 2026-03-19 10:48:26,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:48:26,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d330b8ad4124cec3553 HTTP/1.1" 200 None 2026-03-19 10:48:26,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:48:26,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9316b0ec88e58bad0e47e HTTP/1.1" 200 None 2026-03-19 10:48:26,683 - lava_callback - ERROR - Error processing callback for node 69b9316b0ec88e58bad0e47e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39792 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60598 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35394 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42404 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42016 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39938 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:57:56,403 - lava_callback - INFO - Received callback for node 69bbd1fbec3f435d20d52af5 INFO: 172.20.0.1:53244 - "POST /node/69bbd1fbec3f435d20d52af5 HTTP/1.0" 202 Accepted 2026-03-19 10:57:56,411 - lava_callback - INFO - Starting async job submit for node 69bbd1fbec3f435d20d52af5 2026-03-19 10:57:56,454 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:57:56,488 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbd1fbec3f435d20d52af5 HTTP/1.1" 200 None 2026-03-19 10:57:56,489 - lava_callback - DEBUG - Processing node 69bbd1fbec3f435d20d52af5: baseline-nfs-arm64 INFO: 172.20.0.1:53260 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:57:57,524 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:57:57,752 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:57:57,754 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbd1fbec3f435d20d52af5/log.txt.gz 2026-03-19 10:57:58,319 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:57:58,563 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:57:58,566 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbd1fbec3f435d20d52af5/lava-logs.yaml 2026-03-19 10:57:58,586 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 10:57:58,780 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 10:57:58,782 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-nfs-arm64-69bbd1fbec3f435d20d52af5/lava_callback.json.gz DEBUG: Setup failed for 69bbd1fbec3f435d20d52af5. Transitting job node result: incomplete -> fail 2026-03-19 10:57:58,871 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:57:58,885 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbd1fbec3f435d20d52af5 HTTP/1.1" 200 None 2026-03-19 10:57:58,887 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:57:58,900 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb13dec3f435d20d51aa7 HTTP/1.1" 200 None 2026-03-19 10:57:58,902 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:57:58,926 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbd1fbec3f435d20d52af5 HTTP/1.1" 200 None 2026-03-19 10:57:59,031 - lava_callback - INFO - Completed processing callback for node 69bbd1fbec3f435d20d52af5 INFO: 172.20.0.1:40932 - "GET / HTTP/1.0" 200 OK 2026-03-19 10:58:14,519 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 10:58:14,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:55538 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38870 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58916 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38320 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41856 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41300 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:03:52,973 - lava_callback - INFO - Received callback for node 69b9350d0ec88e58bad0e4ce INFO: 172.20.0.1:38302 - "POST /node/69b9350d0ec88e58bad0e4ce HTTP/1.0" 202 Accepted 2026-03-19 11:03:52,980 - lava_callback - INFO - Starting async job submit for node 69b9350d0ec88e58bad0e4ce 2026-03-19 11:03:52,981 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:03:53,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9350d0ec88e58bad0e4ce HTTP/1.1" 200 None 2026-03-19 11:03:53,002 - lava_callback - DEBUG - Processing node 69b9350d0ec88e58bad0e4ce: baseline-arm64-baylibre 2026-03-19 11:03:53,002 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9350d0ec88e58bad0e4ce 2026-03-19 11:03:53,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:03:53,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9350d0ec88e58bad0e4ce HTTP/1.1" 200 None 2026-03-19 11:03:53,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:03:53,031 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:03:53,033 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:03:53,053 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9350d0ec88e58bad0e4ce HTTP/1.1" 200 None 2026-03-19 11:03:53,063 - lava_callback - ERROR - Error processing callback for node 69b9350d0ec88e58bad0e4ce: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34390 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:05:12,683 - lava_callback - INFO - Received callback for node 69b935580ec88e58bad0e4dd INFO: 172.20.0.1:57876 - "POST /node/69b935580ec88e58bad0e4dd HTTP/1.0" 202 Accepted 2026-03-19 11:05:12,688 - lava_callback - INFO - Starting async job submit for node 69b935580ec88e58bad0e4dd 2026-03-19 11:05:12,689 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:05:12,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b935580ec88e58bad0e4dd HTTP/1.1" 200 None 2026-03-19 11:05:12,707 - lava_callback - DEBUG - Processing node 69b935580ec88e58bad0e4dd: baseline-arm64-baylibre 2026-03-19 11:05:12,708 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b935580ec88e58bad0e4dd 2026-03-19 11:05:12,708 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:05:12,724 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b935580ec88e58bad0e4dd HTTP/1.1" 200 None 2026-03-19 11:05:12,726 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:05:12,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:05:12,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:05:12,772 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b935580ec88e58bad0e4dd HTTP/1.1" 200 None 2026-03-19 11:05:12,774 - lava_callback - ERROR - Error processing callback for node 69b935580ec88e58bad0e4dd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57882 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41478 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42204 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:06:32,740 - lava_callback - INFO - Received callback for node 69b935a70ec88e58bad0e4e5 INFO: 172.20.0.1:35184 - "POST /node/69b935a70ec88e58bad0e4e5 HTTP/1.0" 202 Accepted 2026-03-19 11:06:32,746 - lava_callback - INFO - Starting async job submit for node 69b935a70ec88e58bad0e4e5 2026-03-19 11:06:32,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:06:32,762 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b935a70ec88e58bad0e4e5 HTTP/1.1" 200 None 2026-03-19 11:06:32,763 - lava_callback - DEBUG - Processing node 69b935a70ec88e58bad0e4e5: baseline-arm64-baylibre 2026-03-19 11:06:32,763 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b935a70ec88e58bad0e4e5 2026-03-19 11:06:32,763 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:06:32,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b935a70ec88e58bad0e4e5 HTTP/1.1" 200 None 2026-03-19 11:06:32,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:06:32,792 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:06:32,793 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:06:32,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b935a70ec88e58bad0e4e5 HTTP/1.1" 200 None 2026-03-19 11:06:32,817 - lava_callback - ERROR - Error processing callback for node 69b935a70ec88e58bad0e4e5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44962 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:07:52,879 - lava_callback - INFO - Received callback for node 69b936000ec88e58bad0e4f0 INFO: 172.20.0.1:47964 - "POST /node/69b936000ec88e58bad0e4f0 HTTP/1.0" 202 Accepted 2026-03-19 11:07:52,885 - lava_callback - INFO - Starting async job submit for node 69b936000ec88e58bad0e4f0 2026-03-19 11:07:52,886 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:07:52,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b936000ec88e58bad0e4f0 HTTP/1.1" 200 None 2026-03-19 11:07:52,918 - lava_callback - DEBUG - Processing node 69b936000ec88e58bad0e4f0: baseline-arm64-baylibre 2026-03-19 11:07:52,918 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b936000ec88e58bad0e4f0 2026-03-19 11:07:52,919 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:07:52,964 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b936000ec88e58bad0e4f0 HTTP/1.1" 200 None 2026-03-19 11:07:52,965 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:07:52,982 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:07:52,983 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:07:53,025 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b936000ec88e58bad0e4f0 HTTP/1.1" 200 None 2026-03-19 11:07:53,034 - lava_callback - ERROR - Error processing callback for node 69b936000ec88e58bad0e4f0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58872 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:09:12,923 - lava_callback - INFO - Received callback for node 69b9364b0ec88e58bad0e501 INFO: 172.20.0.1:49978 - "POST /node/69b9364b0ec88e58bad0e501 HTTP/1.0" 202 Accepted 2026-03-19 11:09:12,929 - lava_callback - INFO - Starting async job submit for node 69b9364b0ec88e58bad0e501 2026-03-19 11:09:12,930 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:09:12,944 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9364b0ec88e58bad0e501 HTTP/1.1" 200 None 2026-03-19 11:09:12,945 - lava_callback - DEBUG - Processing node 69b9364b0ec88e58bad0e501: baseline-arm64-baylibre 2026-03-19 11:09:12,946 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9364b0ec88e58bad0e501 2026-03-19 11:09:12,946 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:09:12,970 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9364b0ec88e58bad0e501 HTTP/1.1" 200 None 2026-03-19 11:09:12,971 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:09:13,008 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:09:13,010 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:09:13,056 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9364b0ec88e58bad0e501 HTTP/1.1" 200 None 2026-03-19 11:09:13,058 - lava_callback - ERROR - Error processing callback for node 69b9364b0ec88e58bad0e501: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49984 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46250 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:10:32,998 - lava_callback - INFO - Received callback for node 69b936960ec88e58bad0e50c INFO: 172.20.0.1:43352 - "POST /node/69b936960ec88e58bad0e50c HTTP/1.0" 202 Accepted 2026-03-19 11:10:33,005 - lava_callback - INFO - Starting async job submit for node 69b936960ec88e58bad0e50c 2026-03-19 11:10:33,006 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:10:33,049 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b936960ec88e58bad0e50c HTTP/1.1" 200 None 2026-03-19 11:10:33,050 - lava_callback - DEBUG - Processing node 69b936960ec88e58bad0e50c: baseline-arm64-baylibre 2026-03-19 11:10:33,050 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b936960ec88e58bad0e50c 2026-03-19 11:10:33,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:10:33,064 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b936960ec88e58bad0e50c HTTP/1.1" 200 None 2026-03-19 11:10:33,065 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:10:33,101 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:10:33,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:10:33,122 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b936960ec88e58bad0e50c HTTP/1.1" 200 None 2026-03-19 11:10:33,128 - lava_callback - ERROR - Error processing callback for node 69b936960ec88e58bad0e50c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34432 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35930 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:12:07,631 - lava_callback - INFO - Received callback for node 69b936f60ec88e58bad0e517 INFO: 172.20.0.1:35944 - "POST /node/69b936f60ec88e58bad0e517 HTTP/1.0" 202 Accepted 2026-03-19 11:12:07,636 - lava_callback - INFO - Starting async job submit for node 69b936f60ec88e58bad0e517 2026-03-19 11:12:07,637 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:12:07,655 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b936f60ec88e58bad0e517 HTTP/1.1" 200 None 2026-03-19 11:12:07,656 - lava_callback - DEBUG - Processing node 69b936f60ec88e58bad0e517: baseline-arm64-clabbe 2026-03-19 11:12:07,656 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b936f60ec88e58bad0e517 2026-03-19 11:12:07,657 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:12:07,681 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b936f60ec88e58bad0e517 HTTP/1.1" 200 None 2026-03-19 11:12:07,682 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:12:07,696 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:12:07,697 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:12:07,719 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b936f60ec88e58bad0e517 HTTP/1.1" 200 None 2026-03-19 11:12:07,721 - lava_callback - ERROR - Error processing callback for node 69b936f60ec88e58bad0e517: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44288 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43738 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:13:09,886 - lava_callback - INFO - Received callback for node 69bbd11aec3f435d20d52ad4 INFO: 172.20.0.1:36218 - "POST /node/69bbd11aec3f435d20d52ad4 HTTP/1.0" 202 Accepted 2026-03-19 11:13:09,933 - lava_callback - INFO - Starting async job submit for node 69bbd11aec3f435d20d52ad4 2026-03-19 11:13:09,958 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:13:09,997 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbd11aec3f435d20d52ad4 HTTP/1.1" 200 None 2026-03-19 11:13:09,998 - lava_callback - DEBUG - Processing node 69bbd11aec3f435d20d52ad4: baseline-arm-pengutronix 2026-03-19 11:13:10,104 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 11:13:10,267 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 11:13:10,269 - lava_callback - INFO - Log uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbd11aec3f435d20d52ad4/log.txt.gz 2026-03-19 11:13:10,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 11:13:10,528 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 11:13:10,530 - lava_callback - INFO - LAVA YAML uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbd11aec3f435d20d52ad4/lava-logs.yaml 2026-03-19 11:13:10,533 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): files-staging.kernelci.org:443 2026-03-19 11:13:10,699 - urllib3.connectionpool - DEBUG - https://files-staging.kernelci.org:443 "POST /upload HTTP/1.1" 200 0 2026-03-19 11:13:10,700 - lava_callback - INFO - Callback data uploaded to https://files-staging.kernelci.org/baseline-arm-pengutronix-69bbd11aec3f435d20d52ad4/lava_callback.json.gz DEBUG: Setup failed for 69bbd11aec3f435d20d52ad4. Transitting job node result: incomplete -> fail 2026-03-19 11:13:10,749 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:13:10,771 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbd11aec3f435d20d52ad4 HTTP/1.1" 200 None 2026-03-19 11:13:10,773 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:13:10,787 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69bbb130ec3f435d20d51a98 HTTP/1.1" 200 None 2026-03-19 11:13:10,788 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:13:10,812 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69bbd11aec3f435d20d52ad4 HTTP/1.1" 200 None 2026-03-19 11:13:10,899 - lava_callback - INFO - Completed processing callback for node 69bbd11aec3f435d20d52ad4 2026-03-19 11:13:14,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:13:14,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "POST /latest/telemetry HTTP/1.1" 200 14 INFO: 172.20.0.1:36230 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37018 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:13:27,559 - lava_callback - INFO - Received callback for node 69b937420ec88e58bad0e524 INFO: 172.20.0.1:37026 - "POST /node/69b937420ec88e58bad0e524 HTTP/1.0" 202 Accepted 2026-03-19 11:13:27,565 - lava_callback - INFO - Starting async job submit for node 69b937420ec88e58bad0e524 2026-03-19 11:13:27,566 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:13:27,581 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b937420ec88e58bad0e524 HTTP/1.1" 200 None 2026-03-19 11:13:27,582 - lava_callback - DEBUG - Processing node 69b937420ec88e58bad0e524: baseline-arm64-clabbe 2026-03-19 11:13:27,582 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b937420ec88e58bad0e524 2026-03-19 11:13:27,583 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:13:27,600 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b937420ec88e58bad0e524 HTTP/1.1" 200 None 2026-03-19 11:13:27,602 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:13:27,620 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:13:27,622 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:13:27,643 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b937420ec88e58bad0e524 HTTP/1.1" 200 None 2026-03-19 11:13:27,650 - lava_callback - ERROR - Error processing callback for node 69b937420ec88e58bad0e524: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46326 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48818 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:15:07,826 - lava_callback - INFO - Received callback for node 69b937ab0ec88e58bad0e52d INFO: 172.20.0.1:48822 - "POST /node/69b937ab0ec88e58bad0e52d HTTP/1.0" 202 Accepted 2026-03-19 11:15:07,832 - lava_callback - INFO - Starting async job submit for node 69b937ab0ec88e58bad0e52d 2026-03-19 11:15:07,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:15:07,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b937ab0ec88e58bad0e52d HTTP/1.1" 200 None 2026-03-19 11:15:07,849 - lava_callback - DEBUG - Processing node 69b937ab0ec88e58bad0e52d: baseline-arm64-clabbe 2026-03-19 11:15:07,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b937ab0ec88e58bad0e52d 2026-03-19 11:15:07,849 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:15:07,876 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b937ab0ec88e58bad0e52d HTTP/1.1" 200 None 2026-03-19 11:15:07,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:15:07,893 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:15:07,894 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:15:07,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b937ab0ec88e58bad0e52d HTTP/1.1" 200 None 2026-03-19 11:15:07,930 - lava_callback - ERROR - Error processing callback for node 69b937ab0ec88e58bad0e52d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52406 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:16:27,717 - lava_callback - INFO - Received callback for node 69b937f70ec88e58bad0e53a INFO: 172.20.0.1:52418 - "POST /node/69b937f70ec88e58bad0e53a HTTP/1.0" 202 Accepted 2026-03-19 11:16:27,723 - lava_callback - INFO - Starting async job submit for node 69b937f70ec88e58bad0e53a 2026-03-19 11:16:27,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:16:27,740 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b937f70ec88e58bad0e53a HTTP/1.1" 200 None 2026-03-19 11:16:27,741 - lava_callback - DEBUG - Processing node 69b937f70ec88e58bad0e53a: baseline-arm64-clabbe 2026-03-19 11:16:27,742 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b937f70ec88e58bad0e53a 2026-03-19 11:16:27,742 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:16:27,763 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b937f70ec88e58bad0e53a HTTP/1.1" 200 None 2026-03-19 11:16:27,764 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:16:27,777 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:16:27,779 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:16:27,799 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b937f70ec88e58bad0e53a HTTP/1.1" 200 None 2026-03-19 11:16:27,800 - lava_callback - ERROR - Error processing callback for node 69b937f70ec88e58bad0e53a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34122 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:18:07,752 - lava_callback - INFO - Received callback for node 69b9385f0ec88e58bad0e544 INFO: 172.20.0.1:34134 - "POST /node/69b9385f0ec88e58bad0e544 HTTP/1.0" 202 Accepted 2026-03-19 11:18:07,757 - lava_callback - INFO - Starting async job submit for node 69b9385f0ec88e58bad0e544 2026-03-19 11:18:07,758 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:18:07,773 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9385f0ec88e58bad0e544 HTTP/1.1" 200 None 2026-03-19 11:18:07,774 - lava_callback - DEBUG - Processing node 69b9385f0ec88e58bad0e544: baseline-arm64-clabbe 2026-03-19 11:18:07,774 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9385f0ec88e58bad0e544 2026-03-19 11:18:07,775 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:18:07,788 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9385f0ec88e58bad0e544 HTTP/1.1" 200 None 2026-03-19 11:18:07,789 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:18:07,807 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:18:07,808 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:18:07,829 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9385f0ec88e58bad0e544 HTTP/1.1" 200 None 2026-03-19 11:18:07,835 - lava_callback - ERROR - Error processing callback for node 69b9385f0ec88e58bad0e544: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40150 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47770 - "GET / HTTP/1.0" 200 OK 2026-03-19 11:19:27,780 - lava_callback - INFO - Received callback for node 69b938a90ec88e58bad0e551 INFO: 172.20.0.1:47772 - "POST /node/69b938a90ec88e58bad0e551 HTTP/1.0" 202 Accepted 2026-03-19 11:19:27,785 - lava_callback - INFO - Starting async job submit for node 69b938a90ec88e58bad0e551 2026-03-19 11:19:27,786 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:19:27,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b938a90ec88e58bad0e551 HTTP/1.1" 200 None 2026-03-19 11:19:27,801 - lava_callback - DEBUG - Processing node 69b938a90ec88e58bad0e551: baseline-arm64-clabbe 2026-03-19 11:19:27,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b938a90ec88e58bad0e551 2026-03-19 11:19:27,802 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:19:27,815 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b938a90ec88e58bad0e551 HTTP/1.1" 200 None 2026-03-19 11:19:27,816 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:19:27,831 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b82d510b8ad4124cec3566 HTTP/1.1" 200 None 2026-03-19 11:19:27,832 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 11:19:27,852 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b938a90ec88e58bad0e551 HTTP/1.1" 200 None 2026-03-19 11:19:27,863 - lava_callback - ERROR - Error processing callback for node 69b938a90ec88e58bad0e551: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53716 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43992 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34892 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56374 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52766 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56838 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42826 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43804 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43812 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50682 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37138 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50358 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58336 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43740 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60340 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53648 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42576 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39946 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43950 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59622 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58160 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36088 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36140 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49056 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44822 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47004 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40782 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58854 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34114 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49974 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40906 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57300 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45050 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37686 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35436 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40888 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43070 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52502 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53282 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33442 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54704 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48696 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48260 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52200 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36642 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40908 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40834 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50532 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38790 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38800 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33554 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43788 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42502 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50470 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37692 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54608 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53966 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48352 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43416 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54098 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54108 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58204 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39686 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43478 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36122 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53496 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36452 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36466 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39506 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37354 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45218 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56816 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51250 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59726 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42194 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53712 - "GET / HTTP/1.0" 200 OK 2026-03-19 12:53:19,042 - lava_callback - INFO - Received callback for node 69b94eab0ec88e58bad0e5b8 INFO: 172.20.0.1:53722 - "POST /node/69b94eab0ec88e58bad0e5b8 HTTP/1.0" 202 Accepted 2026-03-19 12:53:19,047 - lava_callback - INFO - Starting async job submit for node 69b94eab0ec88e58bad0e5b8 2026-03-19 12:53:19,048 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:53:19,063 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94eab0ec88e58bad0e5b8 HTTP/1.1" 200 None 2026-03-19 12:53:19,063 - lava_callback - DEBUG - Processing node 69b94eab0ec88e58bad0e5b8: baseline-arm-baylibre 2026-03-19 12:53:19,064 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b94eab0ec88e58bad0e5b8 2026-03-19 12:53:19,064 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:53:19,077 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94eab0ec88e58bad0e5b8 HTTP/1.1" 200 None 2026-03-19 12:53:19,078 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:53:19,100 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-19 12:53:19,102 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:53:19,123 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b94eab0ec88e58bad0e5b8 HTTP/1.1" 200 None 2026-03-19 12:53:19,124 - lava_callback - ERROR - Error processing callback for node 69b94eab0ec88e58bad0e5b8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50580 - "GET / HTTP/1.0" 200 OK 2026-03-19 12:53:58,852 - lava_callback - INFO - Received callback for node 69b94ed40ec88e58bad0e5c2 INFO: 172.20.0.1:50594 - "POST /node/69b94ed40ec88e58bad0e5c2 HTTP/1.0" 202 Accepted 2026-03-19 12:53:58,858 - lava_callback - INFO - Starting async job submit for node 69b94ed40ec88e58bad0e5c2 2026-03-19 12:53:58,859 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:53:58,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94ed40ec88e58bad0e5c2 HTTP/1.1" 200 None 2026-03-19 12:53:58,874 - lava_callback - DEBUG - Processing node 69b94ed40ec88e58bad0e5c2: baseline-arm-baylibre 2026-03-19 12:53:58,874 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b94ed40ec88e58bad0e5c2 2026-03-19 12:53:58,875 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:53:58,890 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94ed40ec88e58bad0e5c2 HTTP/1.1" 200 None 2026-03-19 12:53:58,891 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:53:58,904 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-19 12:53:58,906 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:53:58,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b94ed40ec88e58bad0e5c2 HTTP/1.1" 200 None 2026-03-19 12:53:58,927 - lava_callback - ERROR - Error processing callback for node 69b94ed40ec88e58bad0e5c2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37696 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39258 - "GET / HTTP/1.0" 200 OK 2026-03-19 12:54:38,908 - lava_callback - INFO - Received callback for node 69b94efa0ec88e58bad0e5cf INFO: 172.20.0.1:39268 - "POST /node/69b94efa0ec88e58bad0e5cf HTTP/1.0" 202 Accepted 2026-03-19 12:54:38,914 - lava_callback - INFO - Starting async job submit for node 69b94efa0ec88e58bad0e5cf 2026-03-19 12:54:38,915 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:54:38,946 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94efa0ec88e58bad0e5cf HTTP/1.1" 200 None 2026-03-19 12:54:38,947 - lava_callback - DEBUG - Processing node 69b94efa0ec88e58bad0e5cf: baseline-arm-baylibre 2026-03-19 12:54:38,947 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b94efa0ec88e58bad0e5cf 2026-03-19 12:54:38,947 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:54:38,961 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94efa0ec88e58bad0e5cf HTTP/1.1" 200 None 2026-03-19 12:54:38,963 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:54:38,976 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-19 12:54:38,978 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:54:38,998 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b94efa0ec88e58bad0e5cf HTTP/1.1" 200 None 2026-03-19 12:54:38,999 - lava_callback - ERROR - Error processing callback for node 69b94efa0ec88e58bad0e5cf: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40932 - "GET / HTTP/1.0" 200 OK 2026-03-19 12:54:58,904 - lava_callback - INFO - Received callback for node 69b94f200ec88e58bad0e5e0 INFO: 172.20.0.1:40940 - "POST /node/69b94f200ec88e58bad0e5e0 HTTP/1.0" 202 Accepted 2026-03-19 12:54:58,910 - lava_callback - INFO - Starting async job submit for node 69b94f200ec88e58bad0e5e0 2026-03-19 12:54:58,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:54:58,935 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94f200ec88e58bad0e5e0 HTTP/1.1" 200 None 2026-03-19 12:54:58,936 - lava_callback - DEBUG - Processing node 69b94f200ec88e58bad0e5e0: baseline-arm-baylibre 2026-03-19 12:54:58,937 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b94f200ec88e58bad0e5e0 2026-03-19 12:54:58,937 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:54:58,952 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94f200ec88e58bad0e5e0 HTTP/1.1" 200 None 2026-03-19 12:54:58,953 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:54:58,972 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-19 12:54:58,973 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:54:58,994 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b94f200ec88e58bad0e5e0 HTTP/1.1" 200 None 2026-03-19 12:54:58,995 - lava_callback - ERROR - Error processing callback for node 69b94f200ec88e58bad0e5e0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57418 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48542 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48554 - "GET / HTTP/1.0" 200 OK 2026-03-19 12:55:38,917 - lava_callback - INFO - Received callback for node 69b94f460ec88e58bad0e5ea INFO: 172.20.0.1:48560 - "POST /node/69b94f460ec88e58bad0e5ea HTTP/1.0" 202 Accepted 2026-03-19 12:55:38,922 - lava_callback - INFO - Starting async job submit for node 69b94f460ec88e58bad0e5ea 2026-03-19 12:55:38,923 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:55:38,938 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94f460ec88e58bad0e5ea HTTP/1.1" 200 None 2026-03-19 12:55:38,939 - lava_callback - DEBUG - Processing node 69b94f460ec88e58bad0e5ea: baseline-arm-baylibre 2026-03-19 12:55:38,939 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b94f460ec88e58bad0e5ea 2026-03-19 12:55:38,940 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:55:38,960 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94f460ec88e58bad0e5ea HTTP/1.1" 200 None 2026-03-19 12:55:38,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:55:38,975 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-19 12:55:38,976 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:55:39,006 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b94f460ec88e58bad0e5ea HTTP/1.1" 200 None 2026-03-19 12:55:39,008 - lava_callback - ERROR - Error processing callback for node 69b94f460ec88e58bad0e5ea: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40228 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40244 - "GET / HTTP/1.0" 200 OK 2026-03-19 12:56:18,994 - lava_callback - INFO - Received callback for node 69b94f6b0ec88e58bad0e5fa INFO: 172.20.0.1:40250 - "POST /node/69b94f6b0ec88e58bad0e5fa HTTP/1.0" 202 Accepted 2026-03-19 12:56:18,999 - lava_callback - INFO - Starting async job submit for node 69b94f6b0ec88e58bad0e5fa 2026-03-19 12:56:19,000 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:56:19,014 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94f6b0ec88e58bad0e5fa HTTP/1.1" 200 None 2026-03-19 12:56:19,015 - lava_callback - DEBUG - Processing node 69b94f6b0ec88e58bad0e5fa: baseline-arm-baylibre 2026-03-19 12:56:19,016 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b94f6b0ec88e58bad0e5fa 2026-03-19 12:56:19,016 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:56:19,029 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94f6b0ec88e58bad0e5fa HTTP/1.1" 200 None 2026-03-19 12:56:19,031 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:56:19,044 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-19 12:56:19,045 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:56:19,070 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b94f6b0ec88e58bad0e5fa HTTP/1.1" 200 None 2026-03-19 12:56:19,072 - lava_callback - ERROR - Error processing callback for node 69b94f6b0ec88e58bad0e5fa: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33910 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57608 - "GET / HTTP/1.0" 200 OK 2026-03-19 12:58:12,316 - lava_callback - INFO - Received callback for node 69b94fda0ec88e58bad0e620 INFO: 172.20.0.1:53650 - "POST /node/69b94fda0ec88e58bad0e620 HTTP/1.0" 202 Accepted 2026-03-19 12:58:12,322 - lava_callback - INFO - Starting async job submit for node 69b94fda0ec88e58bad0e620 2026-03-19 12:58:12,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:58:12,338 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94fda0ec88e58bad0e620 HTTP/1.1" 200 None 2026-03-19 12:58:12,339 - lava_callback - DEBUG - Processing node 69b94fda0ec88e58bad0e620: baseline-arm-clabbe 2026-03-19 12:58:12,339 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b94fda0ec88e58bad0e620 2026-03-19 12:58:12,340 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:58:12,356 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b94fda0ec88e58bad0e620 HTTP/1.1" 200 None 2026-03-19 12:58:12,358 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:58:12,378 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-19 12:58:12,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:58:12,405 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b94fda0ec88e58bad0e620 HTTP/1.1" 200 None 2026-03-19 12:58:12,407 - lava_callback - ERROR - Error processing callback for node 69b94fda0ec88e58bad0e620: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53666 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53380 - "GET / HTTP/1.0" 200 OK 2026-03-19 12:58:52,267 - lava_callback - INFO - Received callback for node 69b950090ec88e58bad0e630 INFO: 172.20.0.1:49924 - "POST /node/69b950090ec88e58bad0e630 HTTP/1.0" 202 Accepted 2026-03-19 12:58:52,272 - lava_callback - INFO - Starting async job submit for node 69b950090ec88e58bad0e630 2026-03-19 12:58:52,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:58:52,287 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b950090ec88e58bad0e630 HTTP/1.1" 200 None 2026-03-19 12:58:52,288 - lava_callback - DEBUG - Processing node 69b950090ec88e58bad0e630: baseline-arm-clabbe 2026-03-19 12:58:52,288 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b950090ec88e58bad0e630 2026-03-19 12:58:52,289 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:58:52,310 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b950090ec88e58bad0e630 HTTP/1.1" 200 None 2026-03-19 12:58:52,313 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:58:52,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-19 12:58:52,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:58:52,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b950090ec88e58bad0e630 HTTP/1.1" 200 None 2026-03-19 12:58:52,352 - lava_callback - ERROR - Error processing callback for node 69b950090ec88e58bad0e630: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42778 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42700 - "GET / HTTP/1.0" 200 OK 2026-03-19 12:59:32,296 - lava_callback - INFO - Received callback for node 69b9502f0ec88e58bad0e63c INFO: 172.20.0.1:42714 - "POST /node/69b9502f0ec88e58bad0e63c HTTP/1.0" 202 Accepted 2026-03-19 12:59:32,301 - lava_callback - INFO - Starting async job submit for node 69b9502f0ec88e58bad0e63c 2026-03-19 12:59:32,302 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:59:32,321 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9502f0ec88e58bad0e63c HTTP/1.1" 200 None 2026-03-19 12:59:32,322 - lava_callback - DEBUG - Processing node 69b9502f0ec88e58bad0e63c: baseline-arm-clabbe 2026-03-19 12:59:32,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9502f0ec88e58bad0e63c 2026-03-19 12:59:32,323 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:59:32,351 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9502f0ec88e58bad0e63c HTTP/1.1" 200 None 2026-03-19 12:59:32,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:59:32,367 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-19 12:59:32,368 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 12:59:32,395 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9502f0ec88e58bad0e63c HTTP/1.1" 200 None 2026-03-19 12:59:32,397 - lava_callback - ERROR - Error processing callback for node 69b9502f0ec88e58bad0e63c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51052 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:00:12,458 - lava_callback - INFO - Received callback for node 69b950550ec88e58bad0e647 INFO: 172.20.0.1:57804 - "POST /node/69b950550ec88e58bad0e647 HTTP/1.0" 202 Accepted 2026-03-19 13:00:12,464 - lava_callback - INFO - Starting async job submit for node 69b950550ec88e58bad0e647 2026-03-19 13:00:12,465 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:00:12,480 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b950550ec88e58bad0e647 HTTP/1.1" 200 None 2026-03-19 13:00:12,481 - lava_callback - DEBUG - Processing node 69b950550ec88e58bad0e647: baseline-arm-clabbe 2026-03-19 13:00:12,481 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b950550ec88e58bad0e647 2026-03-19 13:00:12,482 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:00:12,495 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b950550ec88e58bad0e647 HTTP/1.1" 200 None 2026-03-19 13:00:12,497 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:00:12,510 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-19 13:00:12,511 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:00:12,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b950550ec88e58bad0e647 HTTP/1.1" 200 None 2026-03-19 13:00:12,533 - lava_callback - ERROR - Error processing callback for node 69b950550ec88e58bad0e647: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57812 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52112 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45240 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:01:12,378 - lava_callback - INFO - Received callback for node 69b950810ec88e58bad0e657 INFO: 172.20.0.1:37734 - "POST /node/69b950810ec88e58bad0e657 HTTP/1.0" 202 Accepted 2026-03-19 13:01:12,387 - lava_callback - INFO - Starting async job submit for node 69b950810ec88e58bad0e657 2026-03-19 13:01:12,388 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:01:12,403 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b950810ec88e58bad0e657 HTTP/1.1" 200 None 2026-03-19 13:01:12,404 - lava_callback - DEBUG - Processing node 69b950810ec88e58bad0e657: baseline-arm-clabbe 2026-03-19 13:01:12,404 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b950810ec88e58bad0e657 2026-03-19 13:01:12,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:01:12,428 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b950810ec88e58bad0e657 HTTP/1.1" 200 None 2026-03-19 13:01:12,430 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:01:12,449 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89da7fbe29c53ae85cce2 HTTP/1.1" 200 None 2026-03-19 13:01:12,451 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:01:12,476 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b950810ec88e58bad0e657 HTTP/1.1" 200 None 2026-03-19 13:01:12,478 - lava_callback - ERROR - Error processing callback for node 69b950810ec88e58bad0e657: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37744 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59558 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41024 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44522 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60372 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58164 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40444 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45022 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56630 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56634 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50736 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44148 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44156 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57408 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54396 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57798 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54380 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51296 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36440 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60284 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46966 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43644 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39772 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44652 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41034 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60484 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38650 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47262 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60830 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43318 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36388 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54570 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48504 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34044 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47588 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40586 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53232 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42366 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50756 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57160 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42326 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57662 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35380 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52598 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48708 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47668 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54998 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42906 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42922 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:30:20,968 - lava_callback - INFO - Received callback for node 69b957690ec88e58bad0e6fc INFO: 172.20.0.1:45816 - "POST /node/69b957690ec88e58bad0e6fc HTTP/1.0" 202 Accepted 2026-03-19 13:30:20,973 - lava_callback - INFO - Starting async job submit for node 69b957690ec88e58bad0e6fc 2026-03-19 13:30:20,974 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:30:20,993 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b957690ec88e58bad0e6fc HTTP/1.1" 200 None 2026-03-19 13:30:20,993 - lava_callback - DEBUG - Processing node 69b957690ec88e58bad0e6fc: baseline-arm64-baylibre 2026-03-19 13:30:20,994 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b957690ec88e58bad0e6fc 2026-03-19 13:30:20,994 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:30:21,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b957690ec88e58bad0e6fc HTTP/1.1" 200 None 2026-03-19 13:30:21,021 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:30:21,035 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:30:21,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:30:21,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b957690ec88e58bad0e6fc HTTP/1.1" 200 None 2026-03-19 13:30:21,058 - lava_callback - ERROR - Error processing callback for node 69b957690ec88e58bad0e6fc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45822 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34606 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:31:40,973 - lava_callback - INFO - Received callback for node 69b957b60ec88e58bad0e70a INFO: 172.20.0.1:50390 - "POST /node/69b957b60ec88e58bad0e70a HTTP/1.0" 202 Accepted 2026-03-19 13:31:40,979 - lava_callback - INFO - Starting async job submit for node 69b957b60ec88e58bad0e70a 2026-03-19 13:31:40,980 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:31:40,995 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b957b60ec88e58bad0e70a HTTP/1.1" 200 None 2026-03-19 13:31:40,995 - lava_callback - DEBUG - Processing node 69b957b60ec88e58bad0e70a: baseline-arm64-baylibre 2026-03-19 13:31:40,996 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b957b60ec88e58bad0e70a 2026-03-19 13:31:40,996 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:31:41,010 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b957b60ec88e58bad0e70a HTTP/1.1" 200 None 2026-03-19 13:31:41,011 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:31:41,034 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:31:41,036 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:31:41,067 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b957b60ec88e58bad0e70a HTTP/1.1" 200 None 2026-03-19 13:31:41,068 - lava_callback - ERROR - Error processing callback for node 69b957b60ec88e58bad0e70a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35764 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35772 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36998 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58814 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:33:21,048 - lava_callback - INFO - Received callback for node 69b9580d0ec88e58bad0e717 INFO: 172.20.0.1:55642 - "POST /node/69b9580d0ec88e58bad0e717 HTTP/1.0" 202 Accepted 2026-03-19 13:33:21,054 - lava_callback - INFO - Starting async job submit for node 69b9580d0ec88e58bad0e717 2026-03-19 13:33:21,055 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:33:21,068 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9580d0ec88e58bad0e717 HTTP/1.1" 200 None 2026-03-19 13:33:21,069 - lava_callback - DEBUG - Processing node 69b9580d0ec88e58bad0e717: baseline-arm64-baylibre 2026-03-19 13:33:21,069 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9580d0ec88e58bad0e717 2026-03-19 13:33:21,070 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:33:21,084 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9580d0ec88e58bad0e717 HTTP/1.1" 200 None 2026-03-19 13:33:21,086 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:33:21,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:33:21,100 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:33:21,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9580d0ec88e58bad0e717 HTTP/1.1" 200 None 2026-03-19 13:33:21,126 - lava_callback - ERROR - Error processing callback for node 69b9580d0ec88e58bad0e717: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44930 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52866 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52882 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:34:21,072 - lava_callback - INFO - Received callback for node 69b958580ec88e58bad0e721 INFO: 172.20.0.1:43390 - "POST /node/69b958580ec88e58bad0e721 HTTP/1.0" 202 Accepted 2026-03-19 13:34:21,078 - lava_callback - INFO - Starting async job submit for node 69b958580ec88e58bad0e721 2026-03-19 13:34:21,079 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:34:21,095 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b958580ec88e58bad0e721 HTTP/1.1" 200 None 2026-03-19 13:34:21,096 - lava_callback - DEBUG - Processing node 69b958580ec88e58bad0e721: baseline-arm64-baylibre 2026-03-19 13:34:21,096 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b958580ec88e58bad0e721 2026-03-19 13:34:21,097 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:34:21,134 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b958580ec88e58bad0e721 HTTP/1.1" 200 None 2026-03-19 13:34:21,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:34:21,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:34:21,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:34:21,188 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b958580ec88e58bad0e721 HTTP/1.1" 200 None 2026-03-19 13:34:21,190 - lava_callback - ERROR - Error processing callback for node 69b958580ec88e58bad0e721: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38480 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53050 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:35:41,150 - lava_callback - INFO - Received callback for node 69b958a20ec88e58bad0e72f INFO: 172.20.0.1:41582 - "POST /node/69b958a20ec88e58bad0e72f HTTP/1.0" 202 Accepted 2026-03-19 13:35:41,156 - lava_callback - INFO - Starting async job submit for node 69b958a20ec88e58bad0e72f 2026-03-19 13:35:41,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:35:41,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b958a20ec88e58bad0e72f HTTP/1.1" 200 None 2026-03-19 13:35:41,172 - lava_callback - DEBUG - Processing node 69b958a20ec88e58bad0e72f: baseline-arm64-baylibre 2026-03-19 13:35:41,172 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b958a20ec88e58bad0e72f 2026-03-19 13:35:41,173 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:35:41,185 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b958a20ec88e58bad0e72f HTTP/1.1" 200 None 2026-03-19 13:35:41,187 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:35:41,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:35:41,201 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:35:41,227 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b958a20ec88e58bad0e72f HTTP/1.1" 200 None 2026-03-19 13:35:41,237 - lava_callback - ERROR - Error processing callback for node 69b958a20ec88e58bad0e72f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36246 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46530 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:37:01,192 - lava_callback - INFO - Received callback for node 69b958ed0ec88e58bad0e73a INFO: 172.20.0.1:52746 - "POST /node/69b958ed0ec88e58bad0e73a HTTP/1.0" 202 Accepted 2026-03-19 13:37:01,198 - lava_callback - INFO - Starting async job submit for node 69b958ed0ec88e58bad0e73a 2026-03-19 13:37:01,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:37:01,212 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b958ed0ec88e58bad0e73a HTTP/1.1" 200 None 2026-03-19 13:37:01,213 - lava_callback - DEBUG - Processing node 69b958ed0ec88e58bad0e73a: baseline-arm64-baylibre 2026-03-19 13:37:01,213 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b958ed0ec88e58bad0e73a 2026-03-19 13:37:01,213 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:37:01,226 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b958ed0ec88e58bad0e73a HTTP/1.1" 200 None 2026-03-19 13:37:01,227 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:37:01,240 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:37:01,242 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:37:01,272 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b958ed0ec88e58bad0e73a HTTP/1.1" 200 None 2026-03-19 13:37:01,274 - lava_callback - ERROR - Error processing callback for node 69b958ed0ec88e58bad0e73a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47714 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37002 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44942 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38116 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56026 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:40:13,923 - lava_callback - INFO - Received callback for node 69b959b90ec88e58bad0e749 INFO: 172.20.0.1:50980 - "POST /node/69b959b90ec88e58bad0e749 HTTP/1.0" 202 Accepted 2026-03-19 13:40:13,928 - lava_callback - INFO - Starting async job submit for node 69b959b90ec88e58bad0e749 2026-03-19 13:40:13,929 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:40:13,959 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b959b90ec88e58bad0e749 HTTP/1.1" 200 None 2026-03-19 13:40:13,960 - lava_callback - DEBUG - Processing node 69b959b90ec88e58bad0e749: baseline-arm64-clabbe 2026-03-19 13:40:13,960 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b959b90ec88e58bad0e749 2026-03-19 13:40:13,961 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:40:13,974 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b959b90ec88e58bad0e749 HTTP/1.1" 200 None 2026-03-19 13:40:13,975 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:40:13,990 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:40:13,992 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:40:14,020 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b959b90ec88e58bad0e749 HTTP/1.1" 200 None 2026-03-19 13:40:14,025 - lava_callback - ERROR - Error processing callback for node 69b959b90ec88e58bad0e749: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41518 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49232 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42570 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:42:14,044 - lava_callback - INFO - Received callback for node 69b95a300ec88e58bad0e756 INFO: 172.20.0.1:58530 - "POST /node/69b95a300ec88e58bad0e756 HTTP/1.0" 202 Accepted 2026-03-19 13:42:14,049 - lava_callback - INFO - Starting async job submit for node 69b95a300ec88e58bad0e756 2026-03-19 13:42:14,050 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:42:14,065 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b95a300ec88e58bad0e756 HTTP/1.1" 200 None 2026-03-19 13:42:14,067 - lava_callback - DEBUG - Processing node 69b95a300ec88e58bad0e756: baseline-arm64-clabbe 2026-03-19 13:42:14,067 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b95a300ec88e58bad0e756 2026-03-19 13:42:14,067 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:42:14,081 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b95a300ec88e58bad0e756 HTTP/1.1" 200 None 2026-03-19 13:42:14,082 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:42:14,099 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:42:14,101 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:42:14,121 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b95a300ec88e58bad0e756 HTTP/1.1" 200 None 2026-03-19 13:42:14,127 - lava_callback - ERROR - Error processing callback for node 69b95a300ec88e58bad0e756: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58534 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58536 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35484 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49084 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:43:34,113 - lava_callback - INFO - Received callback for node 69b95a7c0ec88e58bad0e763 INFO: 172.20.0.1:49100 - "POST /node/69b95a7c0ec88e58bad0e763 HTTP/1.0" 202 Accepted 2026-03-19 13:43:34,119 - lava_callback - INFO - Starting async job submit for node 69b95a7c0ec88e58bad0e763 2026-03-19 13:43:34,120 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:43:34,135 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b95a7c0ec88e58bad0e763 HTTP/1.1" 200 None 2026-03-19 13:43:34,135 - lava_callback - DEBUG - Processing node 69b95a7c0ec88e58bad0e763: baseline-arm64-clabbe 2026-03-19 13:43:34,136 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b95a7c0ec88e58bad0e763 2026-03-19 13:43:34,136 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:43:34,150 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b95a7c0ec88e58bad0e763 HTTP/1.1" 200 None 2026-03-19 13:43:34,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:43:34,168 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:43:34,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:43:34,190 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b95a7c0ec88e58bad0e763 HTTP/1.1" 200 None 2026-03-19 13:43:34,191 - lava_callback - ERROR - Error processing callback for node 69b95a7c0ec88e58bad0e763: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36738 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52056 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48348 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:44:54,155 - lava_callback - INFO - Received callback for node 69b95ac80ec88e58bad0e76e INFO: 172.20.0.1:58620 - "POST /node/69b95ac80ec88e58bad0e76e HTTP/1.0" 202 Accepted 2026-03-19 13:44:54,161 - lava_callback - INFO - Starting async job submit for node 69b95ac80ec88e58bad0e76e 2026-03-19 13:44:54,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:44:54,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b95ac80ec88e58bad0e76e HTTP/1.1" 200 None 2026-03-19 13:44:54,177 - lava_callback - DEBUG - Processing node 69b95ac80ec88e58bad0e76e: baseline-arm64-clabbe 2026-03-19 13:44:54,178 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b95ac80ec88e58bad0e76e 2026-03-19 13:44:54,178 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:44:54,192 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b95ac80ec88e58bad0e76e HTTP/1.1" 200 None 2026-03-19 13:44:54,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:44:54,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:44:54,215 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:44:54,236 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b95ac80ec88e58bad0e76e HTTP/1.1" 200 None 2026-03-19 13:44:54,242 - lava_callback - ERROR - Error processing callback for node 69b95ac80ec88e58bad0e76e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52688 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40736 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35596 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39538 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:46:14,241 - lava_callback - INFO - Received callback for node 69b95b210ec88e58bad0e779 INFO: 172.20.0.1:46386 - "POST /node/69b95b210ec88e58bad0e779 HTTP/1.0" 202 Accepted 2026-03-19 13:46:14,247 - lava_callback - INFO - Starting async job submit for node 69b95b210ec88e58bad0e779 2026-03-19 13:46:14,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:46:14,271 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b95b210ec88e58bad0e779 HTTP/1.1" 200 None 2026-03-19 13:46:14,272 - lava_callback - DEBUG - Processing node 69b95b210ec88e58bad0e779: baseline-arm64-clabbe 2026-03-19 13:46:14,272 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b95b210ec88e58bad0e779 2026-03-19 13:46:14,272 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:46:14,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b95b210ec88e58bad0e779 HTTP/1.1" 200 None 2026-03-19 13:46:14,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:46:14,304 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:46:14,305 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:46:14,337 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b95b210ec88e58bad0e779 HTTP/1.1" 200 None 2026-03-19 13:46:14,338 - lava_callback - ERROR - Error processing callback for node 69b95b210ec88e58bad0e779: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:46390 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46400 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37562 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60002 - "GET / HTTP/1.0" 200 OK 2026-03-19 13:47:34,342 - lava_callback - INFO - Received callback for node 69b95b6e0ec88e58bad0e787 INFO: 172.20.0.1:60012 - "POST /node/69b95b6e0ec88e58bad0e787 HTTP/1.0" 202 Accepted 2026-03-19 13:47:34,347 - lava_callback - INFO - Starting async job submit for node 69b95b6e0ec88e58bad0e787 2026-03-19 13:47:34,348 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:47:34,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b95b6e0ec88e58bad0e787 HTTP/1.1" 200 None 2026-03-19 13:47:34,363 - lava_callback - DEBUG - Processing node 69b95b6e0ec88e58bad0e787: baseline-arm64-clabbe 2026-03-19 13:47:34,363 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b95b6e0ec88e58bad0e787 2026-03-19 13:47:34,364 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:47:34,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b95b6e0ec88e58bad0e787 HTTP/1.1" 200 None 2026-03-19 13:47:34,378 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:47:34,391 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b89db8fbe29c53ae85ccf4 HTTP/1.1" 200 None 2026-03-19 13:47:34,392 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 13:47:34,413 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b95b6e0ec88e58bad0e787 HTTP/1.1" 200 None 2026-03-19 13:47:34,419 - lava_callback - ERROR - Error processing callback for node 69b95b6e0ec88e58bad0e787: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46758 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50566 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49368 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49290 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50406 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50412 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33084 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56492 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54724 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45954 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40872 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40874 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58398 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59882 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50986 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56012 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44282 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51066 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60900 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47250 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60988 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53414 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33042 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57184 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57196 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56454 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37976 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46430 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51514 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38208 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59852 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54242 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59080 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33034 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43206 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60948 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49180 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57092 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48738 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49378 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41402 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52978 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52984 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33100 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58302 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36894 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50290 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50294 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43324 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33754 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38632 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48446 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42544 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44932 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45310 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49700 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57216 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55550 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53576 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45154 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45170 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43078 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:38410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38826 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38168 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54702 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40236 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40940 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41202 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41216 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50756 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44858 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36656 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59648 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43156 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43172 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60382 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50412 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38154 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46830 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60094 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36340 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59122 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41498 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44546 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46452 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42552 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37922 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34782 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34784 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57272 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32840 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43024 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55672 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:55676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50370 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48336 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48342 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54868 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48522 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48248 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60952 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46086 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45580 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44894 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56798 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40638 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47720 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39450 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48226 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42652 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54490 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39666 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51384 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51392 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35816 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35824 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58228 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57520 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:38:04,772 - lava_callback - INFO - Received callback for node 69b967440ec88e58bad0e7cd INFO: 172.20.0.1:51904 - "POST /node/69b967440ec88e58bad0e7cd HTTP/1.0" 202 Accepted 2026-03-19 14:38:04,777 - lava_callback - INFO - Starting async job submit for node 69b967440ec88e58bad0e7cd 2026-03-19 14:38:04,778 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:38:04,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b967440ec88e58bad0e7cd HTTP/1.1" 200 None 2026-03-19 14:38:04,802 - lava_callback - DEBUG - Processing node 69b967440ec88e58bad0e7cd: baseline-arm-baylibre 2026-03-19 14:38:04,802 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b967440ec88e58bad0e7cd 2026-03-19 14:38:04,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:38:04,816 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b967440ec88e58bad0e7cd HTTP/1.1" 200 None 2026-03-19 14:38:04,818 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:38:04,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:38:04,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:38:04,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b967440ec88e58bad0e7cd HTTP/1.1" 200 None 2026-03-19 14:38:04,883 - lava_callback - ERROR - Error processing callback for node 69b967440ec88e58bad0e7cd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37276 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59434 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59446 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:38:44,553 - lava_callback - INFO - Received callback for node 69b9676a0ec88e58bad0e7d8 INFO: 172.20.0.1:49484 - "POST /node/69b9676a0ec88e58bad0e7d8 HTTP/1.0" 202 Accepted 2026-03-19 14:38:44,559 - lava_callback - INFO - Starting async job submit for node 69b9676a0ec88e58bad0e7d8 2026-03-19 14:38:44,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:38:44,574 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9676a0ec88e58bad0e7d8 HTTP/1.1" 200 None 2026-03-19 14:38:44,575 - lava_callback - DEBUG - Processing node 69b9676a0ec88e58bad0e7d8: baseline-arm-baylibre 2026-03-19 14:38:44,575 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9676a0ec88e58bad0e7d8 2026-03-19 14:38:44,576 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:38:44,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9676a0ec88e58bad0e7d8 HTTP/1.1" 200 None 2026-03-19 14:38:44,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:38:44,614 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:38:44,615 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:38:44,636 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9676a0ec88e58bad0e7d8 HTTP/1.1" 200 None 2026-03-19 14:38:44,643 - lava_callback - ERROR - Error processing callback for node 69b9676a0ec88e58bad0e7d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:59142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48962 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41192 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34370 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34374 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:40:24,642 - lava_callback - INFO - Received callback for node 69b967d60ec88e58bad0e826 INFO: 172.20.0.1:48258 - "POST /node/69b967d60ec88e58bad0e826 HTTP/1.0" 202 Accepted 2026-03-19 14:40:24,648 - lava_callback - INFO - Starting async job submit for node 69b967d60ec88e58bad0e826 2026-03-19 14:40:24,649 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:40:24,663 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b967d60ec88e58bad0e826 HTTP/1.1" 200 None 2026-03-19 14:40:24,664 - lava_callback - DEBUG - Processing node 69b967d60ec88e58bad0e826: baseline-arm-baylibre 2026-03-19 14:40:24,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b967d60ec88e58bad0e826 2026-03-19 14:40:24,665 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:40:24,679 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b967d60ec88e58bad0e826 HTTP/1.1" 200 None 2026-03-19 14:40:24,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:40:24,693 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:40:24,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:40:24,715 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b967d60ec88e58bad0e826 HTTP/1.1" 200 None 2026-03-19 14:40:24,717 - lava_callback - ERROR - Error processing callback for node 69b967d60ec88e58bad0e826: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44234 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58200 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:41:04,708 - lava_callback - INFO - Received callback for node 69b967fc0ec88e58bad0e834 INFO: 172.20.0.1:38452 - "POST /node/69b967fc0ec88e58bad0e834 HTTP/1.0" 202 Accepted 2026-03-19 14:41:04,714 - lava_callback - INFO - Starting async job submit for node 69b967fc0ec88e58bad0e834 2026-03-19 14:41:04,715 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:41:04,730 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b967fc0ec88e58bad0e834 HTTP/1.1" 200 None 2026-03-19 14:41:04,731 - lava_callback - DEBUG - Processing node 69b967fc0ec88e58bad0e834: baseline-arm-baylibre 2026-03-19 14:41:04,731 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b967fc0ec88e58bad0e834 2026-03-19 14:41:04,732 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:41:04,748 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b967fc0ec88e58bad0e834 HTTP/1.1" 200 None 2026-03-19 14:41:04,750 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:41:04,768 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 14:41:04,770 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:41:04,791 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b967fc0ec88e58bad0e834 HTTP/1.1" 200 None 2026-03-19 14:41:04,792 - lava_callback - ERROR - Error processing callback for node 69b967fc0ec88e58bad0e834: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33312 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40958 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33288 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33298 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:41:44,688 - lava_callback - INFO - Received callback for node 69b968210ec88e58bad0e83f INFO: 172.20.0.1:50130 - "POST /node/69b968210ec88e58bad0e83f HTTP/1.0" 202 Accepted 2026-03-19 14:41:44,694 - lava_callback - INFO - Starting async job submit for node 69b968210ec88e58bad0e83f 2026-03-19 14:41:44,695 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:41:44,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b968210ec88e58bad0e83f HTTP/1.1" 200 None 2026-03-19 14:41:44,710 - lava_callback - DEBUG - Processing node 69b968210ec88e58bad0e83f: baseline-arm-baylibre 2026-03-19 14:41:44,710 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b968210ec88e58bad0e83f 2026-03-19 14:41:44,711 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:41:44,745 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b968210ec88e58bad0e83f HTTP/1.1" 200 None 2026-03-19 14:41:44,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:41:44,761 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 14:41:44,762 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:41:44,786 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b968210ec88e58bad0e83f HTTP/1.1" 200 None 2026-03-19 14:41:44,787 - lava_callback - ERROR - Error processing callback for node 69b968210ec88e58bad0e83f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42986 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37924 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37934 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:42:24,723 - lava_callback - INFO - Received callback for node 69b968450ec88e58bad0e84a INFO: 172.20.0.1:57470 - "POST /node/69b968450ec88e58bad0e84a HTTP/1.0" 202 Accepted 2026-03-19 14:42:24,729 - lava_callback - INFO - Starting async job submit for node 69b968450ec88e58bad0e84a 2026-03-19 14:42:24,729 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:42:24,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b968450ec88e58bad0e84a HTTP/1.1" 200 None 2026-03-19 14:42:24,744 - lava_callback - DEBUG - Processing node 69b968450ec88e58bad0e84a: baseline-arm-baylibre 2026-03-19 14:42:24,744 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b968450ec88e58bad0e84a 2026-03-19 14:42:24,744 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:42:24,760 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b968450ec88e58bad0e84a HTTP/1.1" 200 None 2026-03-19 14:42:24,761 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:42:24,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 14:42:24,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:42:24,800 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b968450ec88e58bad0e84a HTTP/1.1" 200 None 2026-03-19 14:42:24,801 - lava_callback - ERROR - Error processing callback for node 69b968450ec88e58bad0e84a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40684 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40334 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44772 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:43:04,827 - lava_callback - INFO - Received callback for node 69b968690ec88e58bad0e855 INFO: 172.20.0.1:38984 - "POST /node/69b968690ec88e58bad0e855 HTTP/1.0" 202 Accepted 2026-03-19 14:43:04,833 - lava_callback - INFO - Starting async job submit for node 69b968690ec88e58bad0e855 2026-03-19 14:43:04,834 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:43:04,848 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b968690ec88e58bad0e855 HTTP/1.1" 200 None 2026-03-19 14:43:04,849 - lava_callback - DEBUG - Processing node 69b968690ec88e58bad0e855: baseline-arm-baylibre 2026-03-19 14:43:04,849 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b968690ec88e58bad0e855 2026-03-19 14:43:04,850 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:43:04,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b968690ec88e58bad0e855 HTTP/1.1" 200 None 2026-03-19 14:43:04,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:43:04,888 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 14:43:04,889 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:43:04,909 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b968690ec88e58bad0e855 HTTP/1.1" 200 None 2026-03-19 14:43:04,917 - lava_callback - ERROR - Error processing callback for node 69b968690ec88e58bad0e855: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52646 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52658 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60098 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:43:44,861 - lava_callback - INFO - Received callback for node 69b9688e0ec88e58bad0e862 INFO: 172.20.0.1:49188 - "POST /node/69b9688e0ec88e58bad0e862 HTTP/1.0" 202 Accepted 2026-03-19 14:43:44,866 - lava_callback - INFO - Starting async job submit for node 69b9688e0ec88e58bad0e862 2026-03-19 14:43:44,867 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:43:44,882 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9688e0ec88e58bad0e862 HTTP/1.1" 200 None 2026-03-19 14:43:44,882 - lava_callback - DEBUG - Processing node 69b9688e0ec88e58bad0e862: baseline-arm-baylibre 2026-03-19 14:43:44,883 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9688e0ec88e58bad0e862 2026-03-19 14:43:44,883 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:43:44,911 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9688e0ec88e58bad0e862 HTTP/1.1" 200 None 2026-03-19 14:43:44,912 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:43:44,925 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 14:43:44,927 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:43:44,947 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9688e0ec88e58bad0e862 HTTP/1.1" 200 None 2026-03-19 14:43:44,949 - lava_callback - ERROR - Error processing callback for node 69b9688e0ec88e58bad0e862: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54602 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:44:04,850 - lava_callback - INFO - Received callback for node 69b968b10ec88e58bad0e86d INFO: 172.20.0.1:57114 - "POST /node/69b968b10ec88e58bad0e86d HTTP/1.0" 202 Accepted 2026-03-19 14:44:04,856 - lava_callback - INFO - Starting async job submit for node 69b968b10ec88e58bad0e86d 2026-03-19 14:44:04,857 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:44:04,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b968b10ec88e58bad0e86d HTTP/1.1" 200 None 2026-03-19 14:44:04,877 - lava_callback - DEBUG - Processing node 69b968b10ec88e58bad0e86d: baseline-arm-baylibre 2026-03-19 14:44:04,878 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b968b10ec88e58bad0e86d 2026-03-19 14:44:04,878 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:44:04,892 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b968b10ec88e58bad0e86d HTTP/1.1" 200 None 2026-03-19 14:44:04,893 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:44:04,906 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 14:44:04,908 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:44:04,928 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b968b10ec88e58bad0e86d HTTP/1.1" 200 None 2026-03-19 14:44:04,936 - lava_callback - ERROR - Error processing callback for node 69b968b10ec88e58bad0e86d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46426 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46438 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60604 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48404 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36914 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43278 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33186 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:45:56,797 - lava_callback - INFO - Received callback for node 69b9691c0ec88e58bad0e890 INFO: 172.20.0.1:33198 - "POST /node/69b9691c0ec88e58bad0e890 HTTP/1.0" 202 Accepted 2026-03-19 14:45:56,802 - lava_callback - INFO - Starting async job submit for node 69b9691c0ec88e58bad0e890 2026-03-19 14:45:56,803 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:45:56,817 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9691c0ec88e58bad0e890 HTTP/1.1" 200 None 2026-03-19 14:45:56,818 - lava_callback - DEBUG - Processing node 69b9691c0ec88e58bad0e890: baseline-arm-clabbe 2026-03-19 14:45:56,818 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9691c0ec88e58bad0e890 2026-03-19 14:45:56,819 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:45:56,832 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9691c0ec88e58bad0e890 HTTP/1.1" 200 None 2026-03-19 14:45:56,833 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:45:56,849 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 14:45:56,851 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:45:56,873 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9691c0ec88e58bad0e890 HTTP/1.1" 200 None 2026-03-19 14:45:56,879 - lava_callback - ERROR - Error processing callback for node 69b9691c0ec88e58bad0e890: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41674 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44988 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45004 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51630 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:46:36,697 - lava_callback - INFO - Received callback for node 69b969400ec88e58bad0e8a2 INFO: 172.20.0.1:51634 - "POST /node/69b969400ec88e58bad0e8a2 HTTP/1.0" 202 Accepted 2026-03-19 14:46:36,704 - lava_callback - INFO - Starting async job submit for node 69b969400ec88e58bad0e8a2 2026-03-19 14:46:36,705 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:46:36,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969400ec88e58bad0e8a2 HTTP/1.1" 200 None 2026-03-19 14:46:36,721 - lava_callback - DEBUG - Processing node 69b969400ec88e58bad0e8a2: baseline-arm-clabbe 2026-03-19 14:46:36,721 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b969400ec88e58bad0e8a2 2026-03-19 14:46:36,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:46:36,737 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969400ec88e58bad0e8a2 HTTP/1.1" 200 None 2026-03-19 14:46:36,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:46:36,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 14:46:36,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:46:36,789 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b969400ec88e58bad0e8a2 HTTP/1.1" 200 None 2026-03-19 14:46:36,795 - lava_callback - ERROR - Error processing callback for node 69b969400ec88e58bad0e8a2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51642 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:47:16,800 - lava_callback - INFO - Received callback for node 69b969640ec88e58bad0e8ad INFO: 172.20.0.1:51654 - "POST /node/69b969640ec88e58bad0e8ad HTTP/1.0" 202 Accepted 2026-03-19 14:47:16,806 - lava_callback - INFO - Starting async job submit for node 69b969640ec88e58bad0e8ad 2026-03-19 14:47:16,807 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:47:16,824 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969640ec88e58bad0e8ad HTTP/1.1" 200 None 2026-03-19 14:47:16,825 - lava_callback - DEBUG - Processing node 69b969640ec88e58bad0e8ad: baseline-arm-clabbe 2026-03-19 14:47:16,825 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b969640ec88e58bad0e8ad 2026-03-19 14:47:16,826 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:47:16,844 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969640ec88e58bad0e8ad HTTP/1.1" 200 None 2026-03-19 14:47:16,845 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:47:16,859 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 14:47:16,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:47:16,881 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b969640ec88e58bad0e8ad HTTP/1.1" 200 None 2026-03-19 14:47:16,884 - lava_callback - ERROR - Error processing callback for node 69b969640ec88e58bad0e8ad: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:48448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39346 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59356 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43146 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:47:56,814 - lava_callback - INFO - Received callback for node 69b969880ec88e58bad0e8b6 INFO: 172.20.0.1:43162 - "POST /node/69b969880ec88e58bad0e8b6 HTTP/1.0" 202 Accepted 2026-03-19 14:47:56,820 - lava_callback - INFO - Starting async job submit for node 69b969880ec88e58bad0e8b6 2026-03-19 14:47:56,821 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:47:56,847 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969880ec88e58bad0e8b6 HTTP/1.1" 200 None 2026-03-19 14:47:56,847 - lava_callback - DEBUG - Processing node 69b969880ec88e58bad0e8b6: baseline-arm-clabbe 2026-03-19 14:47:56,848 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b969880ec88e58bad0e8b6 2026-03-19 14:47:56,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:47:56,862 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969880ec88e58bad0e8b6 HTTP/1.1" 200 None 2026-03-19 14:47:56,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:47:56,879 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 14:47:56,880 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:47:56,902 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b969880ec88e58bad0e8b6 HTTP/1.1" 200 None 2026-03-19 14:47:56,904 - lava_callback - ERROR - Error processing callback for node 69b969880ec88e58bad0e8b6: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48172 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48188 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:48:16,830 - lava_callback - INFO - Received callback for node 69b969ad0ec88e58bad0e8c5 INFO: 172.20.0.1:48196 - "POST /node/69b969ad0ec88e58bad0e8c5 HTTP/1.0" 202 Accepted 2026-03-19 14:48:16,836 - lava_callback - INFO - Starting async job submit for node 69b969ad0ec88e58bad0e8c5 2026-03-19 14:48:16,836 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:48:16,856 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969ad0ec88e58bad0e8c5 HTTP/1.1" 200 None 2026-03-19 14:48:16,857 - lava_callback - DEBUG - Processing node 69b969ad0ec88e58bad0e8c5: baseline-arm-clabbe 2026-03-19 14:48:16,857 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b969ad0ec88e58bad0e8c5 2026-03-19 14:48:16,858 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:48:16,870 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969ad0ec88e58bad0e8c5 HTTP/1.1" 200 None 2026-03-19 14:48:16,872 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:48:16,886 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e350ec88e58bad0d0dd HTTP/1.1" 200 None 2026-03-19 14:48:16,888 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:48:16,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b969ad0ec88e58bad0e8c5 HTTP/1.1" 200 None 2026-03-19 14:48:16,918 - lava_callback - ERROR - Error processing callback for node 69b969ad0ec88e58bad0e8c5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49998 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:49:05,177 - lava_callback - INFO - Received callback for node 69b969cc0ec88e58bad0e8d0 INFO: 172.20.0.1:55514 - "POST /node/69b969cc0ec88e58bad0e8d0 HTTP/1.0" 202 Accepted 2026-03-19 14:49:05,182 - lava_callback - INFO - Starting async job submit for node 69b969cc0ec88e58bad0e8d0 2026-03-19 14:49:05,183 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:49:05,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969cc0ec88e58bad0e8d0 HTTP/1.1" 200 None 2026-03-19 14:49:05,199 - lava_callback - DEBUG - Processing node 69b969cc0ec88e58bad0e8d0: baseline-arm-baylibre 2026-03-19 14:49:05,199 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b969cc0ec88e58bad0e8d0 2026-03-19 14:49:05,200 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:49:05,214 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969cc0ec88e58bad0e8d0 HTTP/1.1" 200 None 2026-03-19 14:49:05,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:49:05,246 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:49:05,248 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:49:05,269 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b969cc0ec88e58bad0e8d0 HTTP/1.1" 200 None 2026-03-19 14:49:05,278 - lava_callback - ERROR - Error processing callback for node 69b969cc0ec88e58bad0e8d0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52062 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52066 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:49:25,120 - lava_callback - INFO - Received callback for node 69b969f00ec88e58bad0e8df INFO: 172.20.0.1:59360 - "POST /node/69b969f00ec88e58bad0e8df HTTP/1.0" 202 Accepted 2026-03-19 14:49:25,126 - lava_callback - INFO - Starting async job submit for node 69b969f00ec88e58bad0e8df 2026-03-19 14:49:25,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:49:25,141 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969f00ec88e58bad0e8df HTTP/1.1" 200 None 2026-03-19 14:49:25,142 - lava_callback - DEBUG - Processing node 69b969f00ec88e58bad0e8df: baseline-arm-baylibre 2026-03-19 14:49:25,142 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b969f00ec88e58bad0e8df 2026-03-19 14:49:25,143 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:49:25,156 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b969f00ec88e58bad0e8df HTTP/1.1" 200 None 2026-03-19 14:49:25,157 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:49:25,171 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:49:25,172 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:49:25,198 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b969f00ec88e58bad0e8df HTTP/1.1" 200 None 2026-03-19 14:49:25,204 - lava_callback - ERROR - Error processing callback for node 69b969f00ec88e58bad0e8df: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:59362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33566 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:50:05,146 - lava_callback - INFO - Received callback for node 69b96a130ec88e58bad0e8ee INFO: 172.20.0.1:38562 - "POST /node/69b96a130ec88e58bad0e8ee HTTP/1.0" 202 Accepted 2026-03-19 14:50:05,151 - lava_callback - INFO - Starting async job submit for node 69b96a130ec88e58bad0e8ee 2026-03-19 14:50:05,152 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:50:05,167 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96a130ec88e58bad0e8ee HTTP/1.1" 200 None 2026-03-19 14:50:05,168 - lava_callback - DEBUG - Processing node 69b96a130ec88e58bad0e8ee: baseline-arm-baylibre 2026-03-19 14:50:05,168 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96a130ec88e58bad0e8ee 2026-03-19 14:50:05,169 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:50:05,193 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96a130ec88e58bad0e8ee HTTP/1.1" 200 None 2026-03-19 14:50:05,194 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:50:05,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:50:05,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:50:05,235 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96a130ec88e58bad0e8ee HTTP/1.1" 200 None 2026-03-19 14:50:05,244 - lava_callback - ERROR - Error processing callback for node 69b96a130ec88e58bad0e8ee: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50134 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41460 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:50:45,299 - lava_callback - INFO - Received callback for node 69b96a360ec88e58bad0e8f7 INFO: 172.20.0.1:41242 - "POST /node/69b96a360ec88e58bad0e8f7 HTTP/1.0" 202 Accepted 2026-03-19 14:50:45,305 - lava_callback - INFO - Starting async job submit for node 69b96a360ec88e58bad0e8f7 2026-03-19 14:50:45,306 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:50:45,320 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96a360ec88e58bad0e8f7 HTTP/1.1" 200 None 2026-03-19 14:50:45,321 - lava_callback - DEBUG - Processing node 69b96a360ec88e58bad0e8f7: baseline-arm-baylibre 2026-03-19 14:50:45,322 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96a360ec88e58bad0e8f7 2026-03-19 14:50:45,322 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:50:45,335 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96a360ec88e58bad0e8f7 HTTP/1.1" 200 None 2026-03-19 14:50:45,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:50:45,350 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:50:45,352 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:50:45,371 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96a360ec88e58bad0e8f7 HTTP/1.1" 200 None 2026-03-19 14:50:45,376 - lava_callback - ERROR - Error processing callback for node 69b96a360ec88e58bad0e8f7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:41252 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55730 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43364 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43936 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43946 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:51:25,267 - lava_callback - INFO - Received callback for node 69b96a5b0ec88e58bad0e902 INFO: 172.20.0.1:45068 - "POST /node/69b96a5b0ec88e58bad0e902 HTTP/1.0" 202 Accepted 2026-03-19 14:51:25,273 - lava_callback - INFO - Starting async job submit for node 69b96a5b0ec88e58bad0e902 2026-03-19 14:51:25,274 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:51:25,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96a5b0ec88e58bad0e902 HTTP/1.1" 200 None 2026-03-19 14:51:25,290 - lava_callback - DEBUG - Processing node 69b96a5b0ec88e58bad0e902: baseline-arm-baylibre 2026-03-19 14:51:25,290 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96a5b0ec88e58bad0e902 2026-03-19 14:51:25,291 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:51:25,306 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96a5b0ec88e58bad0e902 HTTP/1.1" 200 None 2026-03-19 14:51:25,308 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:51:25,322 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:51:25,324 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:51:25,345 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96a5b0ec88e58bad0e902 HTTP/1.1" 200 None 2026-03-19 14:51:25,346 - lava_callback - ERROR - Error processing callback for node 69b96a5b0ec88e58bad0e902: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:45082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37850 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33864 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:51:57,287 - lava_callback - INFO - Received callback for node 69b96a800ec88e58bad0e90e INFO: 172.20.0.1:33878 - "POST /node/69b96a800ec88e58bad0e90e HTTP/1.0" 202 Accepted 2026-03-19 14:51:57,293 - lava_callback - INFO - Starting async job submit for node 69b96a800ec88e58bad0e90e 2026-03-19 14:51:57,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:51:57,308 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96a800ec88e58bad0e90e HTTP/1.1" 200 None 2026-03-19 14:51:57,308 - lava_callback - DEBUG - Processing node 69b96a800ec88e58bad0e90e: baseline-arm-clabbe 2026-03-19 14:51:57,309 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96a800ec88e58bad0e90e 2026-03-19 14:51:57,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:51:57,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96a800ec88e58bad0e90e HTTP/1.1" 200 None 2026-03-19 14:51:57,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:51:57,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:51:57,351 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:51:57,380 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96a800ec88e58bad0e90e HTTP/1.1" 200 None 2026-03-19 14:51:57,386 - lava_callback - ERROR - Error processing callback for node 69b96a800ec88e58bad0e90e: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43322 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56400 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56414 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:52:25,272 - lava_callback - INFO - Received callback for node 69b96aa10ec88e58bad0e91d INFO: 172.20.0.1:47408 - "POST /node/69b96aa10ec88e58bad0e91d HTTP/1.0" 202 Accepted 2026-03-19 14:52:25,277 - lava_callback - INFO - Starting async job submit for node 69b96aa10ec88e58bad0e91d 2026-03-19 14:52:25,278 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:52:25,293 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96aa10ec88e58bad0e91d HTTP/1.1" 200 None 2026-03-19 14:52:25,294 - lava_callback - DEBUG - Processing node 69b96aa10ec88e58bad0e91d: baseline-arm-baylibre 2026-03-19 14:52:25,294 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96aa10ec88e58bad0e91d 2026-03-19 14:52:25,294 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:52:25,309 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96aa10ec88e58bad0e91d HTTP/1.1" 200 None 2026-03-19 14:52:25,311 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:52:25,326 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:52:25,328 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:52:25,349 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96aa10ec88e58bad0e91d HTTP/1.1" 200 None 2026-03-19 14:52:25,351 - lava_callback - ERROR - Error processing callback for node 69b96aa10ec88e58bad0e91d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:47418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42456 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57924 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:53:05,314 - lava_callback - INFO - Received callback for node 69b96ac60ec88e58bad0e92b INFO: 172.20.0.1:35856 - "POST /node/69b96ac60ec88e58bad0e92b HTTP/1.0" 202 Accepted 2026-03-19 14:53:05,319 - lava_callback - INFO - Starting async job submit for node 69b96ac60ec88e58bad0e92b 2026-03-19 14:53:05,320 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:53:05,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96ac60ec88e58bad0e92b HTTP/1.1" 200 None 2026-03-19 14:53:05,335 - lava_callback - DEBUG - Processing node 69b96ac60ec88e58bad0e92b: baseline-arm-baylibre 2026-03-19 14:53:05,336 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96ac60ec88e58bad0e92b 2026-03-19 14:53:05,336 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:53:05,357 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96ac60ec88e58bad0e92b HTTP/1.1" 200 None 2026-03-19 14:53:05,359 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:53:05,373 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:53:05,375 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:53:05,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96ac60ec88e58bad0e92b HTTP/1.1" 200 None 2026-03-19 14:53:05,401 - lava_callback - ERROR - Error processing callback for node 69b96ac60ec88e58bad0e92b: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60248 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60254 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52274 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60610 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:53:45,348 - lava_callback - INFO - Received callback for node 69b96aeb0ec88e58bad0e936 INFO: 172.20.0.1:37252 - "POST /node/69b96aeb0ec88e58bad0e936 HTTP/1.0" 202 Accepted 2026-03-19 14:53:45,354 - lava_callback - INFO - Starting async job submit for node 69b96aeb0ec88e58bad0e936 2026-03-19 14:53:45,354 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:53:45,370 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96aeb0ec88e58bad0e936 HTTP/1.1" 200 None 2026-03-19 14:53:45,371 - lava_callback - DEBUG - Processing node 69b96aeb0ec88e58bad0e936: baseline-arm-baylibre 2026-03-19 14:53:45,372 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96aeb0ec88e58bad0e936 2026-03-19 14:53:45,372 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:53:45,385 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96aeb0ec88e58bad0e936 HTTP/1.1" 200 None 2026-03-19 14:53:45,387 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:53:45,400 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:53:45,401 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:53:45,421 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96aeb0ec88e58bad0e936 HTTP/1.1" 200 None 2026-03-19 14:53:45,444 - lava_callback - ERROR - Error processing callback for node 69b96aeb0ec88e58bad0e936: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37266 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56982 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37870 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36924 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:54:25,535 - lava_callback - INFO - Received callback for node 69b96b0f0ec88e58bad0e941 INFO: 172.20.0.1:51788 - "POST /node/69b96b0f0ec88e58bad0e941 HTTP/1.0" 202 Accepted 2026-03-19 14:54:25,540 - lava_callback - INFO - Starting async job submit for node 69b96b0f0ec88e58bad0e941 2026-03-19 14:54:25,541 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:54:25,556 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96b0f0ec88e58bad0e941 HTTP/1.1" 200 None 2026-03-19 14:54:25,557 - lava_callback - DEBUG - Processing node 69b96b0f0ec88e58bad0e941: baseline-arm-baylibre 2026-03-19 14:54:25,557 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96b0f0ec88e58bad0e941 2026-03-19 14:54:25,557 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:54:25,571 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96b0f0ec88e58bad0e941 HTTP/1.1" 200 None 2026-03-19 14:54:25,572 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:54:25,589 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:54:25,591 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:54:25,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96b0f0ec88e58bad0e941 HTTP/1.1" 200 None 2026-03-19 14:54:25,637 - lava_callback - ERROR - Error processing callback for node 69b96b0f0ec88e58bad0e941: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34048 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:55:05,521 - lava_callback - INFO - Received callback for node 69b96b360ec88e58bad0e94c INFO: 172.20.0.1:38790 - "POST /node/69b96b360ec88e58bad0e94c HTTP/1.0" 202 Accepted 2026-03-19 14:55:05,527 - lava_callback - INFO - Starting async job submit for node 69b96b360ec88e58bad0e94c 2026-03-19 14:55:05,528 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:55:05,542 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96b360ec88e58bad0e94c HTTP/1.1" 200 None 2026-03-19 14:55:05,543 - lava_callback - DEBUG - Processing node 69b96b360ec88e58bad0e94c: baseline-arm-baylibre 2026-03-19 14:55:05,543 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96b360ec88e58bad0e94c 2026-03-19 14:55:05,543 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:55:05,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96b360ec88e58bad0e94c HTTP/1.1" 200 None 2026-03-19 14:55:05,558 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:55:05,573 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:55:05,574 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:55:05,594 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96b360ec88e58bad0e94c HTTP/1.1" 200 None 2026-03-19 14:55:05,600 - lava_callback - ERROR - Error processing callback for node 69b96b360ec88e58bad0e94c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48784 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48790 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:55:25,480 - lava_callback - INFO - Received callback for node 69b96b5a0ec88e58bad0e959 INFO: 172.20.0.1:35324 - "POST /node/69b96b5a0ec88e58bad0e959 HTTP/1.0" 202 Accepted 2026-03-19 14:55:25,486 - lava_callback - INFO - Starting async job submit for node 69b96b5a0ec88e58bad0e959 2026-03-19 14:55:25,486 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:55:25,506 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96b5a0ec88e58bad0e959 HTTP/1.1" 200 None 2026-03-19 14:55:25,507 - lava_callback - DEBUG - Processing node 69b96b5a0ec88e58bad0e959: baseline-arm-baylibre 2026-03-19 14:55:25,507 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96b5a0ec88e58bad0e959 2026-03-19 14:55:25,508 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:55:25,521 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96b5a0ec88e58bad0e959 HTTP/1.1" 200 None 2026-03-19 14:55:25,522 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:55:25,535 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:55:25,537 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:55:25,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96b5a0ec88e58bad0e959 HTTP/1.1" 200 None 2026-03-19 14:55:25,559 - lava_callback - ERROR - Error processing callback for node 69b96b5a0ec88e58bad0e959: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53992 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48426 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57612 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53434 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53444 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:56:17,121 - lava_callback - INFO - Received callback for node 69b96b810ec88e58bad0e965 INFO: 172.20.0.1:53460 - "POST /node/69b96b810ec88e58bad0e965 HTTP/1.0" 202 Accepted 2026-03-19 14:56:17,127 - lava_callback - INFO - Starting async job submit for node 69b96b810ec88e58bad0e965 2026-03-19 14:56:17,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:56:17,149 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96b810ec88e58bad0e965 HTTP/1.1" 200 None 2026-03-19 14:56:17,150 - lava_callback - DEBUG - Processing node 69b96b810ec88e58bad0e965: baseline-arm-clabbe 2026-03-19 14:56:17,150 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96b810ec88e58bad0e965 2026-03-19 14:56:17,151 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:56:17,164 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96b810ec88e58bad0e965 HTTP/1.1" 200 None 2026-03-19 14:56:17,166 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:56:17,181 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:56:17,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:56:17,203 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96b810ec88e58bad0e965 HTTP/1.1" 200 None 2026-03-19 14:56:17,204 - lava_callback - ERROR - Error processing callback for node 69b96b810ec88e58bad0e965: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:42338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53788 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38810 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:56:57,155 - lava_callback - INFO - Received callback for node 69b96ba70ec88e58bad0e96f INFO: 172.20.0.1:38820 - "POST /node/69b96ba70ec88e58bad0e96f HTTP/1.0" 202 Accepted 2026-03-19 14:56:57,161 - lava_callback - INFO - Starting async job submit for node 69b96ba70ec88e58bad0e96f 2026-03-19 14:56:57,162 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:56:57,176 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96ba70ec88e58bad0e96f HTTP/1.1" 200 None 2026-03-19 14:56:57,176 - lava_callback - DEBUG - Processing node 69b96ba70ec88e58bad0e96f: baseline-arm-clabbe 2026-03-19 14:56:57,177 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96ba70ec88e58bad0e96f 2026-03-19 14:56:57,177 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:56:57,194 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96ba70ec88e58bad0e96f HTTP/1.1" 200 None 2026-03-19 14:56:57,195 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:56:57,208 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:56:57,209 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:56:57,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96ba70ec88e58bad0e96f HTTP/1.1" 200 None 2026-03-19 14:56:57,239 - lava_callback - ERROR - Error processing callback for node 69b96ba70ec88e58bad0e96f: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52402 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46166 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45422 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45430 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:57:37,175 - lava_callback - INFO - Received callback for node 69b96bcc0ec88e58bad0e97a INFO: 172.20.0.1:45440 - "POST /node/69b96bcc0ec88e58bad0e97a HTTP/1.0" 202 Accepted 2026-03-19 14:57:37,180 - lava_callback - INFO - Starting async job submit for node 69b96bcc0ec88e58bad0e97a 2026-03-19 14:57:37,181 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:57:37,196 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96bcc0ec88e58bad0e97a HTTP/1.1" 200 None 2026-03-19 14:57:37,196 - lava_callback - DEBUG - Processing node 69b96bcc0ec88e58bad0e97a: baseline-arm-clabbe 2026-03-19 14:57:37,197 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96bcc0ec88e58bad0e97a 2026-03-19 14:57:37,197 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:57:37,215 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96bcc0ec88e58bad0e97a HTTP/1.1" 200 None 2026-03-19 14:57:37,216 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:57:37,230 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:57:37,232 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:57:37,274 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96bcc0ec88e58bad0e97a HTTP/1.1" 200 None 2026-03-19 14:57:37,284 - lava_callback - ERROR - Error processing callback for node 69b96bcc0ec88e58bad0e97a: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36246 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:57:57,179 - lava_callback - INFO - Received callback for node 69b96bf10ec88e58bad0e985 INFO: 172.20.0.1:36248 - "POST /node/69b96bf10ec88e58bad0e985 HTTP/1.0" 202 Accepted 2026-03-19 14:57:57,185 - lava_callback - INFO - Starting async job submit for node 69b96bf10ec88e58bad0e985 2026-03-19 14:57:57,186 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:57:57,201 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96bf10ec88e58bad0e985 HTTP/1.1" 200 None 2026-03-19 14:57:57,202 - lava_callback - DEBUG - Processing node 69b96bf10ec88e58bad0e985: baseline-arm-clabbe 2026-03-19 14:57:57,202 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96bf10ec88e58bad0e985 2026-03-19 14:57:57,203 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:57:57,218 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96bf10ec88e58bad0e985 HTTP/1.1" 200 None 2026-03-19 14:57:57,220 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:57:57,233 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:57:57,234 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:57:57,256 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96bf10ec88e58bad0e985 HTTP/1.1" 200 None 2026-03-19 14:57:57,257 - lava_callback - ERROR - Error processing callback for node 69b96bf10ec88e58bad0e985: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:36606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37218 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37226 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58244 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50194 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50206 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:58:37,247 - lava_callback - INFO - Received callback for node 69b96c170ec88e58bad0e992 INFO: 172.20.0.1:50208 - "POST /node/69b96c170ec88e58bad0e992 HTTP/1.0" 202 Accepted 2026-03-19 14:58:37,252 - lava_callback - INFO - Starting async job submit for node 69b96c170ec88e58bad0e992 2026-03-19 14:58:37,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:58:37,276 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96c170ec88e58bad0e992 HTTP/1.1" 200 None 2026-03-19 14:58:37,276 - lava_callback - DEBUG - Processing node 69b96c170ec88e58bad0e992: baseline-arm-clabbe 2026-03-19 14:58:37,277 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96c170ec88e58bad0e992 2026-03-19 14:58:37,277 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:58:37,290 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96c170ec88e58bad0e992 HTTP/1.1" 200 None 2026-03-19 14:58:37,292 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:58:37,307 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:58:37,309 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:58:37,334 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96c170ec88e58bad0e992 HTTP/1.1" 200 None 2026-03-19 14:58:37,335 - lava_callback - ERROR - Error processing callback for node 69b96c170ec88e58bad0e992: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34374 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34384 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:59:17,246 - lava_callback - INFO - Received callback for node 69b96c3c0ec88e58bad0e99d INFO: 172.20.0.1:34392 - "POST /node/69b96c3c0ec88e58bad0e99d HTTP/1.0" 202 Accepted 2026-03-19 14:59:17,252 - lava_callback - INFO - Starting async job submit for node 69b96c3c0ec88e58bad0e99d 2026-03-19 14:59:17,253 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:59:17,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96c3c0ec88e58bad0e99d HTTP/1.1" 200 None 2026-03-19 14:59:17,268 - lava_callback - DEBUG - Processing node 69b96c3c0ec88e58bad0e99d: baseline-arm-clabbe 2026-03-19 14:59:17,268 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96c3c0ec88e58bad0e99d 2026-03-19 14:59:17,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:59:17,282 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96c3c0ec88e58bad0e99d HTTP/1.1" 200 None 2026-03-19 14:59:17,284 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:59:17,302 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:59:17,303 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:59:17,327 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96c3c0ec88e58bad0e99d HTTP/1.1" 200 None 2026-03-19 14:59:17,332 - lava_callback - ERROR - Error processing callback for node 69b96c3c0ec88e58bad0e99d: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:58482 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54078 - "GET / HTTP/1.0" 200 OK 2026-03-19 14:59:45,693 - lava_callback - INFO - Received callback for node 69b96c5f0ec88e58bad0e9a7 INFO: 172.20.0.1:56130 - "POST /node/69b96c5f0ec88e58bad0e9a7 HTTP/1.0" 202 Accepted 2026-03-19 14:59:45,699 - lava_callback - INFO - Starting async job submit for node 69b96c5f0ec88e58bad0e9a7 2026-03-19 14:59:45,699 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:59:45,714 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96c5f0ec88e58bad0e9a7 HTTP/1.1" 200 None 2026-03-19 14:59:45,715 - lava_callback - DEBUG - Processing node 69b96c5f0ec88e58bad0e9a7: baseline-arm-baylibre 2026-03-19 14:59:45,715 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96c5f0ec88e58bad0e9a7 2026-03-19 14:59:45,716 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:59:45,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96c5f0ec88e58bad0e9a7 HTTP/1.1" 200 None 2026-03-19 14:59:45,736 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:59:45,750 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 14:59:45,751 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 14:59:45,774 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96c5f0ec88e58bad0e9a7 HTTP/1.1" 200 None 2026-03-19 14:59:45,779 - lava_callback - ERROR - Error processing callback for node 69b96c5f0ec88e58bad0e9a7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52592 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60104 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37214 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34636 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34640 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56792 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56804 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:01:37,441 - lava_callback - INFO - Received callback for node 69b96ccb0ec88e58bad0e9bd INFO: 172.20.0.1:56812 - "POST /node/69b96ccb0ec88e58bad0e9bd HTTP/1.0" 202 Accepted 2026-03-19 15:01:37,446 - lava_callback - INFO - Starting async job submit for node 69b96ccb0ec88e58bad0e9bd 2026-03-19 15:01:37,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:01:37,475 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96ccb0ec88e58bad0e9bd HTTP/1.1" 200 None 2026-03-19 15:01:37,476 - lava_callback - DEBUG - Processing node 69b96ccb0ec88e58bad0e9bd: baseline-arm-clabbe 2026-03-19 15:01:37,476 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96ccb0ec88e58bad0e9bd 2026-03-19 15:01:37,477 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:01:37,491 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96ccb0ec88e58bad0e9bd HTTP/1.1" 200 None 2026-03-19 15:01:37,492 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:01:37,516 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 15:01:37,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:01:37,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96ccb0ec88e58bad0e9bd HTTP/1.1" 200 None 2026-03-19 15:01:37,545 - lava_callback - ERROR - Error processing callback for node 69b96ccb0ec88e58bad0e9bd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42786 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56594 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56606 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:02:17,441 - lava_callback - INFO - Received callback for node 69b96cf10ec88e58bad0e9c7 INFO: 172.20.0.1:56622 - "POST /node/69b96cf10ec88e58bad0e9c7 HTTP/1.0" 202 Accepted 2026-03-19 15:02:17,446 - lava_callback - INFO - Starting async job submit for node 69b96cf10ec88e58bad0e9c7 2026-03-19 15:02:17,447 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:02:17,465 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96cf10ec88e58bad0e9c7 HTTP/1.1" 200 None 2026-03-19 15:02:17,466 - lava_callback - DEBUG - Processing node 69b96cf10ec88e58bad0e9c7: baseline-arm-clabbe 2026-03-19 15:02:17,466 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96cf10ec88e58bad0e9c7 2026-03-19 15:02:17,467 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:02:17,481 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96cf10ec88e58bad0e9c7 HTTP/1.1" 200 None 2026-03-19 15:02:17,483 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:02:17,502 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 15:02:17,503 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:02:17,523 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96cf10ec88e58bad0e9c7 HTTP/1.1" 200 None 2026-03-19 15:02:17,529 - lava_callback - ERROR - Error processing callback for node 69b96cf10ec88e58bad0e9c7: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:37320 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35476 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40662 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:40672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38538 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40444 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:03:57,544 - lava_callback - INFO - Received callback for node 69b96d560ec88e58bad0e9d8 INFO: 172.20.0.1:40460 - "POST /node/69b96d560ec88e58bad0e9d8 HTTP/1.0" 202 Accepted 2026-03-19 15:03:57,550 - lava_callback - INFO - Starting async job submit for node 69b96d560ec88e58bad0e9d8 2026-03-19 15:03:57,551 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:03:57,579 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96d560ec88e58bad0e9d8 HTTP/1.1" 200 None 2026-03-19 15:03:57,579 - lava_callback - DEBUG - Processing node 69b96d560ec88e58bad0e9d8: baseline-arm-clabbe 2026-03-19 15:03:57,580 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96d560ec88e58bad0e9d8 2026-03-19 15:03:57,580 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:03:57,593 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96d560ec88e58bad0e9d8 HTTP/1.1" 200 None 2026-03-19 15:03:57,595 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:03:57,608 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 15:03:57,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:03:57,631 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96d560ec88e58bad0e9d8 HTTP/1.1" 200 None 2026-03-19 15:03:57,632 - lava_callback - ERROR - Error processing callback for node 69b96d560ec88e58bad0e9d8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 15:03:59,680 - lava_callback - INFO - Received callback for node 69b96d4b0ec88e58bad0e9d3 INFO: 172.20.0.1:40464 - "POST /node/69b96d4b0ec88e58bad0e9d3 HTTP/1.0" 202 Accepted 2026-03-19 15:03:59,686 - lava_callback - INFO - Starting async job submit for node 69b96d4b0ec88e58bad0e9d3 2026-03-19 15:03:59,686 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:03:59,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96d4b0ec88e58bad0e9d3 HTTP/1.1" 200 None 2026-03-19 15:03:59,702 - lava_callback - DEBUG - Processing node 69b96d4b0ec88e58bad0e9d3: baseline-x86 2026-03-19 15:03:59,702 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96d4b0ec88e58bad0e9d3 2026-03-19 15:03:59,703 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:03:59,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96d4b0ec88e58bad0e9d3 HTTP/1.1" 200 None 2026-03-19 15:03:59,722 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:03:59,746 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e550ec88e58bad0d108 HTTP/1.1" 200 None 2026-03-19 15:03:59,747 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:03:59,780 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96d4b0ec88e58bad0e9d3 HTTP/1.1" 200 None 2026-03-19 15:03:59,786 - lava_callback - ERROR - Error processing callback for node 69b96d4b0ec88e58bad0e9d3: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:52884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39602 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45142 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45158 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:04:37,525 - lava_callback - INFO - Received callback for node 69b96d7c0ec88e58bad0e9eb INFO: 172.20.0.1:45164 - "POST /node/69b96d7c0ec88e58bad0e9eb HTTP/1.0" 202 Accepted 2026-03-19 15:04:37,530 - lava_callback - INFO - Starting async job submit for node 69b96d7c0ec88e58bad0e9eb 2026-03-19 15:04:37,531 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:04:37,546 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96d7c0ec88e58bad0e9eb HTTP/1.1" 200 None 2026-03-19 15:04:37,547 - lava_callback - DEBUG - Processing node 69b96d7c0ec88e58bad0e9eb: baseline-arm-clabbe 2026-03-19 15:04:37,548 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96d7c0ec88e58bad0e9eb 2026-03-19 15:04:37,548 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:04:37,561 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96d7c0ec88e58bad0e9eb HTTP/1.1" 200 None 2026-03-19 15:04:37,563 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:04:37,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 15:04:37,577 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:04:37,597 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96d7c0ec88e58bad0e9eb HTTP/1.1" 200 None 2026-03-19 15:04:37,599 - lava_callback - ERROR - Error processing callback for node 69b96d7c0ec88e58bad0e9eb: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41980 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45972 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49726 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49742 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:05:17,606 - lava_callback - INFO - Received callback for node 69b96da10ec88e58bad0e9f2 INFO: 172.20.0.1:49756 - "POST /node/69b96da10ec88e58bad0e9f2 HTTP/1.0" 202 Accepted 2026-03-19 15:05:17,612 - lava_callback - INFO - Starting async job submit for node 69b96da10ec88e58bad0e9f2 2026-03-19 15:05:17,613 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:05:17,638 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96da10ec88e58bad0e9f2 HTTP/1.1" 200 None 2026-03-19 15:05:17,640 - lava_callback - DEBUG - Processing node 69b96da10ec88e58bad0e9f2: baseline-arm-clabbe 2026-03-19 15:05:17,640 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96da10ec88e58bad0e9f2 2026-03-19 15:05:17,641 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:05:17,654 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96da10ec88e58bad0e9f2 HTTP/1.1" 200 None 2026-03-19 15:05:17,656 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:05:17,678 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 15:05:17,680 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:05:17,701 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96da10ec88e58bad0e9f2 HTTP/1.1" 200 None 2026-03-19 15:05:17,706 - lava_callback - ERROR - Error processing callback for node 69b96da10ec88e58bad0e9f2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38224 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47026 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:05:57,603 - lava_callback - INFO - Received callback for node 69b96dc60ec88e58bad0e9fd INFO: 172.20.0.1:47028 - "POST /node/69b96dc60ec88e58bad0e9fd HTTP/1.0" 202 Accepted 2026-03-19 15:05:57,609 - lava_callback - INFO - Starting async job submit for node 69b96dc60ec88e58bad0e9fd 2026-03-19 15:05:57,610 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:05:57,626 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96dc60ec88e58bad0e9fd HTTP/1.1" 200 None 2026-03-19 15:05:57,627 - lava_callback - DEBUG - Processing node 69b96dc60ec88e58bad0e9fd: baseline-arm-clabbe 2026-03-19 15:05:57,627 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96dc60ec88e58bad0e9fd 2026-03-19 15:05:57,628 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:05:57,650 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96dc60ec88e58bad0e9fd HTTP/1.1" 200 None 2026-03-19 15:05:57,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:05:57,665 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 15:05:57,667 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:05:57,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96dc60ec88e58bad0e9fd HTTP/1.1" 200 None 2026-03-19 15:05:57,700 - lava_callback - ERROR - Error processing callback for node 69b96dc60ec88e58bad0e9fd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56486 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38330 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38346 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:06:37,662 - lava_callback - INFO - Received callback for node 69b96ded0ec88e58bad0ea11 INFO: 172.20.0.1:38356 - "POST /node/69b96ded0ec88e58bad0ea11 HTTP/1.0" 202 Accepted 2026-03-19 15:06:37,667 - lava_callback - INFO - Starting async job submit for node 69b96ded0ec88e58bad0ea11 2026-03-19 15:06:37,668 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:06:37,682 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96ded0ec88e58bad0ea11 HTTP/1.1" 200 None 2026-03-19 15:06:37,683 - lava_callback - DEBUG - Processing node 69b96ded0ec88e58bad0ea11: baseline-arm-clabbe 2026-03-19 15:06:37,684 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96ded0ec88e58bad0ea11 2026-03-19 15:06:37,684 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:06:37,698 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96ded0ec88e58bad0ea11 HTTP/1.1" 200 None 2026-03-19 15:06:37,700 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:06:37,713 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 15:06:37,714 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:06:37,741 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96ded0ec88e58bad0ea11 HTTP/1.1" 200 None 2026-03-19 15:06:37,743 - lava_callback - ERROR - Error processing callback for node 69b96ded0ec88e58bad0ea11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56926 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33634 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:33636 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:07:17,668 - lava_callback - INFO - Received callback for node 69b96e120ec88e58bad0ea20 INFO: 172.20.0.1:33638 - "POST /node/69b96e120ec88e58bad0ea20 HTTP/1.0" 202 Accepted 2026-03-19 15:07:17,674 - lava_callback - INFO - Starting async job submit for node 69b96e120ec88e58bad0ea20 2026-03-19 15:07:17,674 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:07:17,689 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96e120ec88e58bad0ea20 HTTP/1.1" 200 None 2026-03-19 15:07:17,689 - lava_callback - DEBUG - Processing node 69b96e120ec88e58bad0ea20: baseline-arm-clabbe 2026-03-19 15:07:17,690 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96e120ec88e58bad0ea20 2026-03-19 15:07:17,690 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:07:17,703 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96e120ec88e58bad0ea20 HTTP/1.1" 200 None 2026-03-19 15:07:17,704 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:07:17,717 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c7f91727ff69d6f21d89 HTTP/1.1" 200 None 2026-03-19 15:07:17,719 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:07:17,759 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96e120ec88e58bad0ea20 HTTP/1.1" 200 None 2026-03-19 15:07:17,760 - lava_callback - ERROR - Error processing callback for node 69b96e120ec88e58bad0ea20: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40540 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42968 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42972 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:07:46,099 - lava_callback - INFO - Received callback for node 69b96e3c0ec88e58bad0ea2c INFO: 172.20.0.1:53930 - "POST /node/69b96e3c0ec88e58bad0ea2c HTTP/1.0" 202 Accepted 2026-03-19 15:07:46,108 - lava_callback - INFO - Starting async job submit for node 69b96e3c0ec88e58bad0ea2c 2026-03-19 15:07:46,109 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:07:46,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96e3c0ec88e58bad0ea2c HTTP/1.1" 200 None 2026-03-19 15:07:46,126 - lava_callback - DEBUG - Processing node 69b96e3c0ec88e58bad0ea2c: baseline-arm64-baylibre 2026-03-19 15:07:46,126 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96e3c0ec88e58bad0ea2c 2026-03-19 15:07:46,127 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:07:46,140 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96e3c0ec88e58bad0ea2c HTTP/1.1" 200 None 2026-03-19 15:07:46,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:07:46,170 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:07:46,171 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:07:46,200 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96e3c0ec88e58bad0ea2c HTTP/1.1" 200 None 2026-03-19 15:07:46,215 - lava_callback - ERROR - Error processing callback for node 69b96e3c0ec88e58bad0ea2c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53936 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49556 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49570 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49014 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46878 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60664 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:09:06,398 - lava_callback - INFO - Received callback for node 69b96e8b0ec88e58bad0ea61 INFO: 172.20.0.1:33262 - "POST /node/69b96e8b0ec88e58bad0ea61 HTTP/1.0" 202 Accepted 2026-03-19 15:09:06,404 - lava_callback - INFO - Starting async job submit for node 69b96e8b0ec88e58bad0ea61 2026-03-19 15:09:06,405 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:09:06,419 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96e8b0ec88e58bad0ea61 HTTP/1.1" 200 None 2026-03-19 15:09:06,420 - lava_callback - DEBUG - Processing node 69b96e8b0ec88e58bad0ea61: baseline-arm64-baylibre 2026-03-19 15:09:06,421 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96e8b0ec88e58bad0ea61 2026-03-19 15:09:06,421 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:09:06,436 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96e8b0ec88e58bad0ea61 HTTP/1.1" 200 None 2026-03-19 15:09:06,438 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:09:06,452 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:09:06,453 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:09:06,474 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96e8b0ec88e58bad0ea61 HTTP/1.1" 200 None 2026-03-19 15:09:06,475 - lava_callback - ERROR - Error processing callback for node 69b96e8b0ec88e58bad0ea61: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:33268 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35302 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46842 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36566 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39482 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39488 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:10:26,266 - lava_callback - INFO - Received callback for node 69b96edb0ec88e58bad0ea77 INFO: 172.20.0.1:51584 - "POST /node/69b96edb0ec88e58bad0ea77 HTTP/1.0" 202 Accepted 2026-03-19 15:10:26,272 - lava_callback - INFO - Starting async job submit for node 69b96edb0ec88e58bad0ea77 2026-03-19 15:10:26,273 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:10:26,286 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96edb0ec88e58bad0ea77 HTTP/1.1" 200 None 2026-03-19 15:10:26,287 - lava_callback - DEBUG - Processing node 69b96edb0ec88e58bad0ea77: baseline-arm64-baylibre 2026-03-19 15:10:26,287 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96edb0ec88e58bad0ea77 2026-03-19 15:10:26,288 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:10:26,325 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96edb0ec88e58bad0ea77 HTTP/1.1" 200 None 2026-03-19 15:10:26,327 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:10:26,340 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:10:26,342 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:10:26,362 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96edb0ec88e58bad0ea77 HTTP/1.1" 200 None 2026-03-19 15:10:26,368 - lava_callback - ERROR - Error processing callback for node 69b96edb0ec88e58bad0ea77: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:51590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51210 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60932 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57994 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58010 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38760 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38764 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:11:46,308 - lava_callback - INFO - Received callback for node 69b96f280ec88e58bad0ea83 INFO: 172.20.0.1:55332 - "POST /node/69b96f280ec88e58bad0ea83 HTTP/1.0" 202 Accepted 2026-03-19 15:11:46,313 - lava_callback - INFO - Starting async job submit for node 69b96f280ec88e58bad0ea83 2026-03-19 15:11:46,314 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:11:46,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96f280ec88e58bad0ea83 HTTP/1.1" 200 None 2026-03-19 15:11:46,329 - lava_callback - DEBUG - Processing node 69b96f280ec88e58bad0ea83: baseline-arm64-baylibre 2026-03-19 15:11:46,330 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96f280ec88e58bad0ea83 2026-03-19 15:11:46,330 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:11:46,343 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96f280ec88e58bad0ea83 HTTP/1.1" 200 None 2026-03-19 15:11:46,344 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:11:46,360 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:11:46,361 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:11:46,381 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96f280ec88e58bad0ea83 HTTP/1.1" 200 None 2026-03-19 15:11:46,382 - lava_callback - ERROR - Error processing callback for node 69b96f280ec88e58bad0ea83: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:55344 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57624 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59396 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57712 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60680 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:59072 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38876 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42732 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:13:06,478 - lava_callback - INFO - Received callback for node 69b96f770ec88e58bad0ea91 INFO: 172.20.0.1:32864 - "POST /node/69b96f770ec88e58bad0ea91 HTTP/1.0" 202 Accepted 2026-03-19 15:13:06,484 - lava_callback - INFO - Starting async job submit for node 69b96f770ec88e58bad0ea91 2026-03-19 15:13:06,485 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:13:06,503 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96f770ec88e58bad0ea91 HTTP/1.1" 200 None 2026-03-19 15:13:06,503 - lava_callback - DEBUG - Processing node 69b96f770ec88e58bad0ea91: baseline-arm64-baylibre 2026-03-19 15:13:06,504 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96f770ec88e58bad0ea91 2026-03-19 15:13:06,504 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:13:06,517 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96f770ec88e58bad0ea91 HTTP/1.1" 200 None 2026-03-19 15:13:06,518 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:32866 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:13:06,532 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:13:06,534 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:13:06,554 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96f770ec88e58bad0ea91 HTTP/1.1" 200 None 2026-03-19 15:13:06,562 - lava_callback - ERROR - Error processing callback for node 69b96f770ec88e58bad0ea91: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35942 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35944 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34900 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34246 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34816 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:14:26,642 - lava_callback - INFO - Received callback for node 69b96fc50ec88e58bad0ea9c INFO: 172.20.0.1:34818 - "POST /node/69b96fc50ec88e58bad0ea9c HTTP/1.0" 202 Accepted 2026-03-19 15:14:26,647 - lava_callback - INFO - Starting async job submit for node 69b96fc50ec88e58bad0ea9c 2026-03-19 15:14:26,648 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:14:26,662 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96fc50ec88e58bad0ea9c HTTP/1.1" 200 None 2026-03-19 15:14:26,663 - lava_callback - DEBUG - Processing node 69b96fc50ec88e58bad0ea9c: baseline-arm64-baylibre 2026-03-19 15:14:26,664 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b96fc50ec88e58bad0ea9c 2026-03-19 15:14:26,664 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:14:26,677 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b96fc50ec88e58bad0ea9c HTTP/1.1" 200 None 2026-03-19 15:14:26,679 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:14:26,721 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:14:26,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:14:26,743 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b96fc50ec88e58bad0ea9c HTTP/1.1" 200 None 2026-03-19 15:14:26,752 - lava_callback - ERROR - Error processing callback for node 69b96fc50ec88e58bad0ea9c: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:43190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43202 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58832 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44838 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50448 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50450 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:15:46,494 - lava_callback - INFO - Received callback for node 69b970130ec88e58bad0eaa9 INFO: 172.20.0.1:52692 - "POST /node/69b970130ec88e58bad0eaa9 HTTP/1.0" 202 Accepted 2026-03-19 15:15:46,499 - lava_callback - INFO - Starting async job submit for node 69b970130ec88e58bad0eaa9 2026-03-19 15:15:46,500 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 INFO: 172.20.0.1:52704 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:15:46,515 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b970130ec88e58bad0eaa9 HTTP/1.1" 200 None 2026-03-19 15:15:46,516 - lava_callback - DEBUG - Processing node 69b970130ec88e58bad0eaa9: baseline-arm64-baylibre 2026-03-19 15:15:46,516 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b970130ec88e58bad0eaa9 2026-03-19 15:15:46,517 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:15:46,530 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b970130ec88e58bad0eaa9 HTTP/1.1" 200 None 2026-03-19 15:15:46,532 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:15:46,545 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:15:46,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:15:46,567 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b970130ec88e58bad0eaa9 HTTP/1.1" 200 None 2026-03-19 15:15:46,568 - lava_callback - ERROR - Error processing callback for node 69b970130ec88e58bad0eaa9: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:38770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55594 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50844 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50856 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48144 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39124 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40432 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58354 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:17:06,616 - lava_callback - INFO - Received callback for node 69b970640ec88e58bad0eab2 INFO: 172.20.0.1:58370 - "POST /node/69b970640ec88e58bad0eab2 HTTP/1.0" 202 Accepted 2026-03-19 15:17:06,622 - lava_callback - INFO - Starting async job submit for node 69b970640ec88e58bad0eab2 2026-03-19 15:17:06,623 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:17:06,637 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b970640ec88e58bad0eab2 HTTP/1.1" 200 None 2026-03-19 15:17:06,637 - lava_callback - DEBUG - Processing node 69b970640ec88e58bad0eab2: baseline-arm64-baylibre 2026-03-19 15:17:06,638 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b970640ec88e58bad0eab2 2026-03-19 15:17:06,638 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:17:06,651 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b970640ec88e58bad0eab2 HTTP/1.1" 200 None 2026-03-19 15:17:06,652 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:17:06,683 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:17:06,685 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:17:06,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b970640ec88e58bad0eab2 HTTP/1.1" 200 None 2026-03-19 15:17:06,706 - lava_callback - ERROR - Error processing callback for node 69b970640ec88e58bad0eab2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:49748 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49764 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54606 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41916 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48104 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35460 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:18:26,718 - lava_callback - INFO - Received callback for node 69b970ae0ec88e58bad0eac2 INFO: 172.20.0.1:35476 - "POST /node/69b970ae0ec88e58bad0eac2 HTTP/1.0" 202 Accepted 2026-03-19 15:18:26,724 - lava_callback - INFO - Starting async job submit for node 69b970ae0ec88e58bad0eac2 2026-03-19 15:18:26,724 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:18:26,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b970ae0ec88e58bad0eac2 HTTP/1.1" 200 None 2026-03-19 15:18:26,739 - lava_callback - DEBUG - Processing node 69b970ae0ec88e58bad0eac2: baseline-arm64-baylibre 2026-03-19 15:18:26,739 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b970ae0ec88e58bad0eac2 2026-03-19 15:18:26,740 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:18:26,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b970ae0ec88e58bad0eac2 HTTP/1.1" 200 None 2026-03-19 15:18:26,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:18:26,778 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:18:26,780 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:18:26,801 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b970ae0ec88e58bad0eac2 HTTP/1.1" 200 None 2026-03-19 15:18:26,803 - lava_callback - ERROR - Error processing callback for node 69b970ae0ec88e58bad0eac2: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:35582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38794 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42488 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40046 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41880 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41890 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56350 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:19:26,677 - lava_callback - INFO - Received callback for node 69b970f90ec88e58bad0eacd INFO: 172.20.0.1:56356 - "POST /node/69b970f90ec88e58bad0eacd HTTP/1.0" 202 Accepted 2026-03-19 15:19:26,682 - lava_callback - INFO - Starting async job submit for node 69b970f90ec88e58bad0eacd 2026-03-19 15:19:26,683 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:19:26,705 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b970f90ec88e58bad0eacd HTTP/1.1" 200 None 2026-03-19 15:19:26,706 - lava_callback - DEBUG - Processing node 69b970f90ec88e58bad0eacd: baseline-arm64-baylibre 2026-03-19 15:19:26,706 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b970f90ec88e58bad0eacd 2026-03-19 15:19:26,706 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:19:26,720 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b970f90ec88e58bad0eacd HTTP/1.1" 200 None 2026-03-19 15:19:26,721 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:19:26,734 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:19:26,735 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:19:26,756 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b970f90ec88e58bad0eacd HTTP/1.1" 200 None 2026-03-19 15:19:26,765 - lava_callback - ERROR - Error processing callback for node 69b970f90ec88e58bad0eacd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:57516 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57530 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56568 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56260 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48424 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54490 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54494 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50082 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38526 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46648 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:20:46,979 - lava_callback - INFO - Received callback for node 69b971470ec88e58bad0ead8 INFO: 172.20.0.1:46658 - "POST /node/69b971470ec88e58bad0ead8 HTTP/1.0" 202 Accepted 2026-03-19 15:20:46,985 - lava_callback - INFO - Starting async job submit for node 69b971470ec88e58bad0ead8 2026-03-19 15:20:46,986 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:20:47,001 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b971470ec88e58bad0ead8 HTTP/1.1" 200 None 2026-03-19 15:20:47,002 - lava_callback - DEBUG - Processing node 69b971470ec88e58bad0ead8: baseline-arm64-baylibre 2026-03-19 15:20:47,002 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b971470ec88e58bad0ead8 2026-03-19 15:20:47,003 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:20:47,017 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b971470ec88e58bad0ead8 HTTP/1.1" 200 None 2026-03-19 15:20:47,018 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:20:47,032 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:20:47,034 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:20:47,055 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b971470ec88e58bad0ead8 HTTP/1.1" 200 None 2026-03-19 15:20:47,065 - lava_callback - ERROR - Error processing callback for node 69b971470ec88e58bad0ead8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:50768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46036 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:46038 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33312 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48710 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42778 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49924 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37794 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51338 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42574 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42580 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33814 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36504 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34000 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49310 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60038 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38164 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44386 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44388 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42384 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50256 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38500 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58660 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58670 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52762 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49912 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52508 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52358 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52360 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47664 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35678 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35682 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:27:18,652 - lava_callback - INFO - Received callback for node 69b972cb0ec88e58bad0eb19 INFO: 172.20.0.1:35694 - "POST /node/69b972cb0ec88e58bad0eb19 HTTP/1.0" 202 Accepted 2026-03-19 15:27:18,657 - lava_callback - INFO - Starting async job submit for node 69b972cb0ec88e58bad0eb19 2026-03-19 15:27:18,658 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:27:18,672 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b972cb0ec88e58bad0eb19 HTTP/1.1" 200 None 2026-03-19 15:27:18,673 - lava_callback - DEBUG - Processing node 69b972cb0ec88e58bad0eb19: baseline-arm64-clabbe 2026-03-19 15:27:18,673 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b972cb0ec88e58bad0eb19 2026-03-19 15:27:18,673 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:27:18,694 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b972cb0ec88e58bad0eb19 HTTP/1.1" 200 None 2026-03-19 15:27:18,696 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:27:18,709 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b3c8061727ff69d6f21d98 HTTP/1.1" 200 None 2026-03-19 15:27:18,710 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:27:18,731 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b972cb0ec88e58bad0eb19 HTTP/1.1" 200 None 2026-03-19 15:27:18,733 - lava_callback - ERROR - Error processing callback for node 69b972cb0ec88e58bad0eb19: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44116 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44132 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46238 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49620 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55790 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:28:27,209 - lava_callback - INFO - Received callback for node 69b9730f0ec88e58bad0eb22 INFO: 172.20.0.1:55804 - "POST /node/69b9730f0ec88e58bad0eb22 HTTP/1.0" 202 Accepted 2026-03-19 15:28:27,217 - lava_callback - INFO - Starting async job submit for node 69b9730f0ec88e58bad0eb22 2026-03-19 15:28:27,218 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:28:27,238 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9730f0ec88e58bad0eb22 HTTP/1.1" 200 None 2026-03-19 15:28:27,239 - lava_callback - DEBUG - Processing node 69b9730f0ec88e58bad0eb22: baseline-arm64-baylibre 2026-03-19 15:28:27,239 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9730f0ec88e58bad0eb22 2026-03-19 15:28:27,240 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:28:27,253 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9730f0ec88e58bad0eb22 HTTP/1.1" 200 None 2026-03-19 15:28:27,254 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:28:27,267 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 15:28:27,269 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:28:27,289 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9730f0ec88e58bad0eb22 HTTP/1.1" 200 None 2026-03-19 15:28:27,294 - lava_callback - ERROR - Error processing callback for node 69b9730f0ec88e58bad0eb22: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:56582 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56590 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50140 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50146 - "GET /favicon.ico HTTP/1.0" 404 Not Found INFO: 172.20.0.1:47846 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42690 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:42704 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53488 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:29:47,303 - lava_callback - INFO - Received callback for node 69b9735c0ec88e58bad0eb30 INFO: 172.20.0.1:53490 - "POST /node/69b9735c0ec88e58bad0eb30 HTTP/1.0" 202 Accepted 2026-03-19 15:29:47,309 - lava_callback - INFO - Starting async job submit for node 69b9735c0ec88e58bad0eb30 2026-03-19 15:29:47,310 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:29:47,329 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9735c0ec88e58bad0eb30 HTTP/1.1" 200 None 2026-03-19 15:29:47,330 - lava_callback - DEBUG - Processing node 69b9735c0ec88e58bad0eb30: baseline-arm64-baylibre 2026-03-19 15:29:47,331 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9735c0ec88e58bad0eb30 2026-03-19 15:29:47,331 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:29:47,348 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9735c0ec88e58bad0eb30 HTTP/1.1" 200 None 2026-03-19 15:29:47,349 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:29:47,377 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b90e430ec88e58bad0d0ec HTTP/1.1" 200 None 2026-03-19 15:29:47,379 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:29:47,399 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9735c0ec88e58bad0eb30 HTTP/1.1" 200 None 2026-03-19 15:29:47,404 - lava_callback - ERROR - Error processing callback for node 69b9735c0ec88e58bad0eb30: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:60718 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53556 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:51978 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56848 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38030 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43592 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37072 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37076 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47622 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43828 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49796 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45904 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45908 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33416 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46064 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39436 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47742 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50560 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50562 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50148 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54964 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44460 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50018 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50028 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57350 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40328 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34546 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34560 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58806 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41200 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36960 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44740 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:52578 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57692 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45304 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60280 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54762 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47348 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37150 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43136 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60586 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50294 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50298 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57414 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60712 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60714 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51728 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34910 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53134 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41610 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41620 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56300 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55258 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52864 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39298 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39314 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42746 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36802 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56146 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38198 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60610 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:57050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45420 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35912 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32928 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38052 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48796 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48808 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57126 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57120 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41128 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36918 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37732 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57318 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44018 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33130 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45828 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:45832 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49296 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34020 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55468 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46054 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47438 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47446 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42362 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38618 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55098 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53774 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47126 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47128 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35062 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48892 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48902 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49176 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44708 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:44720 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60276 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53996 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56780 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41096 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35186 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34752 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60240 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46678 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45026 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60032 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47398 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:47406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36698 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46152 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46158 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45306 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56174 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:56178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41920 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55682 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55688 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42182 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57212 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58758 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58770 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42184 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57752 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57768 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54352 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57040 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58980 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58994 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43512 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43520 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45696 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:53:00,956 - lava_callback - INFO - Received callback for node 69b978cc151254d948eeea68 INFO: 172.20.0.1:53560 - "POST /node/69b978cc151254d948eeea68 HTTP/1.0" 202 Accepted 2026-03-19 15:53:00,961 - lava_callback - INFO - Starting async job submit for node 69b978cc151254d948eeea68 2026-03-19 15:53:00,962 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:53:01,000 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b978cc151254d948eeea68 HTTP/1.1" 200 None 2026-03-19 15:53:01,000 - lava_callback - DEBUG - Processing node 69b978cc151254d948eeea68: baseline-x86 2026-03-19 15:53:01,001 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b978cc151254d948eeea68 2026-03-19 15:53:01,001 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:53:01,021 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b978cc151254d948eeea68 HTTP/1.1" 200 None 2026-03-19 15:53:01,023 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:53:01,036 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b974a7151254d948eeea18 HTTP/1.1" 200 None 2026-03-19 15:53:01,037 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:53:01,057 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b978cc151254d948eeea68 HTTP/1.1" 200 None 2026-03-19 15:53:01,059 - lava_callback - ERROR - Error processing callback for node 69b978cc151254d948eeea68: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:53564 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54420 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54428 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38222 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34672 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34676 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33410 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34646 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53868 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53880 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37694 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58852 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58862 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:55626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54106 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43048 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:43050 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36650 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:55:28,731 - lava_callback - INFO - Received callback for node 69b9795d151254d948eeeab4 INFO: 172.20.0.1:36662 - "POST /node/69b9795d151254d948eeeab4 HTTP/1.0" 202 Accepted 2026-03-19 15:55:28,737 - lava_callback - INFO - Starting async job submit for node 69b9795d151254d948eeeab4 2026-03-19 15:55:28,738 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:28,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9795d151254d948eeeab4 HTTP/1.1" 200 None 2026-03-19 15:55:28,754 - lava_callback - DEBUG - Processing node 69b9795d151254d948eeeab4: baseline-arm-baylibre 2026-03-19 15:55:28,754 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9795d151254d948eeeab4 2026-03-19 15:55:28,755 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:28,775 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9795d151254d948eeeab4 HTTP/1.1" 200 None 2026-03-19 15:55:28,777 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:28,790 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-19 15:55:28,791 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:28,841 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9795d151254d948eeeab4 HTTP/1.1" 200 None 2026-03-19 15:55:28,847 - lava_callback - ERROR - Error processing callback for node 69b9795d151254d948eeeab4: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 15:55:29,387 - lava_callback - INFO - Received callback for node 69b9795f151254d948eeeab8 INFO: 172.20.0.1:36668 - "POST /node/69b9795f151254d948eeeab8 HTTP/1.0" 202 Accepted 2026-03-19 15:55:29,393 - lava_callback - INFO - Starting async job submit for node 69b9795f151254d948eeeab8 2026-03-19 15:55:29,394 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:29,408 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9795f151254d948eeeab8 HTTP/1.1" 200 None 2026-03-19 15:55:29,409 - lava_callback - DEBUG - Processing node 69b9795f151254d948eeeab8: baseline-arm-baylibre 2026-03-19 15:55:29,409 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9795f151254d948eeeab8 2026-03-19 15:55:29,409 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:29,447 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9795f151254d948eeeab8 HTTP/1.1" 200 None 2026-03-19 15:55:29,449 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:29,462 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-19 15:55:29,463 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:29,505 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9795f151254d948eeeab8 HTTP/1.1" 200 None 2026-03-19 15:55:29,514 - lava_callback - ERROR - Error processing callback for node 69b9795f151254d948eeeab8: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 15:55:30,071 - lava_callback - INFO - Received callback for node 69b97960151254d948eeeabd INFO: 172.20.0.1:40212 - "POST /node/69b97960151254d948eeeabd HTTP/1.0" 202 Accepted 2026-03-19 15:55:30,080 - lava_callback - INFO - Starting async job submit for node 69b97960151254d948eeeabd 2026-03-19 15:55:30,080 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:30,094 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97960151254d948eeeabd HTTP/1.1" 200 None 2026-03-19 15:55:30,095 - lava_callback - DEBUG - Processing node 69b97960151254d948eeeabd: baseline-arm-baylibre 2026-03-19 15:55:30,095 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b97960151254d948eeeabd 2026-03-19 15:55:30,096 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:30,109 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97960151254d948eeeabd HTTP/1.1" 200 None 2026-03-19 15:55:30,110 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:30,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-19 15:55:30,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:30,153 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b97960151254d948eeeabd HTTP/1.1" 200 None 2026-03-19 15:55:30,155 - lava_callback - ERROR - Error processing callback for node 69b97960151254d948eeeabd: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 15:55:30,717 - lava_callback - INFO - Received callback for node 69b97961151254d948eeead1 INFO: 172.20.0.1:40226 - "POST /node/69b97961151254d948eeead1 HTTP/1.0" 202 Accepted 2026-03-19 15:55:30,722 - lava_callback - INFO - Starting async job submit for node 69b97961151254d948eeead1 2026-03-19 15:55:30,723 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:30,738 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97961151254d948eeead1 HTTP/1.1" 200 None 2026-03-19 15:55:30,738 - lava_callback - DEBUG - Processing node 69b97961151254d948eeead1: baseline-arm-baylibre 2026-03-19 15:55:30,739 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b97961151254d948eeead1 2026-03-19 15:55:30,739 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:30,753 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97961151254d948eeead1 HTTP/1.1" 200 None 2026-03-19 15:55:30,754 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:30,767 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-19 15:55:30,768 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:30,794 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b97961151254d948eeead1 HTTP/1.1" 200 None 2026-03-19 15:55:30,796 - lava_callback - ERROR - Error processing callback for node 69b97961151254d948eeead1: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 15:55:31,405 - lava_callback - INFO - Received callback for node 69b97964151254d948eeeadc INFO: 172.20.0.1:40228 - "POST /node/69b97964151254d948eeeadc HTTP/1.0" 202 Accepted 2026-03-19 15:55:31,411 - lava_callback - INFO - Starting async job submit for node 69b97964151254d948eeeadc 2026-03-19 15:55:31,411 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:31,426 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97964151254d948eeeadc HTTP/1.1" 200 None 2026-03-19 15:55:31,427 - lava_callback - DEBUG - Processing node 69b97964151254d948eeeadc: baseline-arm-baylibre 2026-03-19 15:55:31,427 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b97964151254d948eeeadc 2026-03-19 15:55:31,428 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:31,441 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97964151254d948eeeadc HTTP/1.1" 200 None 2026-03-19 15:55:31,443 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:31,456 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-19 15:55:31,457 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:31,484 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b97964151254d948eeeadc HTTP/1.1" 200 None 2026-03-19 15:55:31,486 - lava_callback - ERROR - Error processing callback for node 69b97964151254d948eeeadc: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 15:55:32,088 - lava_callback - INFO - Received callback for node 69b97966151254d948eeeae0 INFO: 172.20.0.1:40242 - "POST /node/69b97966151254d948eeeae0 HTTP/1.0" 202 Accepted 2026-03-19 15:55:32,094 - lava_callback - INFO - Starting async job submit for node 69b97966151254d948eeeae0 2026-03-19 15:55:32,095 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:32,110 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97966151254d948eeeae0 HTTP/1.1" 200 None 2026-03-19 15:55:32,111 - lava_callback - DEBUG - Processing node 69b97966151254d948eeeae0: baseline-arm-baylibre 2026-03-19 15:55:32,111 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b97966151254d948eeeae0 2026-03-19 15:55:32,112 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:32,125 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97966151254d948eeeae0 HTTP/1.1" 200 None 2026-03-19 15:55:32,126 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:32,139 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-19 15:55:32,141 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:32,166 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b97966151254d948eeeae0 HTTP/1.1" 200 None 2026-03-19 15:55:32,167 - lava_callback - ERROR - Error processing callback for node 69b97966151254d948eeeae0: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:40256 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40264 - "GET / HTTP/1.0" 200 OK 2026-03-19 15:55:39,842 - lava_callback - INFO - Received callback for node 69b97973151254d948eeeb08 INFO: 172.20.0.1:44288 - "POST /node/69b97973151254d948eeeb08 HTTP/1.0" 202 Accepted 2026-03-19 15:55:39,847 - lava_callback - INFO - Starting async job submit for node 69b97973151254d948eeeb08 2026-03-19 15:55:39,848 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:39,863 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97973151254d948eeeb08 HTTP/1.1" 200 None 2026-03-19 15:55:39,863 - lava_callback - DEBUG - Processing node 69b97973151254d948eeeb08: baseline-arm-clabbe 2026-03-19 15:55:39,864 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b97973151254d948eeeb08 2026-03-19 15:55:39,864 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:39,877 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97973151254d948eeeb08 HTTP/1.1" 200 None 2026-03-19 15:55:39,879 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:39,895 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-19 15:55:39,896 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:39,917 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b97973151254d948eeeb08 HTTP/1.1" 200 None 2026-03-19 15:55:39,918 - lava_callback - ERROR - Error processing callback for node 69b97973151254d948eeeb08: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 15:55:40,503 - lava_callback - INFO - Received callback for node 69b9796e151254d948eeeaf5 INFO: 172.20.0.1:44296 - "POST /node/69b9796e151254d948eeeaf5 HTTP/1.0" 202 Accepted 2026-03-19 15:55:40,509 - lava_callback - INFO - Starting async job submit for node 69b9796e151254d948eeeaf5 2026-03-19 15:55:40,509 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:40,524 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9796e151254d948eeeaf5 HTTP/1.1" 200 None 2026-03-19 15:55:40,525 - lava_callback - DEBUG - Processing node 69b9796e151254d948eeeaf5: baseline-arm-clabbe 2026-03-19 15:55:40,525 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b9796e151254d948eeeaf5 2026-03-19 15:55:40,526 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:40,543 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9796e151254d948eeeaf5 HTTP/1.1" 200 None 2026-03-19 15:55:40,544 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:40,557 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-19 15:55:40,559 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:40,578 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b9796e151254d948eeeaf5 HTTP/1.1" 200 None 2026-03-19 15:55:40,583 - lava_callback - ERROR - Error processing callback for node 69b9796e151254d948eeeaf5: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 15:55:41,158 - lava_callback - INFO - Received callback for node 69b97972151254d948eeeb02 INFO: 172.20.0.1:44300 - "POST /node/69b97972151254d948eeeb02 HTTP/1.0" 202 Accepted 2026-03-19 15:55:41,164 - lava_callback - INFO - Starting async job submit for node 69b97972151254d948eeeb02 2026-03-19 15:55:41,165 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:41,180 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97972151254d948eeeb02 HTTP/1.1" 200 None 2026-03-19 15:55:41,181 - lava_callback - DEBUG - Processing node 69b97972151254d948eeeb02: baseline-arm-clabbe 2026-03-19 15:55:41,181 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b97972151254d948eeeb02 2026-03-19 15:55:41,182 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:41,197 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97972151254d948eeeb02 HTTP/1.1" 200 None 2026-03-19 15:55:41,198 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:41,213 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-19 15:55:41,214 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:41,234 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b97972151254d948eeeb02 HTTP/1.1" 200 None 2026-03-19 15:55:41,236 - lava_callback - ERROR - Error processing callback for node 69b97972151254d948eeeb02: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 15:55:41,855 - lava_callback - INFO - Received callback for node 69b97973151254d948eeeb05 INFO: 172.20.0.1:44314 - "POST /node/69b97973151254d948eeeb05 HTTP/1.0" 202 Accepted 2026-03-19 15:55:41,860 - lava_callback - INFO - Starting async job submit for node 69b97973151254d948eeeb05 2026-03-19 15:55:41,861 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:41,875 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97973151254d948eeeb05 HTTP/1.1" 200 None 2026-03-19 15:55:41,876 - lava_callback - DEBUG - Processing node 69b97973151254d948eeeb05: baseline-arm-clabbe 2026-03-19 15:55:41,877 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b97973151254d948eeeb05 2026-03-19 15:55:41,877 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:41,891 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97973151254d948eeeb05 HTTP/1.1" 200 None 2026-03-19 15:55:41,892 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:41,912 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-19 15:55:41,913 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:41,937 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b97973151254d948eeeb05 HTTP/1.1" 200 None 2026-03-19 15:55:41,938 - lava_callback - ERROR - Error processing callback for node 69b97973151254d948eeeb05: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' 2026-03-19 15:55:42,521 - lava_callback - INFO - Received callback for node 69b97976151254d948eeeb11 INFO: 172.20.0.1:44324 - "POST /node/69b97976151254d948eeeb11 HTTP/1.0" 202 Accepted 2026-03-19 15:55:42,527 - lava_callback - INFO - Starting async job submit for node 69b97976151254d948eeeb11 2026-03-19 15:55:42,527 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:42,544 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97976151254d948eeeb11 HTTP/1.1" 200 None 2026-03-19 15:55:42,545 - lava_callback - DEBUG - Processing node 69b97976151254d948eeeb11: baseline-arm-clabbe 2026-03-19 15:55:42,546 - lava_callback - WARNING - No log data found in callback Job failure metadata not found for node: 69b97976151254d948eeeb11 2026-03-19 15:55:42,546 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:42,560 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b97976151254d948eeeb11 HTTP/1.1" 200 None 2026-03-19 15:55:42,562 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:42,576 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "GET /latest/node/69b9747a151254d948eee9f0 HTTP/1.1" 200 None 2026-03-19 15:55:42,579 - urllib3.connectionpool - DEBUG - Starting new HTTPS connection (1): staging.kernelci.org:9000 2026-03-19 15:55:42,599 - urllib3.connectionpool - DEBUG - https://staging.kernelci.org:9000 "PUT /latest/nodes/69b97976151254d948eeeb11 HTTP/1.1" 200 None 2026-03-19 15:55:42,606 - lava_callback - ERROR - Error processing callback for node 69b97976151254d948eeeb11: 'lava' Traceback (most recent call last): File "/home/kernelci/pipeline/lava_callback.py", line 366, in async_job_submit _emit_callback_telemetry( File "/home/kernelci/pipeline/lava_callback.py", line 387, in _emit_callback_telemetry is_infra = job_callback.is_infra_error() if job_node.get( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/usr/local/lib/python3.12/site-packages/kernelci/runtime/lava.py", line 119, in is_infra_error lava_yaml = self._data['results']['lava'] ~~~~~~~~~~~~~~~~~~~~~^^^^^^^^ KeyError: 'lava' INFO: 172.20.0.1:44332 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38458 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40630 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48520 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:48532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48626 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45602 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:45614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54614 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41608 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46230 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60640 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:60654 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42442 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42316 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50262 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34584 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36544 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:36548 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41844 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41818 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41834 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48990 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33628 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58360 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:58376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38884 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53060 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33376 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41944 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41946 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39948 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57528 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49616 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53220 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53600 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39392 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:39394 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60866 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57510 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57524 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42474 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35744 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44090 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49382 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49390 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40070 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57058 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49776 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42354 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40836 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34800 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34810 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60472 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57006 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57016 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:60532 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49308 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43284 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53718 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:53722 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46632 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57706 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57716 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36440 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53110 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38554 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:32962 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:32974 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56954 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:39114 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48008 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42896 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46162 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35568 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:35572 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52938 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51804 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51820 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:52748 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58464 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37372 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:37846 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:37860 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41734 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57888 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:57904 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:48514 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:53048 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:35118 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34920 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:34934 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:56898 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51406 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:51418 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47292 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:42068 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38872 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41960 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:41970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47178 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47188 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50286 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:38956 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:41036 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:54168 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:54174 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:47002 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46190 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:46204 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:44886 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:34102 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:58270 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:49058 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:49074 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:36690 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40970 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40976 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:40650 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:33462 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:43264 - "GET / HTTP/1.0" 200 OK INFO: 172.20.0.1:50242 - "GET /api/metrics HTTP/1.0" 200 OK INFO: 172.20.0.1:50252 - "GET / HTTP/1.0" 200 OK INFO: Shutting down INFO: Waiting for application shutdown. INFO: Application shutdown complete. INFO: Finished server process [1]